You've successfully subscribed to Thematic
Great! Next, complete checkout for full access to Thematic
Welcome back! You've successfully signed in.
Success! Your account is fully activated, you now have access to all content.
Success! Your billing info is updated.
Billing info update failed.

How to theme qualitative data using thematic analysis software

If you have ever had to analyze customer feedback, you will know that the most difficult part is to create a perfect code frame. You need to understand the dataset, the stakeholders involved and the ideal outcomes of the analysis. You will have to iterate before settling on a solution, which might still not feel perfect.

There are now many thematic analysis software tools out there that can help you manage this process. Some rely on a lot of manual effort but automate theme management. Others use AI algorithms to automate parts of the process.

This amazing technology can help you analyze qualitative data in minutes, but at the same time creates new challenges. How should you think about themes and topics? How to organize them? How does sentiment come in?

In this post we’re diving deep into learning how to create the perfect theme model and code frame as you analyze your qualitative feedback. You’ll learn what a theme is, how to best organize them and how to combine thematic analysis with sentiment analysis. We’ll also address how Thematic helps discover and organize themes, and how you can collaborate with an AI algorithm to get the best results.

Why would I use an AI tool for thematic analysis?

The best approach to doing thematic analysis is reflective, where the researcher spends time getting a good feel of the data. So why would you automate the process with AI?

For a start, you don't want to lose hours manually coding text comments, only to deliver a report with insights that are no longer relevant. Whether you're a researcher, customer experience analyst, or head of insights, you can use an AI tool to manage the thematic analysis process in minutes. That way, you can spend your time delving into the insights and developing solutions!

Innovative service organizations like DoorDash and Atlassian depend on AI tools, like Thematic, to automatically uncover themes in their customer data. They transform their feedback into themes with AI so they can help every decision-maker get quality insights faster. This ease of access to customer insights is why these companies are better at driving sustainable growth while working in a high level of market uncertainty

There are a variety of AI-powered tools available. These tools use advanced algorithms to identify and analyze themes within large sets of data, helping uncover patterns and insights. With AI, you can do thematic analysis of a lot more data, and get more in-depth in the analysis. You can also do a full exploration of qualitative data, analyzing survey responses, community chat, social media and sales conversations. This way, you can see how customer feedback compares across different customer touchpoints.

While there are many thematic analysis software tools out there, only a few use AI algorithms to automatically explore and analyze the qualitative data for themes.

These tools use advanced algorithms to identify and analyze themes within large sets of data, helping uncover patterns and insights. By leveraging the power of AI, thematic analysis can be taken to the next level, allowing for more in-depth and comprehensive exploration of qualitative data

How is Thematic different to other AI solutions?

There are a variety of AI-powered tools available to automate thematic analysis. Our platform, Thematic, is one of the thematic analysis AI tools available. Thematic is specifically designed to analyze customer feedback to help organizations get insights to improve services and products.

Most AI tools are designed as a black box: You only see the input and the output, but not what happens in between. That's a big problem for thematic analysis, you need to be able to explore and discover your themes.

Thematic is different because the platform is built to give a transparent view of the analysis. This makes it possible for people to see how the AI has worked with the data, and then tweak the themes and theme model to make sure they fit their business language and decision-making. It also means researchers and CX leaders can guide how the AI analyzes the data. There is no need to rely on data scientists.

Human input is always needed to make AI results more relevant and accurate. In the industry, this approach is sometimes called Augmented Intelligence, Human-in-the-Loop, or Human-Centric AI.

That's why our software includes a special no-code tool called Themes Editor. In this tool, users can see the intermediate outputs of AI. It has an intuitive interface that’s similar to how we organize files into folders. In the Themes Editor users can see why feedback was analyzed in a certain way.

What is a theme?

Within the context of feedback analysis, a “theme” is the subject (or one of many subjects) within a piece of customer feedback. Themes are a core building block in qualitative data analysis. Themes meet the following criteria:

  • Answer the question “what is this feedback about”?
  • Mentioned by at least 2 people
  • Capture meaning through a selection of keywords and key phrases

For example, the theme “ease of creating an account” includes key phrases like “to create an account” as well as sentiment keywords like “impossible”.

Example of theme building by separating key phrases

A keyword-based approach would match the user’s words exactly. But the theme-based approach captures the meaning regardless of how people might express a theme.

Thematic’s advanced AI groups comments in customer reviews into “themes” automatically. Thematic uses “Unsupervised Machine Learning” to discover synonyms, paraphrases and key phrases which are worth tracking. Thematic allows users to view these in the Themes Editor where they can review and edit mapped phrases, as well merging and unmerging themes.

What is a mapped phrase?

A mapped phrase is a keyword or key phrase that maps to a theme. This is unique to Thematic. For example, the key phrase “simplicity of account creation” falls under the overall theme of “ease of creating an account”. A theme can have between one and several hundreds of mapped phrases.

Mapping phrases to a theme

Some solutions require users to come up with such phrases, or to think up rules and patterns that capture them.

Thematic automatically discovers and suggests mapped phrases. In the Themes Editor, you can always add them manually or delete them. And you can also do it in bulk.

What is a merged theme?

A merged theme is a theme that is very similar in meaning to another theme. In the example below the theme “ease of registering” merges into the theme “ease of creating an account”.

Example of merging 2 themes into 1

Thematic automatically merges some themes. But you can always unmerge them, or merge other themes as necessary.

What’s the difference between a theme and a tag?

A theme captures the subject of a piece of feedback. A tag is a more generic way of capturing anything relevant to a piece of feedback, including a theme. For example, some teams create tags for specific features they launch. A customer might say “I cannot find my user name”, which could have a theme “unable to find username” and be tagged with “Customer Profile Upgrade”.

Once you have a set of themes, you want to tag all feedback with those themes. Tagging means attaching a theme to a piece of customer feedback. Tagging can be done by a person or by an algorithm. Thematic tags feedback with themes automatically.

By tagging all your feedback with themes, you are basically turning your qualitative data into quantitative. You can now start running all sorts of analyses and visualize qualitative feedback in charts, dashboards and reports.

At Thematic, we also attach a sentiment score to each tagged theme. Let’s dig into this in a bit more detail.

Combining your themes with sentiment

Themes can be linked to sentiment in customer feedback in two different ways. (A function of Thematic is the process of sentiment analysis.)

Themes expressing sentiment

  1. The theme expresses the sentiment, for example “difficult to create an account” or “easy to create an account’.
Combining themes with sentiment

Themes expressing sentiment already capture meaning in a clear and expressive way. You can instantly take an action here, e.g. send everyone who submitted this feedback to your product team.

But these themes are not always a good choice for your code frame. Sometimes, when tagging feedback with a theme, the sentiment can be neutral or more specific than just positive or negative, e.g. “many features”, “professional staff”. If customers talk about many different attributes of a product or service in their feedback, having a negative and a positive theme will create an unwieldy code frame.  

Neutral themes, with sentiment filter

The theme can be neutral, for example “creating an account”, and sentiment is attached when a part of a sentence is tagged with that theme.

For example, in a sentence “It was easy for me in the end to create an account”, the theme “creating an account” has a positive sentiment. In a sentence, “It was impossible to follow the instructions to create an account”, it’s negative. The overall sentiment of a theme could be the average sentiment across all tags of that theme in feedback.

Handling sentiment in this way creates less themes and helps find less divisive themes. You can attach sentiment to any theme regardless of the additional sentiment or emotion it might carry, e.g. “exciting features”.

But this analysis can feel less actionable. For instance, imagine a piece of feedback “I struggled when trying to setup direct debit”. It can be themed in two ways:

  1. The theme is “Difficult to set up direct debit”.
  2. The theme is “Setting up direct debit” and the tagged sentiment is negative.

Both express the same information but the first theming feels more actionable.  

Thematic combines both approaches, using the first approach for frequent themes and the second approach for infrequent themes. Just to make sure, it attaches sentiment to all tagged themes.

How to organize themes into a hierarchy

To make it easier to work with themes, it’s best to organize them into a hierarchy. There can be two or three-level hierarchical code frames. Some use sentiment as an intermediate level in the hierarchy. But what’s the best way of organizing themes?

Let’s look at these two examples:

Examples of themes organised in a hierachy

They organize a similar set of themes in two different ways. The code frame on the right seems useful at first glance. You could share all feedback that falls under “Difficult to use” with the UX team and they could analyze the theme by the feature used. But should they focus on improving the UX of registration or setting up direct debit? To understand which part of the UI is more difficult they need to compare the numbers in the “Easy to use” group first.

The approach on the left is focused on the functional areas of the product or service. Ease of use is a separate theme, which can appear alongside more functional themes. If we know that “Setup direct debit” has overall negative sentiment, we can now start looking into why. It may be that the UI is difficult to use or there might be errors outside of the UI.

Thematic is more likely to use the approach on the right when grouping themes automatically. It builds a hierarchy according to frequency of themes. If Billing is mentioned often (there is a lot of feedback tagged with that theme), it becomes a top-level theme, or a base theme as we call it. If a less frequent theme is similar to Billing, Thematic groups it underneath so that it becomes a sub theme.  

Working with themes to create an analysis

Now that you have a code frame of perfect themes and a way of capturing sentiment alongside themes, you can start analyzing your data. Here are some of the reports you can build in Excel, Tableau, Power BI or Thematic. If you can't decide between Tableau or Power BI, read our comprehensive guide: Power BI vs Tableau.

Themes by volume

This report is also called a histogram. It allows you to view the most common themes in the data. You can answer the questions like:

  • “What do people talk the most about?”
  • “Do users care more about X or Y”
  • “What are the biggest differences between what matters to two customer segments?” (if you filter the data by customer segment first)

Here is how we create such a report in Thematic.

This shows what people are mentioning most in their feedback. Within the “features” theme, the most common theme is about depositing checks.
This shows what people are mentioning most in their feedback. Within the “features” theme, the most common theme is about depositing checks.
In this example, we are comparing ★ and ★★★★★ reviews. Within the “access my account” theme, we can see that most ★ reviews are about login issues.
In this example, we are comparing ★ and ★★★★★ reviews. Within the “access my account” theme, we can see that most ★ reviews are about login issues.

Themes by score

If you have a score, such as a star rating or an NPS score, you can group themes to see the ones linked to lowest and highest scores. They might not be frequent, but could be important.

  • Themes linked to highest positive scores describe how you add value to your customers.
  • Themes linked to the lowest negative scores describe where you fall below customer expectations.
Here we can see that the feedback with the highest scores mention a great user experience, reliability, and speed. In contrast, the lowest scoring feedback is from users having issues with app updates.
Here we can see that the feedback with the highest scores mention a great user experience, reliability, and speed. In contrast, the lowest scoring feedback is from users having issues with app updates.

Theme volume over time

If you have a time element in your data, you can visualize a trend. Is the frequency of a theme over time declining or increasing? This kind of report will tell you if customers noticed the improvements you are making in a specific area, or an issue that might be on the rise.

In this example, May-June 2019 saw a spike in feedback about depositing checks. It turns out that this was caused by problems related to the check depositing service of this app.

Thematic provides other visualizations out-of-the-box such as impact, waterfall and anomaly detection.

How to refine themes over time

As more feedback is added to your dataset and as your product and service evolve, your themes will change. You will want to reorganize the theme to account for these changes.

In Thematic, we built a tool called Themes Editor for managing your themes.

Thematic themes editor, showing creating, deleting, renaming and moving themes around

Our Themes Editor can also be used to review comments that don’t have any themes and run themes discoveries. There might be a new theme that can emerge from newly added feedback. The AI can also automatically suggest more similar themes to create granularity in one area of your feedback.

Want to learn more?

The easiest way to experience how you can use AI to theme your data is to try out the approach on your own data. Thematic offers a free trial for companies with a lot of feedback volume, so that you can see the quality of analysis possible with AI. Book a demo with Thematic to see how it works on your data.

Ready to scale customer insights from feedback?

Our experts will show you how Thematic works, how to discover pain points and track the ROI of decisions. To access your free trial, book a personal demo today.

Recent posts

How Watercare drive customer excellence with VoC and Thematic
How Watercare drive customer excellence with VoC and Thematic
Members Public

Watercare, New Zealand's largest water and wastewater utility, are responsible for bringing clean water to people and managing the waste water systems that safeguard the Auckland environment and citizen health. On a typical day, Aucklanders don’t say much to Watercare. Water as a sector gets taken for granted, with

Customer Journeys
How to super-charge your Qualtrics setup with Thematic & Power BI
How to super-charge your Qualtrics setup with Thematic & Power BI
Members Public

Qualtrics is one of the most well-known and powerful Customer Feedback Management platforms. But even so, it has limitations. We recently hosted a live panel where data analysts from two well-known brands shared their experiences with Qualtrics, and how they extended this platform’s capabilities. Below, we’ll share the

Customer Experience
How we use our own platform and Chrome extension to centralize & analyze feedback
How we use our own platform and Chrome extension to centralize & analyze feedback
Members Public

Customer feedback doesn't have all the answers. But it has critical insights for strategy and prioritization. Thematic is a B2B SaaS company. We aren't swimming in feedback. Every piece of feedback counts. Collecting and analyzing this feedback requires a different approach. We receive feedback from many places: * our in-product NPS

Feedback Analysis