How To Use Thematic Analysis AI To Theme Qualitative Data
If you have ever had to analyze customer feedback, you will know that the most difficult part is to create a perfect code frame. You need to understand the dataset, the stakeholders involved and the ideal outcomes of the analysis. You will have to iterate before settling on a solution, which might still not feel perfect.
There are now many thematic analysis software tools out there that can help you manage this process. Some rely on a lot of manual effort but automate theme management. Others use AI algorithms to automate parts of the process. Artificial intelligence (AI) algorithms are capable of assisting in the interpretation and extraction of themes from vast datasets, bringing unparalleled speed and accuracy to the analysis process.
This amazing technology can help you analyze qualitative data in minutes, but at the same time creates new challenges. How should you think about themes and topics? How to organize them? How does sentiment come in?
In this post we’re diving deep into learning how to create the perfect theme model and code frame as you analyze your qualitative feedback. You’ll learn what a theme is, how to best organize them and how to combine thematic analysis with sentiment analysis. We’ll also address how Thematic helps discover and organize themes, and how you can collaborate with an AI algorithm to get the best results.
Why would I use an AI tool for thematic analysis?
The best approach to doing thematic analysis is reflective, where the researcher spends time getting a good feel of the data. So why would you automate the process with AI?
For a start, you don’t want to lose hours manually coding text comments, only to deliver a report with insights that are no longer relevant. Human analysis has its limitations, such as personal biases and oversight. In contrast, thematic analysis software offers accuracy and consistency. Whether you're a researcher, customer experience analyst, or head of insights, you can use an AI tool to manage the thematic analysis process in minutes. That way, you can spend your time delving into the insights and developing solutions!
How to use Thematic Analysis AI software
- Select Thematic Analysis AI Software: Choose a thematic analysis AI software that suits your needs and budget. Thematic is a popular option known for its user-friendly interface and powerful AI capabilities.
- Create an Account and Upload Your Data: Sign up for a free trial or purchase a subscription to the chosen software. Once you have access, you can add data such as product reviews, survey responses, support chat or conversations. The software should support various file formats like CSV, Excel, or plain text.
- Pre-process the Data (Optional): Some software can help with pre-processing your data, such as removing irrelevant information or standardizing formatting. Follow the software's instructions for this step.
- Train the AI Model (If Needed): If the software uses machine learning, you might need to train the AI model on a portion of your data. This step is only required by some software. The AI is trained to understand the language and context of your data
- Run the Thematic Analysis: Initiate the thematic analysis process. The AI will automatically identify patterns and relationships in the feedback, and similar patterns of feedback will be grouped into a theme. The AI will take a few minutes to do a thematic analysis across all your feedback data.
- Review and Refine Themes: Examine the generated themes and their associated feedback. Merge, split, or rename themes as needed to ensure they accurately represent the underlying meaning in the data.
- Analyze Sentiment (Optional): Many thematic analysis AI tools also offer sentiment analysis. This can help you understand the emotional tone associated with each theme, providing deeper insights into your data.
- Visualize and Report: Use the software's visualization tools to create charts, graphs, or word clouds that illustrate the most prevalent themes and their relationships. Generate reports to share your findings with stakeholders.
Large organizations like DoorDash and Atlassian depend on AI-powered analytics tools, like Thematic to create a meaningful structure out of thousands of customer comments, to quickly identify what matters to customers and why. This helps their decision makers to get a clear understanding of customer needs, while working in a high level of market uncertainty
There are a variety of AI-powered analytics tools available. These tools use advanced algorithms to identify and analyze themes within large sets of data, helping uncover patterns and insights. With AI, you can do thematic analysis of a lot more data, and get more in-depth in the analysis. You can also do a full exploration of qualitative data, analyzing survey responses, community chat, social media and sales conversations. This way, you can see how customer feedback compares across different customer touchpoints.
While there are many thematic analysis software tools out there, only a few use AI to automatically explore and analyze the qualitative data for themes.
These tools use advanced algorithms to identify and analyze themes within large sets of data, helping uncover patterns and insights. By leveraging the power of AI, thematic analysis can be taken to the next level, allowing for more in-depth and comprehensive exploration of qualitative data
How is Thematic different to other AI solutions?
There are a variety of AI-powered tools available to automate thematic analysis. Our platform, Thematic, is one of the AI-powered tools available. Thematic is specifically designed to analyze all channels of customer feedback to help organizations get insights to improve services and products.
While Thematic is built so you can dive into and explore how the AI has analyzed the data, most AI tools are designed as a black box: You only see the input and the output, but not what happens in between. That's a big problem for thematic analysis and researchers. To get a proper understanding, you need to be able to explore and work with your themes.
Thematic is built so researchers can see how the AI has worked with the data, and the layers of analysis. Our software includes a special tool called the Theme Editor that you can interact with in a simple drag-and-drop way. Similar to how you work with software files and folders. you can explore the contents, merge, reorganize, rename and delete themes.
The Theme Editor makes it easy for researchers to see why feedback was analyzed in a certain way and guide the AI to refine the analysis. There's no need for a data scientist.
Human input is always needed to make AI results more relevant and accurate. In the industry, this approach is sometimes called Augmented Intelligence, Human-in-the-Loop, or Human-Centric AI.
What is a Theme in AI-Powered Thematic Analysis?
In the context of AI-powered thematic analysis, like that offered by Thematic, a "theme" represents a recurring pattern or topic identified within a dataset. These themes are not merely keywords but encapsulate the underlying meaning and sentiment expressed in the text.
Thematic
AI-powered software to transform qualitative data at scale through a thematic and content analysis.
Within the context of feedback analysis, a “theme” is the subject (or one of many subjects) within a piece of customer feedback. Themes are identified within large sets of text data, such as customer feedback, open-ended survey responses, and social media content. Themes are identified within large sets of text data, such as customer feedback, open-ended survey responses, and social media content. Themes are a core building block in qualitative data analysis. Themes meet the following criteria:
- Answer the question “what is this feedback about”?
- Mentioned by at least 2 people
- Capture meaning through a selection of keywords and key phrases
For example, the theme “ease of creating an account” includes key phrases like “to create an account” as well as sentiment keywords like “impossible”.
A keyword-based approach would match the user’s words exactly. But the theme-based approach captures the meaning regardless of how people might express a theme.
Thematic’s advanced AI groups comments in customer reviews into “themes” automatically. Thematic uses “Unsupervised Machine Learning” to discover synonyms, paraphrases and key phrases which are worth tracking. Thematic allows users to view these in the Themes Editor where they can review and edit mapped phrases, as well merging and unmerging themes.
What is a Mapped Phrase in Thematic's AI?
Thematic's AI introduces the concept of "mapped phrases." These are specific words or phrases that the AI identifies as strongly associated with a particular theme. Thematic automatically discovers and suggests mapped phrases, but users can refine these in the Themes Editor.
A mapped phrase is a keyword or key phrase that maps to a theme within large sets of textual data.This is unique to Thematic. For example, the key phrase “simplicity of account creation” falls under the overall theme of “ease of creating an account”. A theme can have between one and several hundreds of mapped phrases.
Some solutions require users to come up with such phrases, or to think up rules and patterns that capture them.
Thematic automatically discovers and suggests mapped phrases. In the Themes Editor, you can always add them manually or delete them. And you can also do it in bulk.
What is a Merged Theme in Thematic's AI?
Thematic's AI can automatically merge themes that are very similar in meaning. This streamlines the analysis process and helps users focus on the most salient themes. Users can review and adjust these merged themes as needed.
A merged theme is a theme that is very similar in meaning to another theme. In the example below the theme “ease of registering” merges into the theme “ease of creating an account”. Merging themes is an important part of the thematic analysis workflow to ensure accurate representation of the data. In the example below the theme “ease of registering” merges into the theme “ease of creating an account”.
Thematic automatically merges some themes. But you can always unmerge them, or merge other themes as necessary.
Themes vs. Tags in Thematic's AI
While both themes and tags categorize feedback, Thematic's AI distinguishes them. Themes capture the core subject matter, while tags are more flexible labels that can include themes, features, or other relevant details.
Themes and tags are essential components of qualitative analysis, helping to capture and categorize feedback data. A theme captures the subject of a piece of feedback. A tag is a more generic way of capturing anything relevant to a piece of feedback, including a theme. For example, some teams create tags for specific features they launch. A customer might say “I cannot find my user name”, which could have a theme “unable to find username” and be tagged with “Customer Profile Upgrade”.
Once you have a set of themes, you want to tag all feedback with those themes. Tagging means attaching a theme to a piece of customer feedback. Tagging can be done by a person or by an algorithm. Thematic tags feedback with themes automatically.
By tagging all your feedback with themes, you are basically turning your qualitative data into quantitative. You can now start running all sorts of analyses and visualize qualitative feedback in charts, dashboards and reports.
At Thematic, we also attach a sentiment score to each tagged theme. Let’s dig into this in a bit more detail.
Combining your themes with sentiment
Themes can be linked to sentiment in customer feedback in two different ways. (A function of Thematic is the process of sentiment analysis.)
Themes expressing sentiment
- The theme expresses the sentiment, for example “difficult to create an account” or “easy to create an account’.
Themes expressing sentiment already capture meaning in a clear and expressive way. You can instantly take an action here, e.g. send everyone who submitted this feedback to your product team.
But these themes are not always a good choice for your code frame. Sometimes, when tagging feedback with a theme, the sentiment can be neutral or more specific than just positive or negative, e.g. “many features”, “professional staff”. If customers talk about many different attributes of a product or service in their feedback, having a negative and a positive theme will create an unwieldy code frame.
Neutral themes, with sentiment filter
The theme can be neutral, for example “creating an account”, and sentiment is attached when a part of a sentence is tagged with that theme.
For example, in a sentence “It was easy for me in the end to create an account”, the theme “creating an account” has a positive sentiment. In a sentence, “It was impossible to follow the instructions to create an account”, it’s negative. The overall sentiment of a theme could be the average sentiment across all tags of that theme in feedback.
Handling sentiment in this way creates less themes and helps find less divisive themes. You can attach sentiment to any theme regardless of the additional sentiment or emotion it might carry, e.g. “exciting features”.
But this analysis can feel less actionable. For instance, imagine a piece of feedback “I struggled when trying to setup direct debit”. It can be themed in two ways:
- The theme is “Difficult to set up direct debit”.
- The theme is “Setting up direct debit” and the tagged sentiment is negative.
Both express the same information but the first theming feels more actionable.
Thematic combines both approaches, using the first approach for frequent themes and the second approach for infrequent themes. Just to make sure, it attaches sentiment to all tagged themes.
How to organize themes into a hierarchy
To make it easier to work with themes, it’s best to organize them into a hierarchy. There can be two or three-level hierarchical code frames. Some use sentiment as an intermediate level in the hierarchy. But what’s the best way of organizing themes?
Let’s look at these two examples:
They organize a similar set of themes in two different ways. The code frame on the right seems useful at first glance. You could share all feedback that falls under “Difficult to use” with the UX team and they could analyze the theme by the feature used. But should they focus on improving the UX of registration or setting up direct debit? To understand which part of the UI is more difficult they need to compare the numbers in the “Easy to use” group first.
As your product or service evolves and you gather more feedback, your themes will naturally shift. Regularly review and refine your themes using tools like Thematic's Themes Editor. This ensures your analysis remains relevant and actionable. Thematic's AI can even suggest new themes or refinements based on the latest data.
The approach on the left is focused on the functional areas of the product or service. Ease of use is a separate theme, which can appear alongside more functional themes. If we know that “Setup direct debit” has overall negative sentiment, we can now start looking into why. It may be that the UI is difficult to use or there might be errors outside of the UI.
Thematic is more likely to use the approach on the right when grouping themes automatically. It builds a hierarchy according to frequency of themes. If Billing is mentioned often (there is a lot of feedback tagged with that theme), it becomes a top-level theme, or a base theme as we call it. If a less frequent theme is similar to Billing, Thematic groups it underneath so that it becomes a sub theme.
Working with themes to create an analysis
Now that you have a code frame of perfect themes and a way of capturing sentiment alongside themes, you can start analyzing your data. Here are some of the reports you can build in Excel, Tableau, Power BI or Thematic. If you can't decide between Tableau or Power BI, read our comprehensive guide: Power BI vs Tableau.
Themes by volume
This report is also called a histogram. It allows you to view the most common themes in the data. You can answer the questions like:
- “What do people talk the most about?”
- “Do users care more about X or Y”
- “What are the biggest differences between what matters to two customer segments?” (if you filter the data by customer segment first)
Here is how we create such a report in Thematic.
This shows what people are mentioning most in their feedback. Within the “features” theme, the most common theme is about depositing checks.
In this example, we are comparing ★ and ★★★★★ reviews. Within the “access my account” theme, we can see that most ★ reviews are about login issues.
Themes by score
If you have a score, such as a star rating or an NPS score, you can group themes to see the ones linked to lowest and highest scores. They might not be frequent, but could be important.
- Themes linked to highest positive scores describe how you add value to your customers.
- Themes linked to the lowest negative scores describe where you fall below customer expectations.
Here we can see that the feedback with the highest scores mention a great user experience, reliability, and speed. In contrast, the lowest scoring feedback is from users having issues with app updates.
Theme volume over time
If you have a time element in your data, you can visualize a trend. Is the frequency of a theme over time declining or increasing? This kind of report will tell you if customers noticed the improvements you are making in a specific area, or an issue that might be on the rise.
In this example, May-June 2019 saw a spike in feedback about depositing checks. It turns out that this was caused by problems related to the check depositing service of this app.
Thematic provides other visualizations out-of-the-box such as impact, waterfall and anomaly detection.
How to refine themes over time
As more feedback is added to your dataset and as your product and service evolve, your themes will change. You will want to reorganize the theme to account for these changes.
Don't just identify themes; analyze the sentiment associated with them. This provides a deeper understanding of the emotional tone behind customer feedback, allowing for more targeted actions. Thematic's AI can automatically attach sentiment scores to each tagged theme, streamlining this process.
In Thematic, we built a tool called Themes Editor for managing your themes.
Our Themes Editor can also be used to review comments that don’t have any themes and run themes discoveries. There might be a new theme that can emerge from newly added feedback. The AI can also automatically suggest more similar themes to create granularity in one area of your feedback.
Want to learn more?
The easiest way to experience how you can use AI to theme your data is to try out the approach on your own data. Thematic offers a free trial for companies with a lot of feedback volume, so that you can see the quality of analysis possible with AI. Book a demo with Thematic to see how it works on your data.
