You've successfully subscribed to Thematic
Great! Next, complete checkout for full access to Thematic
Welcome back! You've successfully signed in.
Success! Your account is fully activated, you now have access to all content.
Success! Your billing info is updated.
Billing info update failed.

How to build a customer feedback taxonomy

When I speak to market researchers and insights analysts, they often share how they “cut their teeth” manually coding open-ends. Many started their careers sitting in tiny offices reading verbatims for hours on end. Each verbatim was assigned a code. These codes were grouped into a code frame, also called a taxonomy.

Traditionally people built these feedback taxonomies manually. More recently, they've been assisted by AI. And there’s an art and science to it! So what is the right way?

In this article, we share our learnings on how to build and maintain a perfect customer feedback taxonomy. After all, at Thematic, we’ve seen over a hundred teams build theirs using our solution.

Example of a taxonomy being built from customer feedback

Why organize feedback into taxonomies?

To make sense of free-text customer feedback, researchers and analysts use taxonomies, or hierarchies of themes.

These taxonomies capture patterns in feedback. These patterns can be expressed as broad topics or categories, or as highly specific themes. The idea behind this task is to bring structure to unstructured text.

Once all feedback is organized into a taxonomy of themes, you can find trends in this data and compare segments.

Example of a taxonomy of themes within Thematic
Example of a feedback taxonomy for a cable TV company in Thematic

What makes a perfect customer feedback taxonomy?

Let’s face it, there is no 'gold standard' when it comes to taxonomies. Even experts might disagree on how to organize and group themes discovered in feedback.

In our view, a perfect customer feedback taxonomy is one that’s useful. In business context, useful taxonomies put feedback to work: they align teams on what matters and inform decision making.

Among our customers, we find that useful taxonomies:

  1. Have at least 2 levels, otherwise you just have a 'laundry list of terms'
  2. Have specific (typically multi-word) themes, e.g. “login issues”, “not enough seating” that are easily understood by anyone in your company, are actionable and relevant
  3. Organize themes by functional business areas, e.g. “usability” (for UX team), “staff attributes” (for customer service training), “search functionality” (for critical feature development)
  4. Have good coverage in that all sentences that express an opinion have one or more themes associated with them. At least 80% of feedback usually falls into repeating themes and categories.
  5. Reflect anecdotal experience by customer service team who are close to customers and repeatedly hear their frustrations. At the same time, it should not be biased by the views of some stakeholders.

Taxonomies that aren’t useful are usually:

a) too generic and

b) don’t reflect the feedback well.

The first issue often happens when themes are discovered by a not very smart AI. Typically, algorithms pick up patterns that are common but aren’t important. For example, company name or text of the question.

The second issue often happens when a predefined taxonomy is applied to feedback, or when people who create the taxonomy aren’t close to customer issues.

How to create a feedback taxonomy?

Traditionally, market researchers made sense of qualitative data (text), by using manual coding.

They built a code-frame in an inductive fashion:

  1. Read 50 pieces of feedback and determine an initial set of categories for the text.
  2. Read the next 50 pieces of feedback. Do they fall into initial set of categories? If new patterns emerge, re-read the first 50 pieces of feedback to re-categorize it.
  3. Repeat by categorizing all feedback in batches, while deciding on the best structure for the taxonomy.

When working with an AI-solution, some people prefer to “seed” AI with themes of interest or extend a pre-defined taxonomy. Others prefer to get AI to discover themes and then refine them.

I like to tell people that AI is like an intern you hire to work at your company. They might be bright, but they don’t know your business. You will need to guide the AI to the outcome you need: add missing themes, remove irrelevant themes etc. Make sure that the solution you use makes this process easy.

Here is Thematic’s help article that teaches our users how to refine an AI-generated taxonomy.

How to tailor a feedback taxonomy to your use case?

A feedback taxonomy needs to align with your use case. Otherwise, it won’t be useful.

Here are some examples of customer taxonomies we’ve seen:

Use case 1. B2B company with 1,000 short NPS verbatims per year. Goal: Understand drivers of customer satisfaction

A simple taxonomy with generic themes like “pricing” and “customer service” might be good enough. To dig deeper, you might have sub-themes below. For example, under “pricing” you could have “cheap”, “expensive”, “discounts”, “price vs. value” and “price increases”.

Use case 2. B2C company with 100,000 verbatims. Goal: Guide product strategy

A taxonomy that captures features and lets you dig into common issues, questions and requests is ideal here. For example, you might have “registration” as a theme, because it’s a specific product area. Below, you might have “difficulty registering”, “register via single sign-on”, “report registrations” etc.

Use case 3. B2C company with 1,000,000 verbatims. Goal: Personalized marketing campaigns

You can capture what individual customers care about in a CRM and then send them personalized emails based on these preferences. Here, you need to closely work with the marketing team to understand what kind of campaigns they have in mind. For example, the team might want to reward price sensitive loyal customers who don’t feel valued to decrease churn. You’ll need to look at the data on how people express this and make sure that these themes are captured.

Example of analysis showing long-time customers complaining about deals for new customers
Example of analysis showing long-time customers complaining about deals for new customers

How to evolve a feedback taxonomy over time

Imagine a feedback taxonomy that changes with each upload of new feedback. You won’t be able to report over-time trends! Or imagine a static taxonomy that never changes. You won’t pick up themes that emerge due to new issues, market conditions or product improvements.

So, an ideal taxonomy needs to be consistent over time and also evolve to capture new themes. How can this be achieved?

In our experience, this needs to be led by the taxonomy owner or manager.

If a feedback taxonomy is created without the use of AI, its creator / manager needs to regularly read incoming new feedback for emerging themes. If AI is used, you can configure it to show emerging themes in the data, to get suggestions on where these themes should be grouped, or even notified by AI as new themes emerge, so that you don’t have to prompt it.

In any case, you don’t want a taxonomy that grows on its own. This is a great recipe for a messy, useless taxonomy.

A case for ditching a taxonomy altogether

But wait, AI is getting smarter, and can even write my reports. Do we even need a taxonomy?

Large language models like GPT-3 capture trends and summarize feedback without the need of an intermediate step. For example, here’s a GPT-3 summary of the most common issues in an app called Robinhood.

GPT-3 summary of Robinhood feedback

If that’s all you need from your feedback, you might not need a taxonomy. However, you won’t be able to:

  1. Quantify issues. Should your team fix the rejection of orders or app speed? You don’t know what’s more important to your customers from this snippet.
  2. Track improvements over time. Is it more or less difficult to buy this month compared to last month?

So, customer feedback taxonomies are here to stay! But thankfully, AI makes it much easier to build and maintain them.

Keen to see an example? We have a combined customer feedback taxonomy template, pulled from 40+ product companies. This will give you a good idea of which themes and sub-themes to consider when building your own taxonomy. Click on the image below to download.

Preview of taxonomy download

If you'd like to see how Thematic can help you get the insights you need from customer feedback, book a consult with one of our team - we'd be thrilled to show you how Thematic works!

Ready to scale customer insights from feedback?

Our experts will show you how Thematic works, how to discover pain points and track the ROI of decisions. To access your free trial, book a personal demo today.

Recent posts

How to theme qualitative data using thematic analysis software
How to theme qualitative data using thematic analysis software
Members Public

Become a qualitative theming pro! Creating a perfect code frame is hard, but thematic analysis software makes the process much easier.

AI & NLP
How to super-charge your Qualtrics setup with Thematic & Power BI
How to super-charge your Qualtrics setup with Thematic & Power BI
Members Public

Qualtrics is one of the most well-known and powerful Customer Feedback Management platforms. But even so, it has limitations. We recently hosted a live panel where data analysts from two well-known brands shared their experiences with Qualtrics, and how they extended this platform’s capabilities. Below, we’ll share the

Customer Experience
How we use our own platform and Chrome extension to centralize & analyze feedback
How we use our own platform and Chrome extension to centralize & analyze feedback
Members Public

Customer feedback doesn't have all the answers. But it has critical insights for strategy and prioritization. Thematic is a B2B SaaS company. We aren't swimming in feedback. Every piece of feedback counts. Collecting and analyzing this feedback requires a different approach. We receive feedback from many places: * our in-product NPS

Feedback Analysis