Advanced Concept Testing Approaches To Guide Product Development and Business Decisions
Summary
Key Insights
-
•
Concept testing is crucial before product development to validate market need but is underutilized in UX research.
-
•
Three types of concept testing address different questions: what a product does, why users should care, and how to communicate benefits.
-
•
Monadic, sequential, and trade-off testing methods offer varying cost, complexity, and discrimination power trade-offs.
-
•
Trade-off techniques like MaxDiff and conjoint analysis provide stronger discrimination and work well across cultures.
-
•
Combining qualitative research before and after quantitative concept testing improves hypothesis formulation and insights interpretation.
-
•
Including pricing in concept tests impacts user responses and business decisions significantly.
-
•
Brand presence in tests alters multiple metrics, requiring strategic decisions on branded vs. blind studies.
-
•
Online scrappy tests like A/B experiments capture behavior but lack insight into motivations and messaging impact.
-
•
Concept testing helps bridge the gap between UX discovery and business outcomes, strengthening business cases for UX research.
-
•
Expertise is needed to design and analyze complex trade-off tests; partnering with specialized researchers can maximize value.
Notable Quotes
"Concept testing is about testing ideas before development to confirm there is a real need for the product."
"UX researchers tend to focus on the experience after features are approved, missing the chance to validate earlier."
"People care not about product features but what these features do for them."
"Showing several concepts side by side and forcing choices yields better discrimination than rating scales."
"Qualitative research is excellent for discovering needs but poor at quantifying their scale or priority."
"If you have limited resources, start with a simple monadic test using low-cost survey tools."
"MaxDiff is great for prioritizing feature backlogs, especially when you have long lists to evaluate."
"Testing price effects requires careful design because user behavior can be irrational when prices are shown or hidden."
"No research method is perfect; use a mix and triangulate results depending on whether you want to predict or explain."
"When you start concept testing, be clear about what parts of the concept describe the what, the why, and the how."
Or choose a question:
More Videos
"Design thinking can feel like a magical black box or utterly overwhelming; it has to be made immediately usable and valuable."
Erin HauberDesign is Not the Frosting on the Scaled Agile Layer Cake
October 24, 2019
"Our jobs as researchers isn’t really to do research. It’s to influence people and help them make decisions."
Megan KiersteadYou Are a Badass at UX: Overcoming Imposter Syndrome
March 10, 2021
"We maintain structured flexibility so we can move people where the work is regardless of politics or whatever else is going on."
Maggie DieringerCreating Consistency Through Constant Change
January 8, 2024
"Avoid too much upfront discovery that delays value and traps you into a fixed plan."
Meaghan Waters Fotina KoutropoulousLack of Product Thinking will Doom Your Legacy Modernization
June 9, 2021
"User researchers still feel like they’re in a precarious position and want to be part of the pack but they’re just not there yet."
Jemma AhmedBringing together market and user research
October 17, 2019
"Start small by delivering the minimum amount of useful information, like a UX glossary or a single community of practice."
Maria TaylorKnowledge is Power: Managing the Lifeblood of the Design Org
October 3, 2023
"The most important thing you can do is listen and watch and put assumptions aside about what is easy or hard."
Sam ProulxUnderstanding Screen Readers on Mobile: How And Why to Learn from Native Users
June 6, 2023
"We threw out the team structure and started to commission work based on the multiple skills needed for each project."
Catherine BlizzardUsing Integrated Insight to Drive Growth
March 10, 2022
"Carol was really grateful for our conversation."
Randolph Duke IIWar Stories LIVE! Randy Duke II
March 30, 2020
