Advanced Concept Testing Approaches To Guide Product Development and Business Decisions
Summary
Learn about the concept testing methodology and various approaches available, when to use them, the types of decisions they can support, and the process to conduct good concept testing with mixed methodologies in mind.
Key Insights
-
•
Concept testing is crucial before product development to validate market need but is underutilized in UX research.
-
•
Three types of concept testing address different questions: what a product does, why users should care, and how to communicate benefits.
-
•
Monadic, sequential, and trade-off testing methods offer varying cost, complexity, and discrimination power trade-offs.
-
•
Trade-off techniques like MaxDiff and conjoint analysis provide stronger discrimination and work well across cultures.
-
•
Combining qualitative research before and after quantitative concept testing improves hypothesis formulation and insights interpretation.
-
•
Including pricing in concept tests impacts user responses and business decisions significantly.
-
•
Brand presence in tests alters multiple metrics, requiring strategic decisions on branded vs. blind studies.
-
•
Online scrappy tests like A/B experiments capture behavior but lack insight into motivations and messaging impact.
-
•
Concept testing helps bridge the gap between UX discovery and business outcomes, strengthening business cases for UX research.
-
•
Expertise is needed to design and analyze complex trade-off tests; partnering with specialized researchers can maximize value.
Notable Quotes
"Concept testing is about testing ideas before development to confirm there is a real need for the product."
"UX researchers tend to focus on the experience after features are approved, missing the chance to validate earlier."
"People care not about product features but what these features do for them."
"Showing several concepts side by side and forcing choices yields better discrimination than rating scales."
"Qualitative research is excellent for discovering needs but poor at quantifying their scale or priority."
"If you have limited resources, start with a simple monadic test using low-cost survey tools."
"MaxDiff is great for prioritizing feature backlogs, especially when you have long lists to evaluate."
"Testing price effects requires careful design because user behavior can be irrational when prices are shown or hidden."
"No research method is perfect; use a mix and triangulate results depending on whether you want to predict or explain."
"When you start concept testing, be clear about what parts of the concept describe the what, the why, and the how."
Or choose a question:
More Videos
"It doesn’t matter when work is done, so long as it’s done and its quality."
Lavy Kumar Kat Temple Shan Sebastian Tara Jensen Jenn ChouFuture of Work
June 9, 2021
"Design and research at Compass have become so integrated that we become these powerful partners driving the product vision."
Andreas Huebner Amy Takata Craig BrookesWhat Is It Like To Be Part of The UX Team at Compass?
March 11, 2021
"Cluster analysis is very useful if you want to avoid a one-size-fits-all approach to product or service design."
Ricardo MartinsUnlocking the power of advanced quantitative methods
March 12, 2025
"Closing the distance is about connecting not only with customers but also between cross-functional team members."
Monty HammontreeThe Future of UX Research
December 3, 2020
"We didn’t explain the philosophy behind the design ops activities, so others didn’t understand why some activities couldn’t be done outside design."
Benjamin RealShowing the Value of DesignOps by Not Having a DesignOps Team
October 21, 2020
"You can own the infrastructure that allows knowledge to flow but you can't actually own the knowledge itself."
Kate TowseyAsk Me Anything (AMA) with Kate Towsey
April 2, 2025
"When you look at data without training, confirmation bias makes you just find what you already believe."
Steve Portigal Chris Chapo Kelly Goto Christian RohrerDiscussion
May 13, 2015
"Accessible foundations are built by involving voices of people with disabilities from ideation to prototyping to launch."
Sam ProulxOnline Shopping: Designing an Accessible Experience
March 28, 2023
"Users with physical challenges often can see and interpret prototypes but may need help clicking through them because assistive tech may not support the prototype system."
Sam ProulxPrototype Reviews, People With Disabilities, and You
October 1, 2021
