Summary
Learn about the concept testing methodology and various approaches available, when to use them, the types of decisions they can support, and the process to conduct good concept testing with mixed methodologies in mind.
Key Insights
-
•
Concept testing is mainly used before product development to validate if a product or feature idea meets a real market need.
-
•
There are three types of concept testing: pure concept (what), positioning concept (why), and advertising concept (how).
-
•
UX research often neglects concept testing, focusing more on user experience post-approval rather than validating product necessity beforehand.
-
•
Monadic, sequential, and trade-off (MaxDiff and conjoint analysis) are the main testing methodologies, each with unique strengths and limitations.
-
•
Trade-off techniques like MaxDiff and conjoint analysis have higher discriminatory power than rating scales and suit complex prioritization problems.
-
•
Qualitative research should precede quantitative concept testing to formulate hypotheses and help create relevant test concepts.
-
•
Qualitative research alone cannot measure the problem's size or market impact, making quantitative validation essential.
-
•
Concept testing designs must consider branding, pricing presentation, target population, and decision rules to ensure meaningful results.
-
•
Pragmatic approaches like AB testing or ad campaigns measure behavioral response but lack insight into the ‘why’ behind consumer choices.
-
•
One can start concept testing simply with monadic tests using common survey tools, progressing to advanced trade-off techniques as resources allow.
Notable Quotes
"Concept testing is about testing ideas related to product features and benefits before development."
"UX researchers tend to be more involved in researching the user experience after a product or feature idea has been approved."
"When we don’t start with whether a product or feature is needed, we risk failing to align product development with business goals and user needs."
"People care not so much about product features, but what these features do for them."
"MaxDiff is a great approach to prioritizing the product feature backlog and can handle dozens of items efficiently."
"Qualitative research helps understand the range of behaviors, motivations, and contexts, which guides better concept design."
"No research method is perfect; it’s about selecting the right approach that fits the research questions and problem."
"Concept testing can connect the dots between UX discovery research and business outcomes, making product development more efficient."
"You don’t have to do advanced concept testing yourself if you lack expertise; building a business case to partner with specialists is key."
"Monadic testing suits complex concepts that need detailed attention, avoiding user fatigue in surveys with multiple concepts."
Or choose a question:
More Videos
"We must be those that the company feels uncomfortable but at the same time necessary."
Verónica Urzúa Jorge MontielThe B-side of the Research Impact
March 12, 2021
"The operators expected to use a suite of applications that had nothing consistent across them."
Michal Anne RogondinoSaving Outer Space: The First UX Design System for Our Nation’s Satellites
January 8, 2024
"Bravery means being unafraid to buck conventional wisdom and see the world as it truly is."
Jemma AhmedTheme 2 Intro
March 10, 2022
"Today’s theme is all about reflecting on the state of Civic design and government design practice and our careers."
Kara KaneTheme One Intro
November 16, 2022
"Relationship Design is about how you do your work, not just what you do."
Laine Riley ProkayHow DesignOps can Drive Inclusive Career Ladders for All
September 30, 2021
"Our working memories can only hold three to five item chunks at a time despite the data downpour."
Laura Gatewood Laine ProkayBeyond Buzzwords: Adding Heart to Effective Slack Communication
September 23, 2024
"At IBM, I felt like I was following a script; at Compass, I get to promote my ideas and see how they work."
Caitlyn Hampton Monica Lee Jina YoonCompass 101: Growing Your Career In A Startup World
June 11, 2021
"It’s not incumbent upon you to finish making this world a better place, but neither are you free to desist from it."
Hana NagelTurning Research Ripples into Waves
November 8, 2018
"UXers may have to help with adoption and training, even if it’s not traditionally their job."
Alexandra SchmidtEnterprise UX Playbook (Videoconference)
December 1, 2022