Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Advanced Concept Testing Approaches To Guide Product Development and Business Decisions
Gold
Friday, March 11, 2022 • Advancing Research 2022
Share the love for this talk
Advanced Concept Testing Approaches To Guide Product Development and Business Decisions
Speakers: Michaela Mora
Link:

Summary

Learn about the concept testing methodology and various approaches available, when to use them, the types of decisions they can support, and the process to conduct good concept testing with mixed methodologies in mind.

Key Insights

  • Concept testing is mainly used before product development to validate if a product or feature idea meets a real market need.

  • There are three types of concept testing: pure concept (what), positioning concept (why), and advertising concept (how).

  • UX research often neglects concept testing, focusing more on user experience post-approval rather than validating product necessity beforehand.

  • Monadic, sequential, and trade-off (MaxDiff and conjoint analysis) are the main testing methodologies, each with unique strengths and limitations.

  • Trade-off techniques like MaxDiff and conjoint analysis have higher discriminatory power than rating scales and suit complex prioritization problems.

  • Qualitative research should precede quantitative concept testing to formulate hypotheses and help create relevant test concepts.

  • Qualitative research alone cannot measure the problem's size or market impact, making quantitative validation essential.

  • Concept testing designs must consider branding, pricing presentation, target population, and decision rules to ensure meaningful results.

  • Pragmatic approaches like AB testing or ad campaigns measure behavioral response but lack insight into the ‘why’ behind consumer choices.

  • One can start concept testing simply with monadic tests using common survey tools, progressing to advanced trade-off techniques as resources allow.

Notable Quotes

"Concept testing is about testing ideas related to product features and benefits before development."

"UX researchers tend to be more involved in researching the user experience after a product or feature idea has been approved."

"When we don’t start with whether a product or feature is needed, we risk failing to align product development with business goals and user needs."

"People care not so much about product features, but what these features do for them."

"MaxDiff is a great approach to prioritizing the product feature backlog and can handle dozens of items efficiently."

"Qualitative research helps understand the range of behaviors, motivations, and contexts, which guides better concept design."

"No research method is perfect; it’s about selecting the right approach that fits the research questions and problem."

"Concept testing can connect the dots between UX discovery research and business outcomes, making product development more efficient."

"You don’t have to do advanced concept testing yourself if you lack expertise; building a business case to partner with specialists is key."

"Monadic testing suits complex concepts that need detailed attention, avoiding user fatigue in surveys with multiple concepts."

Ask the Rosenbot
Alba Villamil
Stereotyped by Design: Pitfalls in Cross-Cultural User Research
2020 • Advancing Research 2020
Gold
Leah Buley
Ask Me Anything with Leah Buley and Joe Natoli, co-authors of The User Experience Team of One (2nd edition)
2024 • Rosenfeld Community
Sarah Barrett
AI in Real Life: Using LLMs to Turbocharge Microsoft Learn
2025 • Rosenfeld Community
Louis Rosenfeld
Coffee with Lou: Should You Write a (UX) Book? (Videoconference)
2024 • Rosenfeld Community
Bria Alexander
Opening Remarks
2023 • Advancing Research 2023
Gold
Marissa Cui
Climate Design Product Showcase (Videoconference)
2024 • Climate UX Interest Group (Rosenfeld Community)
Dantley Davis
Leadership & Diversity—A Fireside Chat with Dantley Davis (Videoconference)
2020 • Enterprise Community
Wendy Johansson
An Education on Design Education for Orgs
2021 • Design at Scale 2021
Gold
Allison Sanders
Operating with Purpose
2024 • DesignOps Summit 2020
Gold
Aditi Ruiz
Pulse Check: Empathy Mapping Your Product Manager, Pt. 2
2022 • Design in Product 2022
Gold
Andrew Webster
Scaling Design Capability: How Involved Should You Be?
2021 • DesignOps Summit 2021
Gold
Designing Systems at Scale
2018 • DesignOps Summit 2018
Gold
Lisa Welchman
Cleaning Up Our Mess: Digital Governance for Designers
2018 • Enterprise Experience 2018
Gold
JD Buckley
COMMUNICATE: Discussion
2018 • Enterprise Experience 2018
Gold
Dave Gray
Liminal Thinking: Sense-making for systems in large organizations
2015 • Enterprise UX 2015
Gold
Joe Meersman
Use AI to Drive Outcomes that Go Beyond the Design Sprint
2024 • DesignOps 2024
Gold

More Videos

Adam Cutler

"The 1500 are designers, we don't distinguish strictly between UX or visual or industrial—they all bring design to the org."

Adam Cutler Karen Pascoe Ian Swinson Susan Worthman

Discussion

June 8, 2016

Peter Merholz

"Playing politics in UX leadership is about maximizing relationships ethically to advance your agenda, not about being underhanded."

Peter Merholz

The Trials and Tribulations of Directors of UX (Videoconference)

July 13, 2023

Lisa Welchman

"Everything that has been put online, someone like us made and put there; we bake our own biases into it."

Lisa Welchman

Cleaning Up Our Mess: Digital Governance for Designers

June 14, 2018

Vincent Brathwaite

"The solutions are out there; we just need the will to implement them."

Vincent Brathwaite

Opener: Past, Present, and Future—Closing the Racial Divide in Design Teams

October 22, 2020

Brenna Fallon

"Engineers can be our biggest allies in making really important process changes."

Brenna Fallon

Learning Over Outcomes

October 24, 2019

Tricia Wang

"Hip hop proves that we can re-animate spaces with highly generative communities that weren't built for us."

Tricia Wang

Spatial Collapse: Designing for Emergent Culture

January 8, 2024

Edgar Anzaldua Moreno

"Marital status mattered because car buying decisions often involve family members, not just the individual."

Edgar Anzaldua Moreno

Using Research to Determine Unique Value Proposition

March 11, 2021

"Successful operations must have a well-laid-out and transparent process and documentation, but that process must become invisible in its application."

Designing Systems at Scale

November 7, 2018

Erin Weigel

"Randomization is magic — it evenly distributes confounds so the only difference affecting results is your change."

Erin Weigel

Get Your Whole Team Testing to Design for Impact

July 24, 2024