Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Advanced Concept Testing Approaches To Guide Product Development and Business Decisions

Gold
Friday, March 11, 2022 • Advancing Research 2022
Share the love for this talk
Advanced Concept Testing Approaches To Guide Product Development and Business Decisions
Speakers: Michaela Mora
Link:

Summary

Learn about the concept testing methodology and various approaches available, when to use them, the types of decisions they can support, and the process to conduct good concept testing with mixed methodologies in mind.

Key Insights

  • Concept testing is crucial before product development to validate market need but is underutilized in UX research.

  • Three types of concept testing address different questions: what a product does, why users should care, and how to communicate benefits.

  • Monadic, sequential, and trade-off testing methods offer varying cost, complexity, and discrimination power trade-offs.

  • Trade-off techniques like MaxDiff and conjoint analysis provide stronger discrimination and work well across cultures.

  • Combining qualitative research before and after quantitative concept testing improves hypothesis formulation and insights interpretation.

  • Including pricing in concept tests impacts user responses and business decisions significantly.

  • Brand presence in tests alters multiple metrics, requiring strategic decisions on branded vs. blind studies.

  • Online scrappy tests like A/B experiments capture behavior but lack insight into motivations and messaging impact.

  • Concept testing helps bridge the gap between UX discovery and business outcomes, strengthening business cases for UX research.

  • Expertise is needed to design and analyze complex trade-off tests; partnering with specialized researchers can maximize value.

Notable Quotes

"Concept testing is about testing ideas before development to confirm there is a real need for the product."

"UX researchers tend to focus on the experience after features are approved, missing the chance to validate earlier."

"People care not about product features but what these features do for them."

"Showing several concepts side by side and forcing choices yields better discrimination than rating scales."

"Qualitative research is excellent for discovering needs but poor at quantifying their scale or priority."

"If you have limited resources, start with a simple monadic test using low-cost survey tools."

"MaxDiff is great for prioritizing feature backlogs, especially when you have long lists to evaluate."

"Testing price effects requires careful design because user behavior can be irrational when prices are shown or hidden."

"No research method is perfect; use a mix and triangulate results depending on whether you want to predict or explain."

"When you start concept testing, be clear about what parts of the concept describe the what, the why, and the how."

Ask the Rosenbot
Emily Lessard
RFPs Without Tears: Writing Inclusive RFPS that Don't Scare Away Talent
2021 • Civic Design 2021
Gold
Peter Van Dijck
Building impactful AI products for design and product leaders, Part 3: Understand AI architectures: RAG, Agents, Oh My!
2025 • Rosenfeld Community
Sam Proulx
Accessibility: An Opportunity to Innovate
2022 • Civic Design 2022
Gold
Dan Saffer
Why AI projects fail (and what we can do about it)
2025 • Rosenfeld Community
Sohit Karol
Designing Delightful Listening Experiences: Mixed Methods Research in the Age of Machine Learning
2020 • Advancing Research 2020
Gold
Jen Cardello
Standardizing Product Merits for Leaders, Designers, and Everyone
2018 • Enterprise Experience 2018
Gold
B. Pagels-Minor
Breaking the Tension: The Power of Enabling Your Employees to Show Up Authentically
2022 • Design at Scale 2022
Gold
Clemens Janssen
Efficiently Scaling Research as a Team of One
2023 • Advancing Research 2023
Gold
Prayag Narula
HCI 2.0: Humanity Deserves the Attention that UX Research has to Offer
2023 • Advancing Research 2023
Gold
Dave Hoffer
UX Job Search AMA #3 with Joanne Weaver and Dave Hoffer
2025 • Rosenfeld Community
Aiyana Bodi
Three Key Climate Initiatives and How You Can Help
2024 • Climate UX Interest Group
Carol Scott
Avoid Harming Your Team and Users: Promoting Care and Brand Reputation with Trauma-Informed UX Practices
2025 • Rosenfeld Community
Todd Healy
Driving Change with CX Metrics
2023 • Enterprise UX 2023
Gold
Heidi Trost
When AI Becomes the User’s Point Person—and Point of Failure
2025 • Rosenfeld Community
Laura Schaefer
DesignOps: A Conduit for Inclusion
2022 • DesignOps Summit 2022
Gold
Joe Meersman
Use AI to Drive Outcomes that Go Beyond the Design Sprint
2024 • DesignOps Summit 2024
Gold

More Videos

Xenia Adjoubei

"Data sovereignty is about who owns your data, which country’s laws apply, and how vulnerable groups are fairly protected."

Xenia Adjoubei Sean Bruce

Empowering Communities Through the Researcher in Residence Program

March 29, 2023

Tamara Kartoziia

"My definition of service design is dancing with needs and value."

Tamara Kartoziia

Think global, adapt local: how service design accelerated B2B market entry by 6 months

November 20, 2025

Jay Bustamante

"MidJourney’s dataset reflects stereotyped images because it’s based on internet image results without specific instruction."

Jay Bustamante

Navigating the Ethical Frontier: DesignOps Strategies for Responsible AI Innovation

October 2, 2023

Nicole Aleong

"Anticipation involves preparatory actions to manage uncertainty about future conditions."

Nicole Aleong

Future Orientations to Everyday Life: Futures Anthropology as a Methodology

March 26, 2024

Nick Lewis

"Be curious, keep learning, and believe you can make a difference in sustainability."

Nick Lewis

Designing and building low-carbon websites independently

November 18, 2025

Vicky Teinaki

"Rather than inscrutable KPIs, we should find metrics that work in harmony with the needs of the user."

Vicky Teinaki Michele Marut Tim Parmee

Short Take #3: UX/Product Lessons from Your Industry Peers

December 6, 2022

Laura Weiss

"Everyone contributes to conflict; it’s not about right or wrong, but what each person is trying to protect."

Laura Weiss

Turn Down the Heat: 3 Ways to Handle Conflict in the Moment

November 20, 2024

Joerg Beringer

"Most product teams don't really have user research outputs or they come too late and disconnected from design."

Joerg Beringer Thomas Geis

Scaling User Research with AI: Continuous Discovery of User Needs in Minutes

June 10, 2025

Shelby Switzer

"Why be here if you’re not going to be here."

Shelby Switzer

Making Space for Community Knowledge-sharing in a Distributed World

December 10, 2021