Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Advanced Concept Testing Approaches To Guide Product Development and Business Decisions

Gold
Friday, March 11, 2022 • Advancing Research 2022
Share the love for this talk
Advanced Concept Testing Approaches To Guide Product Development and Business Decisions
Speakers: Michaela Mora
Link:

Summary

Learn about the concept testing methodology and various approaches available, when to use them, the types of decisions they can support, and the process to conduct good concept testing with mixed methodologies in mind.

Key Insights

  • Concept testing is crucial before product development to validate market need but is underutilized in UX research.

  • Three types of concept testing address different questions: what a product does, why users should care, and how to communicate benefits.

  • Monadic, sequential, and trade-off testing methods offer varying cost, complexity, and discrimination power trade-offs.

  • Trade-off techniques like MaxDiff and conjoint analysis provide stronger discrimination and work well across cultures.

  • Combining qualitative research before and after quantitative concept testing improves hypothesis formulation and insights interpretation.

  • Including pricing in concept tests impacts user responses and business decisions significantly.

  • Brand presence in tests alters multiple metrics, requiring strategic decisions on branded vs. blind studies.

  • Online scrappy tests like A/B experiments capture behavior but lack insight into motivations and messaging impact.

  • Concept testing helps bridge the gap between UX discovery and business outcomes, strengthening business cases for UX research.

  • Expertise is needed to design and analyze complex trade-off tests; partnering with specialized researchers can maximize value.

Notable Quotes

"Concept testing is about testing ideas before development to confirm there is a real need for the product."

"UX researchers tend to focus on the experience after features are approved, missing the chance to validate earlier."

"People care not about product features but what these features do for them."

"Showing several concepts side by side and forcing choices yields better discrimination than rating scales."

"Qualitative research is excellent for discovering needs but poor at quantifying their scale or priority."

"If you have limited resources, start with a simple monadic test using low-cost survey tools."

"MaxDiff is great for prioritizing feature backlogs, especially when you have long lists to evaluate."

"Testing price effects requires careful design because user behavior can be irrational when prices are shown or hidden."

"No research method is perfect; use a mix and triangulate results depending on whether you want to predict or explain."

"When you start concept testing, be clear about what parts of the concept describe the what, the why, and the how."

Ask the Rosenbot
Aurobinda Pradhan
Introduction to Collaborative DesignOps using Cubyts
2022 • DesignOps Summit 2022
Gold
Peter Van Dijck
Coffee with Lou #4: Taking a Peek Under the Rosenbot's Hood
2024 • Rosenfeld Community
Joel Branch
Humanizing AI: Filling the Gaps with Multi-faceted Research
2021 • Advancing Research 2021
Gold
Allison Sanders
Operating with Purpose
2024 • DesignOps Summit 2020
Gold
Dave Hora
A Research Skills Evolution
2021 • Advancing Research 2021
Gold
Shelby Switzer
Making Space for Community Knowledge-sharing in a Distributed World
2021 • Civic Design 2021
Gold
Dagmara Kukawka
Tiny team, moonshot impact: Democratizing research across continents
2026 • Advancing Research 2026
Gold
Alba Villamil
Stereotyped by Design: Pitfalls in Cross-Cultural User Research
2020 • Advancing Research 2020
Gold
Farid Sabitov
Theme Four Intro
2022 • DesignOps Summit 2022
Gold
Marissa Cui
Climate Design Product Showcase
2024 • Climate UX Interest Group
Ariel Kennan
Theme 2 Intro
2021 • Civic Design 2021
Gold
Harry Brignull
Beyond Clicks and Tricks: Why deceptive design has grown into a regulatory faultline
2026 • Rosenfeld Community
Louis Rosenfeld
Opening Remarks
2023 • Design in Product 2023
Gold
Bruce Gillespie
Learning from journalism: Balancing impactful communication with compassionate storytelling
2025 • Advancing Research 2025
Gold
Yoel Sumitro
Actions and Reflections: Bridging the Skills Gap among Researchers
2022 • Advancing Research 2022
Gold
Deanna Smith
Leading Change with Confidence: Strategies for Optimizing Your Process
2024 • DesignOps Summit 2024
Gold

More Videos

Joanna Vodopivec

"Bringing stakeholders into the kitchen early helped us learn even before sessions started and adjust designs accordingly."

Joanna Vodopivec Prabhas Pokharel

One Research Team for All - Influence Without Authority

March 9, 2022

Louis Rosenfeld

"I didn’t understand just how complex everything was both on the stakeholder and technology side."

Louis Rosenfeld Lashanda Hodge Senongo Akpem Chris Hodowanec

Becoming a Civic Designer: Making the Move from Private to Public Sector

November 17, 2022

Bria Alexander

"Sponsor sessions are optional but incredibly high content and not sales pitches."

Bria Alexander

Day 3 Welcome

September 25, 2024

Uday Gajendar

"Lauren Cantor is a heavy hitter gathering all the really good resources and putting them together."

Uday Gajendar Louis Rosenfeld

Day 2 Welcome

June 5, 2024

Sam Proulx

"Frequent, bite-sized training is crucial so staff actually remember how to support customers with disabilities."

Sam Proulx

Online Shopping: Designing an Accessible Experience

June 7, 2023

Russ Unger

"Day one is a commencement, a graduation from candidate to employee, not a paperwork slog."

Russ Unger

Onboarding: The Ecosystem, not the Afterthought

November 7, 2017

Catherine Dubut

"We created a simple WordPress site so all corners of the business could contribute and share insights, breaking down silos."

Catherine Dubut

Bridging Physical and Digital Spaces: Approaches to Retail Service Design

March 18, 2021

Josh Clark

"Bespoke UI can generate interfaces on the fly based on immediate need or intent."

Josh Clark Veronika Kindred

Sentient Design: New Postures for AI-Mediated Experiences (2nd of 3 seminars)

January 29, 2025

Dantley Davis

"I approached design not from the context of user experience first, but from what job we’re trying to satisfy for our customers."

Dantley Davis

Leadership & Diversity—A Fireside Chat with Dantley Davis

September 17, 2020