Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Advanced Concept Testing Approaches To Guide Product Development and Business Decisions
Gold
Friday, March 11, 2022 • Advancing Research 2022
Share the love for this talk
Advanced Concept Testing Approaches To Guide Product Development and Business Decisions
Speakers: Michaela Mora
Link:

Summary

Learn about the concept testing methodology and various approaches available, when to use them, the types of decisions they can support, and the process to conduct good concept testing with mixed methodologies in mind.

Key Insights

  • Concept testing is mainly used before product development to validate if a product or feature idea meets a real market need.

  • There are three types of concept testing: pure concept (what), positioning concept (why), and advertising concept (how).

  • UX research often neglects concept testing, focusing more on user experience post-approval rather than validating product necessity beforehand.

  • Monadic, sequential, and trade-off (MaxDiff and conjoint analysis) are the main testing methodologies, each with unique strengths and limitations.

  • Trade-off techniques like MaxDiff and conjoint analysis have higher discriminatory power than rating scales and suit complex prioritization problems.

  • Qualitative research should precede quantitative concept testing to formulate hypotheses and help create relevant test concepts.

  • Qualitative research alone cannot measure the problem's size or market impact, making quantitative validation essential.

  • Concept testing designs must consider branding, pricing presentation, target population, and decision rules to ensure meaningful results.

  • Pragmatic approaches like AB testing or ad campaigns measure behavioral response but lack insight into the ‘why’ behind consumer choices.

  • One can start concept testing simply with monadic tests using common survey tools, progressing to advanced trade-off techniques as resources allow.

Notable Quotes

"Concept testing is about testing ideas related to product features and benefits before development."

"UX researchers tend to be more involved in researching the user experience after a product or feature idea has been approved."

"When we don’t start with whether a product or feature is needed, we risk failing to align product development with business goals and user needs."

"People care not so much about product features, but what these features do for them."

"MaxDiff is a great approach to prioritizing the product feature backlog and can handle dozens of items efficiently."

"Qualitative research helps understand the range of behaviors, motivations, and contexts, which guides better concept design."

"No research method is perfect; it’s about selecting the right approach that fits the research questions and problem."

"Concept testing can connect the dots between UX discovery research and business outcomes, making product development more efficient."

"You don’t have to do advanced concept testing yourself if you lack expertise; building a business case to partner with specialists is key."

"Monadic testing suits complex concepts that need detailed attention, avoiding user fatigue in surveys with multiple concepts."

Ask the Rosenbot
Sarah Brooks
Fireside chat with Sarah Brooks and Jen Pahlka (Videoconference)
2021 • Civic Design Community
Josh Clark
Sentient Design: New Design Patterns for New Experiences (3rd of 3 seminars)
2025 • Rosenfeld Community
Victor Udoewa
Beyond Methods and Diversity: The Roots of Inclusion
2024 • Advancing Research 2024
Gold
Dave Malouf
Theme 3: Introduction and Provocation
2024 • DesignOps Summit 2020
Gold
John Calhoun
Have we Reached Our Peak? Spotting the Next Mountain For DesignOps to Climb
2021 • DesignOps Summit 2021
Gold
Kate Towsey
Ask Me Anything (AMA) with Kate Towsey
2025 • Rosenfeld Community
Melissa Eggleston
Practical People Skills for Building Trust on Teams and with Partners
2021 • Civic Design 2021
Gold
Daniel Gloyd
Designing Warmth
2025 • Rosenfeld Community
Brian Moss
What Does it Mean to be a Resilient Research Team?
2022 • Advancing Research 2022
Gold
Smitha Papolu
Theme 3 Discussion
2019 • Enterprise Experience 2019
Gold
Michaela Mora
Advanced Concept Testing Approaches To Guide Product Development and Business Decisions
2022 • Advancing Research 2022
Gold
Dorelle Rabinowitz
The Magic Word is Trust
2018 • Enterprise Experience 2018
Gold
Amber Knabl
Empowering innovation: The critical role of inclusive product development in the AI era
2024 • Designing with AI 2024
Gold
Bria Alexander
Opening Remarks Day 2
2024 • Advancing Research 2024
Gold
Steve Portigal
Looking Back…to Look Ahead
2024 • Advancing Research 2024
Gold
Natalia Radywyl
Co-Designing New Power in Australia's Public Sector
2022 • Civic Design 2022
Gold

More Videos

Verónica Urzúa

"We must be those that the company feels uncomfortable but at the same time necessary."

Verónica Urzúa Jorge Montiel

The B-side of the Research Impact

March 12, 2021

Michal Anne Rogondino

"The operators expected to use a suite of applications that had nothing consistent across them."

Michal Anne Rogondino

Saving Outer Space: The First UX Design System for Our Nation’s Satellites

January 8, 2024

Jemma Ahmed

"Bravery means being unafraid to buck conventional wisdom and see the world as it truly is."

Jemma Ahmed

Theme 2 Intro

March 10, 2022

Kara Kane

"Today’s theme is all about reflecting on the state of Civic design and government design practice and our careers."

Kara Kane

Theme One Intro

November 16, 2022

Laine Riley Prokay

"Relationship Design is about how you do your work, not just what you do."

Laine Riley Prokay

How DesignOps can Drive Inclusive Career Ladders for All

September 30, 2021

Laura Gatewood

"Our working memories can only hold three to five item chunks at a time despite the data downpour."

Laura Gatewood Laine Prokay

Beyond Buzzwords: Adding Heart to Effective Slack Communication

September 23, 2024

Caitlyn Hampton

"At IBM, I felt like I was following a script; at Compass, I get to promote my ideas and see how they work."

Caitlyn Hampton Monica Lee Jina Yoon

Compass 101: Growing Your Career In A Startup World

June 11, 2021

Hana Nagel

"It’s not incumbent upon you to finish making this world a better place, but neither are you free to desist from it."

Hana Nagel

Turning Research Ripples into Waves

November 8, 2018

Alexandra Schmidt

"UXers may have to help with adoption and training, even if it’s not traditionally their job."

Alexandra Schmidt

Enterprise UX Playbook (Videoconference)

December 1, 2022