Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Advanced Concept Testing Approaches To Guide Product Development and Business Decisions
Gold
Friday, March 11, 2022 • Advancing Research 2022
Share the love for this talk
Advanced Concept Testing Approaches To Guide Product Development and Business Decisions
Speakers: Michaela Mora
Link:

Summary

Learn about the concept testing methodology and various approaches available, when to use them, the types of decisions they can support, and the process to conduct good concept testing with mixed methodologies in mind.

Key Insights

  • Concept testing is mainly used before product development to validate if a product or feature idea meets a real market need.

  • There are three types of concept testing: pure concept (what), positioning concept (why), and advertising concept (how).

  • UX research often neglects concept testing, focusing more on user experience post-approval rather than validating product necessity beforehand.

  • Monadic, sequential, and trade-off (MaxDiff and conjoint analysis) are the main testing methodologies, each with unique strengths and limitations.

  • Trade-off techniques like MaxDiff and conjoint analysis have higher discriminatory power than rating scales and suit complex prioritization problems.

  • Qualitative research should precede quantitative concept testing to formulate hypotheses and help create relevant test concepts.

  • Qualitative research alone cannot measure the problem's size or market impact, making quantitative validation essential.

  • Concept testing designs must consider branding, pricing presentation, target population, and decision rules to ensure meaningful results.

  • Pragmatic approaches like AB testing or ad campaigns measure behavioral response but lack insight into the ‘why’ behind consumer choices.

  • One can start concept testing simply with monadic tests using common survey tools, progressing to advanced trade-off techniques as resources allow.

Notable Quotes

"Concept testing is about testing ideas related to product features and benefits before development."

"UX researchers tend to be more involved in researching the user experience after a product or feature idea has been approved."

"When we don’t start with whether a product or feature is needed, we risk failing to align product development with business goals and user needs."

"People care not so much about product features, but what these features do for them."

"MaxDiff is a great approach to prioritizing the product feature backlog and can handle dozens of items efficiently."

"Qualitative research helps understand the range of behaviors, motivations, and contexts, which guides better concept design."

"No research method is perfect; it’s about selecting the right approach that fits the research questions and problem."

"Concept testing can connect the dots between UX discovery research and business outcomes, making product development more efficient."

"You don’t have to do advanced concept testing yourself if you lack expertise; building a business case to partner with specialists is key."

"Monadic testing suits complex concepts that need detailed attention, avoiding user fatigue in surveys with multiple concepts."

Ask the Rosenbot
Catt Small
Moving from Execution to Strategy as a Designer
2022 • Design in Product 2022
Gold
Yoel Sumitro
Actions and Reflections: Bridging the Skills Gap among Researchers
2022 • Advancing Research 2022
Gold
Candace Myers
Standardizing Design at Scale
2022 • DesignOps Summit 2022
Gold
Kristin Sundermeyer
Design Ops Metrics
2021 • DesignOps Summit 2021
Gold
Dr. Jamika D. Burge
Advancing the Inclusion of Womxn in Research Practices (Videoconference)
2022 • Advancing Research Community
Scott Jensen
Short Take #2: UX/Product Lessons from Your Industry Peers
2022 • Design in Product 2022
Gold
Prayag Narula
Empowering Designers to do Good Research
2022 • Advancing Research 2022
Gold
Milan Guenther
A Shared Language for Co-Creating Ambitious Endeavours
2023 • Enterprise UX 2023
Gold
Rusha Sopariwala
Remote, Together: Craft and Collaboration Across Disciplines, Borders, Time Zones, and a Design Org of 170+
2022 • Design at Scale 2022
Gold
Panel Discussion: Communicating the Value of DesignOps
2018 • DesignOps Summit 2018
Gold
Corey Nelson
Layoffs (Videoconference)
2022 • Advancing Research Community
Ariel Kennan
Building a Design Culture
2017 • Enterprise Experience 2017
Gold
Sam Proulx
Accessibility: An Opportunity to Innovate
2022 • Design at Scale 2022
Gold
Katie Johnson
Disrupting generative AI products with just-in-time consumer insights
2024 • Designing with AI 2024
Gold
Chris Geison
What's Next for Research? (Videoconference)
2021 • Advancing Research Community
Jemma Ahmed
Democratization: Working with it, not against it [Advancing Research Community Workshop Series]
2024 • Advancing Research Community

More Videos

Alex Hurworth

"Knowledge is power; empowering communities leads to better conservation outcomes."

Alex Hurworth Bonnie John Fahd Arshad Antoine Marin

Designing a Contact Tracing App for Universal Access

October 23, 2020

Laine Riley Prokay

"We wanted to actively promote the Design Ops discipline to more people, especially those not familiar with our craft."

Laine Riley Prokay Lisa Gordon

Carving a Path for Early Career DesignOps Practitioners

September 9, 2022

Eniola Oluwole

"We did a great cleanup of patterns from every decade and deleted anything off brand or untested."

Eniola Oluwole

Lessons From the DesignOps Journey of the World's Largest Travel Site

October 24, 2019

Nathan Shedroff

"Design researchers know customers better than almost anyone else in the organization, yet they are rarely invited into strategy processes."

Nathan Shedroff

Double Your Mileage: Use Your Research Strategically

March 31, 2020

Sam Proulx

"Mobile live captions can caption any sounds around the user in real time, making it a powerful accessibility tool."

Sam Proulx

Mobile Accessibility: Why Moving Accessibility Beyond the Desktop is Critical in a Mobile-first World

November 17, 2022

Feleesha Sterling

"The program creates predictability so teams know when to submit questions and when findings will come."

Feleesha Sterling

Building a Rapid Research Program (Videoconference)

May 18, 2023

Neil Barrie

"Culturally resonant experiences can influence society in ways governments only dream of, with velocity and speed."

Neil Barrie

Widening the Aperture: The Case for Taking a Broader Lens to the Dialogue between Products and Culture

March 25, 2024

John Devanney

"We move here. We never actually become New Yorkers."

John Devanney

The Design Management Office

November 6, 2017

Katy Mogal

"One analyst became our research associate by diving deep into the diary videos and organizing the data."

Katy Mogal

But Do Your Insights Scale?

March 12, 2021