Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Advanced Concept Testing Approaches To Guide Product Development and Business Decisions
Gold
Friday, March 11, 2022 • Advancing Research 2022
Share the love for this talk
Advanced Concept Testing Approaches To Guide Product Development and Business Decisions
Speakers: Michaela Mora
Link:

Summary

Learn about the concept testing methodology and various approaches available, when to use them, the types of decisions they can support, and the process to conduct good concept testing with mixed methodologies in mind.

Key Insights

  • Concept testing is mainly used before product development to validate if a product or feature idea meets a real market need.

  • There are three types of concept testing: pure concept (what), positioning concept (why), and advertising concept (how).

  • UX research often neglects concept testing, focusing more on user experience post-approval rather than validating product necessity beforehand.

  • Monadic, sequential, and trade-off (MaxDiff and conjoint analysis) are the main testing methodologies, each with unique strengths and limitations.

  • Trade-off techniques like MaxDiff and conjoint analysis have higher discriminatory power than rating scales and suit complex prioritization problems.

  • Qualitative research should precede quantitative concept testing to formulate hypotheses and help create relevant test concepts.

  • Qualitative research alone cannot measure the problem's size or market impact, making quantitative validation essential.

  • Concept testing designs must consider branding, pricing presentation, target population, and decision rules to ensure meaningful results.

  • Pragmatic approaches like AB testing or ad campaigns measure behavioral response but lack insight into the ‘why’ behind consumer choices.

  • One can start concept testing simply with monadic tests using common survey tools, progressing to advanced trade-off techniques as resources allow.

Notable Quotes

"Concept testing is about testing ideas related to product features and benefits before development."

"UX researchers tend to be more involved in researching the user experience after a product or feature idea has been approved."

"When we don’t start with whether a product or feature is needed, we risk failing to align product development with business goals and user needs."

"People care not so much about product features, but what these features do for them."

"MaxDiff is a great approach to prioritizing the product feature backlog and can handle dozens of items efficiently."

"Qualitative research helps understand the range of behaviors, motivations, and contexts, which guides better concept design."

"No research method is perfect; it’s about selecting the right approach that fits the research questions and problem."

"Concept testing can connect the dots between UX discovery research and business outcomes, making product development more efficient."

"You don’t have to do advanced concept testing yourself if you lack expertise; building a business case to partner with specialists is key."

"Monadic testing suits complex concepts that need detailed attention, avoiding user fatigue in surveys with multiple concepts."

Dave Hora
Advice for Establishing Research (Videoconference)
2022 • Advancing Research Community
Sam Proulx
Understanding Screen Readers on Mobile: How And Why to Learn from Native Users
2023 • Enterprise UX 2023
Gold
Angy Peterson
More Than Technology: Personalized Public Sector Experiences
2021 • Civic Design 2021
Gold
Christian Crumlish
Afternoon Insights Panel
2022 • Design in Product 2022
Gold
Dane DeSutter
What co-speech gestures reveal about users’ thinking during interviews (Videoconference)
2023 • Rosenfeld Community
Anna Poznyakov
Get The Most Out Of Stakeholder Collaboration—and Maximize Your Research Impact
2021 • Advancing Research 2021
Gold
Frances Yllana
Theme 2 Intro
2024 • DesignOps 2024
Gold
Lada Gorlenko
Theme 1: Intro
2024 • Enterprise Experience 2020
Gold
Bassel Deeb
Do More With Less: Equip and Lead Design Orgs Through Adversity
2023 • DesignOps Summit 2023
Gold
Andy Barraclough
From Costly Complexity to Efficient Insights: Why UX Teams Are Switching To Voxpopme
2024 • DesignOps 2024
Gold
Alicia Mooty
Design Staffing Models
2021 • DesignOps Summit 2021
Gold
Amanda Kaleta-Kott
The Joys and Dilemmas of Conducting UX Research with Older Adults
2022 • Advancing Research 2022
Gold
Marieke McCloskey
User Science: Product Analytics & User Research
2021 • Advancing Research 2021
Gold
Ruzanna Rozman
Getting in Flow with Your Team
2024 • DesignOps Summit 2020
Gold
Sam Proulx
SUS: A System Unusable for Twenty Percent of the Population
2021 • DesignOps Summit 2021
Gold
Dr. Jamika D. Burge
Bridge Building across Research Disciplines (Videoconference)
2021 • Advancing Research Community

More Videos

Wyatt Hayman

"Human translation is preferred for accuracy, though Google Translate is used occasionally for urgent needs."

Wyatt Hayman

Global Research Panels (Videoconference)

August 8, 2020

PJ Buddhari

"Our UI kits are generated through JavaScript from design tokens, reducing manual errors and keeping everything up to date."

PJ Buddhari Nate Baldwin

Meet Spectrum, Adobe’s Design System

June 9, 2021

Sarah Gallimore

"Exploring Wi-Fi-free zones in Toronto highlights citizen-driven desires to unplug and maintain data privacy in public spaces."

Sarah Gallimore

Inspire Progress with Artifacts from the Future

November 18, 2022

Peter Merholz

"Developing trust means showing you understand what it takes to get something shipped, that you’re reliable, and that people can be vulnerable with you."

Peter Merholz

The Trials and Tribulations of Directors of UX (Videoconference)

July 13, 2023

Dr. Jamika D. Burge

"Intersectionality is a framework to describe compounding levels of discrimination people experience."

Dr. Jamika D. Burge Mansi Gupta

Advancing the Inclusion of Womxn in Research Practices (Videoconference)

September 15, 2022

Amy Marquez

"Product principles are minimal but help us say, oh, this is meeting that or not meeting that."

Amy Marquez

INVEST: Discussion

June 15, 2018

Dane DeSutter

"You cannot measure feelings meaningfully in a single interview; feelings are emergent and must be measured at scale."

Dane DeSutter Natalie Gedeon Deborah Hendersen Cheryl Platz

Beyond the Console: The rise of the Gamer Experience and how gaming will impact UX Research across industries (Videoconference)

May 17, 2024

Zariah Cameron

"If I don’t trust you, how can I feel safe with you?"

Zariah Cameron

ReDesigning Wellbeing for Equitable Care in the Workplace

September 23, 2024

Jessica Norris

"Regular positive feedback, not just negative, is essential because many with ADHD rely on extrinsic motivation."

Jessica Norris

ADHD: A DesignOps Superpower

September 9, 2022