Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Advanced Concept Testing Approaches To Guide Product Development and Business Decisions
Gold
Friday, March 11, 2022 • Advancing Research 2022
Share the love for this talk
Advanced Concept Testing Approaches To Guide Product Development and Business Decisions
Speakers: Michaela Mora
Link:

Summary

Learn about the concept testing methodology and various approaches available, when to use them, the types of decisions they can support, and the process to conduct good concept testing with mixed methodologies in mind.

Key Insights

  • Concept testing is mainly used before product development to validate if a product or feature idea meets a real market need.

  • There are three types of concept testing: pure concept (what), positioning concept (why), and advertising concept (how).

  • UX research often neglects concept testing, focusing more on user experience post-approval rather than validating product necessity beforehand.

  • Monadic, sequential, and trade-off (MaxDiff and conjoint analysis) are the main testing methodologies, each with unique strengths and limitations.

  • Trade-off techniques like MaxDiff and conjoint analysis have higher discriminatory power than rating scales and suit complex prioritization problems.

  • Qualitative research should precede quantitative concept testing to formulate hypotheses and help create relevant test concepts.

  • Qualitative research alone cannot measure the problem's size or market impact, making quantitative validation essential.

  • Concept testing designs must consider branding, pricing presentation, target population, and decision rules to ensure meaningful results.

  • Pragmatic approaches like AB testing or ad campaigns measure behavioral response but lack insight into the ‘why’ behind consumer choices.

  • One can start concept testing simply with monadic tests using common survey tools, progressing to advanced trade-off techniques as resources allow.

Notable Quotes

"Concept testing is about testing ideas related to product features and benefits before development."

"UX researchers tend to be more involved in researching the user experience after a product or feature idea has been approved."

"When we don’t start with whether a product or feature is needed, we risk failing to align product development with business goals and user needs."

"People care not so much about product features, but what these features do for them."

"MaxDiff is a great approach to prioritizing the product feature backlog and can handle dozens of items efficiently."

"Qualitative research helps understand the range of behaviors, motivations, and contexts, which guides better concept design."

"No research method is perfect; it’s about selecting the right approach that fits the research questions and problem."

"Concept testing can connect the dots between UX discovery research and business outcomes, making product development more efficient."

"You don’t have to do advanced concept testing yourself if you lack expertise; building a business case to partner with specialists is key."

"Monadic testing suits complex concepts that need detailed attention, avoiding user fatigue in surveys with multiple concepts."

Ask the Rosenbot
Alla Weinberg
People Are Sick of Change: Psychological Safety is the Cure (Videoconference)
2023 • DesignOps Community
Tess Dixon
C'mon Get Happy
2021 • DesignOps Summit 2021
Gold
Luca Rager
Empowering Gaming at Scale: How Xbox Builds Powerful, Automated, and Distributed Design Systems with Sketch
2021 • DesignOps Summit 2021
Gold
Aurobinda Pradhan
Introduction to Collaborative DesignOps using Cubyts
2022 • DesignOps Summit 2022
Gold
Cassini Nazir
The Dangers of Empathy: Toward More Responsible Design Research
2023 • Advancing Research 2023
Gold
Nicole Wright
Democratizing Research at HoneyBook
2022 • Advancing Research 2022
Gold
Nicole Bergstrom
AccessibilityOps: Moving beyond “nice to have”
2024 • DesignOps Community
Kate Towsey
Ask Me Anything (AMA) with Kate Towsey
2025 • Rosenfeld Community
Abbey Smalley
Today’s Design Ops and Programs Landscape & Career Paths
2023 • DesignOps Summit 2023
Gold
Megan Blocker
Panel: Excellence in Impact
2024 • Advancing Research 2024
Gold
Steve Sanderson
Discussion
2015 • Enterprise UX 2015
Gold
Indi Young
Paying Better Attention to the Problem with Indi Young (Videoconference)
2019 • Advancing Research Community
Roy Opata Olende
How Zapier Uses ‘All Hands Research’ to Increase Exposure to Users (Videoconference)
2020 • Advancing Research Community
Laura Klein
Unique challenges of innovation in enterprises (Videoconference)
2020 • Enterprise Community
Ryan Rumsey
Business Influence Without Losing Your Soul (Videoconference)
2021 • Enterprise Community
Ned Dwyer
The Future of DesignOps is Tool Consolidation
2024 • DesignOps 2024
Gold

More Videos

Jennifer Kanyamibwa

"If you really want to build culture and see how people cross collaborate, try to make lunch with your entire team every single week."

Jennifer Kanyamibwa

Creating the Blueprint: Growing and Building Design Teams

November 8, 2018

Brigette Metzler

"In large organizations, research teams usually pay for the repo but the value is delivered across the whole company."

Brigette Metzler Dana Chrisfield

Research Repositories: A global project by the ResearchOps Community (Videoconference)

August 27, 2020

Carl Turner

"We assigned people to attend other teams’ meetings to help with integration and started being seen as leaders."

Carl Turner

You Can Do This: Understand and Solve Organizational Problems to Jumpstart a Dead Project

March 28, 2023

John Mortimer

"Trust, facilitation, change, and complexity—if you wrap your mind around those, you’ll get reasonably far."

John Mortimer Milan Guenther Lucy Ellis Patrick Quattlebaum

Panel Discussion

December 3, 2024

Dante Guintu

"Information overload with checklists on top of checklists does not create a great onboarding experience."

Dante Guintu

How to Crush the Talent Crunch

September 8, 2022

Richard Buchanan

"The new marketing is about preparing users or customers for the new kinds of products that will emerge as time moves forward."

Richard Buchanan

Creativity and Principles in the Flourishing Enterprise

June 15, 2018

Dan Willis

"Normally the theme leader would be talking about sleep deprivation because we’re overstimulated and excited by the talks."

Dan Willis

Theme 3: Intro

January 8, 2024

Dan Ward

"Innovation is novelty with impact — three words to remember."

Dan Ward

Failure Friday #1 with Dan Ward

February 7, 2025

Chris Geison

"Let’s shake s*** up."

Chris Geison

Theme Two Intro

March 28, 2023