Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

What Did I Miss? The Hidden Costs of Deprioritizing Diversity in User Research
Gold
Friday, March 12, 2021 • Advancing Research 2021
Share the love for this talk
What Did I Miss? The Hidden Costs of Deprioritizing Diversity in User Research
Speakers: Megan Campos
Link:

Summary

Characteristics like race, ethnicity, gender, and disability status can have a significant impact on how we experience the world, and how the world experiences us. In UX research, diversity is the first thing to vanish from the recruit when the going gets tough; I will talk about what we miss when that happens, and what researchers can do about it in their own practice. This presentation will demonstrate why a diverse recruit is imperative for a strong user research study, provide examples of what we miss when the recruit is homogeneous, and offering tactics for addressing the issue.

Key Insights

  • Demographic criteria like race, gender, and socioeconomic status significantly impact user experiences but are often considered less important than visible traits like age or location in research recruitment.

  • Homogeneous participant pools (mostly white, middle-class, cisgender individuals) persist because demographic criteria are treated as flexible or optional during recruitment.

  • Ignoring demographic diversity risks centering dominant cultural perspectives and missing unique needs, which can limit the effectiveness of research outcomes.

  • Explicitly setting non-negotiable demographic quotas (e.g., minimum number of non-white participants) improves recruitment diversity with third-party recruiters.

  • Recruiters often default to convenience samples; strong client insistence is required to shift their priorities toward representativeness.

  • Diverse research teams can better identify recruitment barriers and help reach underrepresented user populations.

  • Case studies in healthcare research demonstrate that racial identity shapes patient experiences in ways unrelated to other factors like profession or age.

  • Not knowing what insights are missed by lacking diversity is a critical blind spot in user research.

  • Recruiting diverse participants requires going beyond familiar networks, including engaging with specific communities and non-English speakers.

  • Purposeful overrepresentation of marginalized groups in research may help correct historical overrepresentation of dominant demographics.

Notable Quotes

"We’re actually talking about increasing the representative numbers for communities who are frequently absent or excluded from research."

"If we just decide to ignore demographics, we’re missing huge swaths of the participant experience and an opportunity to better serve our users."

"Those criteria that have more invisible economic, social, and political structures around them are on the less important end, while visible structures like age are ranked higher."

"The viruses don’t discriminate based on race, but our healthcare system does."

"Recruiters have become conditioned to treat demographic criteria as flexible or optional, and I don’t think they should be."

"If you go into a study knowing that you want to recruit a diverse participant pool, be upfront with the recruiter and push back if they can’t meet those needs."

"We can’t pretend that people’s behaviors and experiences exist separate from the identities that society attaches to them."

"We don’t know what we missed by not yielding demographic diversity — that’s a blind spot in user research."

"Wider audiences equal more dollars — expanding diversity isn’t just ethical, it’s good business."

"Stagnation isn’t good for everyone at best and can actively do a disservice to our users at worst."

Ask the Rosenbot
Andrew Custage
The Digital Journey: Research on Consumer Frustration and Loyalty
2023 • Advancing Research 2023
Gold
Laura Weiss
Turn Down the Heat: 3 Ways to Handle Conflict in the Moment
2024 • Rosenfeld Community
Kristin Sundermeyer
Design Ops Metrics
2021 • DesignOps Summit 2021
Gold
Lisa Welchman
Cleaning Up Our Mess: Digital Governance for Designers
2018 • Enterprise Experience 2018
Gold
What DesignOps Can Learn From DevOps
2017 • DesignOps Summit 2017
Gold
Megan Kierstead
You Are a Badass at UX: Overcoming Imposter Syndrome
2021 • Advancing Research 2021
Gold
Sarah Brooks
Theme Three Intro
2022 • Civic Design 2022
Gold
Jim Kalbach
Jazz Improvisation as a Model for Team Collaboration
2019 • Enterprise Experience 2019
Gold
Steve Baty
Discussion
2016 • Enterprise UX 2016
Gold
Bria Alexander
Welcome
2024 • Enterprise Experience 2020
Gold
JP Allen
Navigating the UX Tools Landscape
2021 • DesignOps Summit 2021
Gold
Lori Muszynski
Keeping Design Weird
2023 • DesignOps Summit 2023
Gold
DesignOps Community Sensing Session (Videoconference)
2021 • DesignOps Community
Marc Fonteijn
First Insights from the 2025 Service Design Salary(+) Report
2024 • Advancing Service Design 2024
Gold
Kat Vellos
Opener: The Other L Word
2024 • DesignOps Summit 2020
Gold
Bria Alexander
Opening Remarks
2021 • Design at Scale 2021
Gold

More Videos

Jennifer Kanyamibwa

"If you really want to build culture and see how people cross collaborate, try to make lunch with your entire team every single week."

Jennifer Kanyamibwa

Creating the Blueprint: Growing and Building Design Teams

November 8, 2018

Brigette Metzler

"Having a repo isn’t the same as having a strategy for socializing and evangelizing the research."

Brigette Metzler Dana Chrisfield

Research Repositories: A global project by the ResearchOps Community (Videoconference)

August 27, 2020

Carl Turner

"The project team gradually realized they were in charge of their own process and could get work done."

Carl Turner

You Can Do This: Understand and Solve Organizational Problems to Jumpstart a Dead Project

March 28, 2023

John Mortimer

"Design will never be able to stay static; it is how you show up responding to probing the system daily."

John Mortimer Milan Guenther Lucy Ellis Patrick Quattlebaum

Panel Discussion

December 3, 2024

Dante Guintu

"Fifty percent of our designers were already active in coaching or mentoring, yet there was a call for a different mentorship flavor."

Dante Guintu

How to Crush the Talent Crunch

September 8, 2022

Richard Buchanan

"We tend to confuse the experience of people with user experience, and I’m less interested in user experience than in the experience of people."

Richard Buchanan

Creativity and Principles in the Flourishing Enterprise

June 15, 2018

Dan Willis

"Sharzad is going to share wisdom earned the hard way from working inside and outside."

Dan Willis

Theme 3: Intro

January 8, 2024

Dan Ward

"We do experiments to learn, and if we learn something, then it’s a successful experiment."

Dan Ward

Failure Friday #1 with Dan Ward

February 7, 2025

Chris Geison

"There's no better time to advance research than now."

Chris Geison

Theme Two Intro

March 28, 2023