Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

What Did I Miss? The Hidden Costs of Deprioritizing Diversity in User Research
Gold
Friday, March 12, 2021 • Advancing Research 2021
Share the love for this talk
What Did I Miss? The Hidden Costs of Deprioritizing Diversity in User Research
Speakers: Megan Campos
Link:

Summary

Characteristics like race, ethnicity, gender, and disability status can have a significant impact on how we experience the world, and how the world experiences us. In UX research, diversity is the first thing to vanish from the recruit when the going gets tough; I will talk about what we miss when that happens, and what researchers can do about it in their own practice. This presentation will demonstrate why a diverse recruit is imperative for a strong user research study, provide examples of what we miss when the recruit is homogeneous, and offering tactics for addressing the issue.

Key Insights

  • Demographic criteria like race, gender, and socioeconomic status significantly impact user experiences but are often considered less important than visible traits like age or location in research recruitment.

  • Homogeneous participant pools (mostly white, middle-class, cisgender individuals) persist because demographic criteria are treated as flexible or optional during recruitment.

  • Ignoring demographic diversity risks centering dominant cultural perspectives and missing unique needs, which can limit the effectiveness of research outcomes.

  • Explicitly setting non-negotiable demographic quotas (e.g., minimum number of non-white participants) improves recruitment diversity with third-party recruiters.

  • Recruiters often default to convenience samples; strong client insistence is required to shift their priorities toward representativeness.

  • Diverse research teams can better identify recruitment barriers and help reach underrepresented user populations.

  • Case studies in healthcare research demonstrate that racial identity shapes patient experiences in ways unrelated to other factors like profession or age.

  • Not knowing what insights are missed by lacking diversity is a critical blind spot in user research.

  • Recruiting diverse participants requires going beyond familiar networks, including engaging with specific communities and non-English speakers.

  • Purposeful overrepresentation of marginalized groups in research may help correct historical overrepresentation of dominant demographics.

Notable Quotes

"We’re actually talking about increasing the representative numbers for communities who are frequently absent or excluded from research."

"If we just decide to ignore demographics, we’re missing huge swaths of the participant experience and an opportunity to better serve our users."

"Those criteria that have more invisible economic, social, and political structures around them are on the less important end, while visible structures like age are ranked higher."

"The viruses don’t discriminate based on race, but our healthcare system does."

"Recruiters have become conditioned to treat demographic criteria as flexible or optional, and I don’t think they should be."

"If you go into a study knowing that you want to recruit a diverse participant pool, be upfront with the recruiter and push back if they can’t meet those needs."

"We can’t pretend that people’s behaviors and experiences exist separate from the identities that society attaches to them."

"We don’t know what we missed by not yielding demographic diversity — that’s a blind spot in user research."

"Wider audiences equal more dollars — expanding diversity isn’t just ethical, it’s good business."

"Stagnation isn’t good for everyone at best and can actively do a disservice to our users at worst."

Ask the Rosenbot
Peter Levin
Solve a Problem Here, Transform a Strategy There: Research as an Occasion for Expanding Organizational Possibility
2024 • Advancing Research 2024
Gold
Kurdin Bazaz
Culture, DIBS & Recruiting
2021 • Design at Scale 2021
Gold
Heidi Trost
To Protect People, You Have to Protect Information: A Human-Centered Design Approach to Cybersecurity
2025 • Rosenfeld Community
Kate Kalcevich
Designing inclusively with AI
2024 • Designing with AI 2024
Gold
Ted Neward
Theme 4: Enterprise Organizational Journey
2019 • Enterprise Experience 2019
Gold
Alla Weinberg
Design Teams Need Psychological Safety: Here’s How to Create It
2022 • DesignOps Summit 2022
Gold
Peter Merholz
The Trials and Tribulations of Directors of UX (Videoconference)
2023 • Enterprise Community
Dawn Ressel
Full-Stack User Experiences: A Marriage of Design and Technology
2016 • Enterprise UX 2016
Gold
B. Pagels-Minor
Breaking the Tension: The Power of Enabling Your Employees to Show Up Authentically
2022 • Design at Scale 2022
Gold
Jeff Gothelf
The Intersection of Lean and Design (Videoconference)
2019 • Enterprise Community
Shaping design, designers and teams
2018 • DesignOps Summit 2018
Gold
Michael Weir
Mixed Methods and Behavioural Science (Videoconference)
2023 • Rosenfeld Community
Jack Moffett
UX Metrics That Matter and The Future of our Design at Scale Conference: A Community Conversation (Videoconference)
2022 • Enterprise Community
Nathan Curtis
Design Systems for Us: How Many One-Source(s)-of-Truth Are Enough? (Videoconference)
2019 • DesignOps Community
Marjorie Stainback
Transforming Strategic Research Capacity through Democratization
2019 • DesignOps Summit 2019
Gold
Peter Van Dijck
Coffee with Lou #4: Taking a Peek Under the Rosenbot's Hood (Videoconference)
2024 • Rosenfeld Community

More Videos

Alex Hurworth

"We are witnessing the most rapid loss of biodiversity in human history."

Alex Hurworth Bonnie John Fahd Arshad Antoine Marin

Designing a Contact Tracing App for Universal Access

October 23, 2020

Laine Riley Prokay

"Investing in new practitioners is mutually rewarding; we learn from their fresh perspectives and reassess what we know ourselves."

Laine Riley Prokay Lisa Gordon

Carving a Path for Early Career DesignOps Practitioners

September 9, 2022

Eniola Oluwole

"TripAdvisor is really nine major business units each thinking like sub companies instead of one end-to-end user experience."

Eniola Oluwole

Lessons From the DesignOps Journey of the World's Largest Travel Site

October 24, 2019

Nathan Shedroff

"You need to learn the vocabulary, tools, and processes your peers know and understand where they are inadequate."

Nathan Shedroff

Double Your Mileage: Use Your Research Strategically

March 31, 2020

Sam Proulx

"Mobile live captions can caption any sounds around the user in real time, making it a powerful accessibility tool."

Sam Proulx

Mobile Accessibility: Why Moving Accessibility Beyond the Desktop is Critical in a Mobile-first World

November 17, 2022

Feleesha Sterling

"Documentation and making findings visible even without a dedicated research librarian helps maintain program momentum."

Feleesha Sterling

Building a Rapid Research Program (Videoconference)

May 18, 2023

Neil Barrie

"We are at an inflection point where what got us here won't get us to a thriving future."

Neil Barrie

Widening the Aperture: The Case for Taking a Broader Lens to the Dialogue between Products and Culture

March 25, 2024

John Devanney

"A well framed project is a rare thing — it’s also a creative exercise that unleashes teams’ possibilities."

John Devanney

The Design Management Office

November 6, 2017

Katy Mogal

"The most important thing is producing something that gives a perspective nobody else in the organization can bring."

Katy Mogal

But Do Your Insights Scale?

March 12, 2021