Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

What Did I Miss? The Hidden Costs of Deprioritizing Diversity in User Research
Gold
Friday, March 12, 2021 • Advancing Research 2021
Share the love for this talk
What Did I Miss? The Hidden Costs of Deprioritizing Diversity in User Research
Speakers: Megan Campos
Link:

Summary

Characteristics like race, ethnicity, gender, and disability status can have a significant impact on how we experience the world, and how the world experiences us. In UX research, diversity is the first thing to vanish from the recruit when the going gets tough; I will talk about what we miss when that happens, and what researchers can do about it in their own practice. This presentation will demonstrate why a diverse recruit is imperative for a strong user research study, provide examples of what we miss when the recruit is homogeneous, and offering tactics for addressing the issue.

Key Insights

  • Demographic criteria like race, gender, and socioeconomic status significantly impact user experiences but are often considered less important than visible traits like age or location in research recruitment.

  • Homogeneous participant pools (mostly white, middle-class, cisgender individuals) persist because demographic criteria are treated as flexible or optional during recruitment.

  • Ignoring demographic diversity risks centering dominant cultural perspectives and missing unique needs, which can limit the effectiveness of research outcomes.

  • Explicitly setting non-negotiable demographic quotas (e.g., minimum number of non-white participants) improves recruitment diversity with third-party recruiters.

  • Recruiters often default to convenience samples; strong client insistence is required to shift their priorities toward representativeness.

  • Diverse research teams can better identify recruitment barriers and help reach underrepresented user populations.

  • Case studies in healthcare research demonstrate that racial identity shapes patient experiences in ways unrelated to other factors like profession or age.

  • Not knowing what insights are missed by lacking diversity is a critical blind spot in user research.

  • Recruiting diverse participants requires going beyond familiar networks, including engaging with specific communities and non-English speakers.

  • Purposeful overrepresentation of marginalized groups in research may help correct historical overrepresentation of dominant demographics.

Notable Quotes

"We’re actually talking about increasing the representative numbers for communities who are frequently absent or excluded from research."

"If we just decide to ignore demographics, we’re missing huge swaths of the participant experience and an opportunity to better serve our users."

"Those criteria that have more invisible economic, social, and political structures around them are on the less important end, while visible structures like age are ranked higher."

"The viruses don’t discriminate based on race, but our healthcare system does."

"Recruiters have become conditioned to treat demographic criteria as flexible or optional, and I don’t think they should be."

"If you go into a study knowing that you want to recruit a diverse participant pool, be upfront with the recruiter and push back if they can’t meet those needs."

"We can’t pretend that people’s behaviors and experiences exist separate from the identities that society attaches to them."

"We don’t know what we missed by not yielding demographic diversity — that’s a blind spot in user research."

"Wider audiences equal more dollars — expanding diversity isn’t just ethical, it’s good business."

"Stagnation isn’t good for everyone at best and can actively do a disservice to our users at worst."

Mansi Gupta
Drawing from Feminist Practice to Make Inclusive Design Operational
2022 • DesignOps Summit 2022
Gold
Alana Washington
(Remote) Service Design: A Transformation Case Study
2022 • Design at Scale 2022
Gold
Ned Dwyer
The Intersection of Design and ResearchOps
2024 • DesignOps 2024
Gold
Adam Cutler
Discussion
2016 • Enterprise UX 2016
Gold
Pippa Lomas
Paving the Path for Neurodiversity in Design
2023 • DesignOps Summit 2023
Gold
Farid Sabitov
Automatization for Large Enterprise Teams
2024 • DesignOps Summit 2020
Gold
Joel Branch
Humanizing AI: Filling the Gaps with Multi-faceted Research
2021 • Advancing Research 2021
Gold
Leisa Reichelt
The Five Dysfunctions of Democratized Research at Scale
2020 • Advancing Research 2020
Gold
Brennan Hartich
Communicating and Establishing DesignOps as a New Function
2018 • DesignOps Summit 2018
Gold
Luke Roberts
Panel Discussion
2024 • Advancing Service Design 2024
Gold
Tutti Taygerly
Videconference: How to Work with Difficult People with Tutti Taygerly
2020 • Enterprise Community
Steve Portigal
War Stories LIVE! Q&A-Discussion
2020 • Advancing Research 2020
Gold
Andy Warr
Under My (Research) Umbrella: The Benefits and Challenges of Building a Unified Insights Function
2024 • Advancing Research 2024
Gold
Stop Talking, Start Doing
2017 • Enterprise Experience 2017
Gold
Angelos Arnis
Navigating the Rapid Shifts in Tech's Turbulent Terrain
2023 • DesignOps Summit 2023
Gold
Alba Villamil
Stereotyped by Design: Pitfalls in Cross-Cultural User Research
2020 • Advancing Research 2020
Gold

More Videos

Wyatt Hayman

"One of the coolest things is that product managers without formal research backgrounds can quickly talk to hosts across six countries without recruiting hassle."

Wyatt Hayman

Global Research Panels (Videoconference)

August 8, 2020

PJ Buddhari

"Instead of choosing colors and then checking contrast, we define target contrast ratios first and generate colors accordingly."

PJ Buddhari Nate Baldwin

Meet Spectrum, Adobe’s Design System

June 9, 2021

Sarah Gallimore

"When we stick to just verbal descriptions, a lot of nuance about future experiences gets lost."

Sarah Gallimore

Inspire Progress with Artifacts from the Future

November 18, 2022

Peter Merholz

"Playing politics in UX leadership is about maximizing relationships ethically to advance your agenda, not about being underhanded."

Peter Merholz

The Trials and Tribulations of Directors of UX (Videoconference)

July 13, 2023

Dr. Jamika D. Burge

"We need to be radically honest about who was in the research rather than blindly trusting generalized findings."

Dr. Jamika D. Burge Mansi Gupta

Advancing the Inclusion of Womxn in Research Practices (Videoconference)

September 15, 2022

Amy Marquez

"Product principles are minimal but help us say, oh, this is meeting that or not meeting that."

Amy Marquez

INVEST: Discussion

June 15, 2018

Dane DeSutter

"Gaming is about generating positivity in ways software like Azure can’t."

Dane DeSutter Natalie Gedeon Deborah Hendersen Cheryl Platz

Beyond the Console: The rise of the Gamer Experience and how gaming will impact UX Research across industries (Videoconference)

May 17, 2024

Zariah Cameron

"Jobs always ask for three references. I think I might start asking for three happy employees."

Zariah Cameron

ReDesigning Wellbeing for Equitable Care in the Workplace

September 23, 2024

Jessica Norris

"Having ADHD is like having a race car engine for a brain but with the brakes of a bicycle."

Jessica Norris

ADHD: A DesignOps Superpower

September 9, 2022