Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

What Did I Miss? The Hidden Costs of Deprioritizing Diversity in User Research
Gold
Friday, March 12, 2021 • Advancing Research 2021
Share the love for this talk
What Did I Miss? The Hidden Costs of Deprioritizing Diversity in User Research
Speakers: Megan Campos
Link:

Summary

Characteristics like race, ethnicity, gender, and disability status can have a significant impact on how we experience the world, and how the world experiences us. In UX research, diversity is the first thing to vanish from the recruit when the going gets tough; I will talk about what we miss when that happens, and what researchers can do about it in their own practice. This presentation will demonstrate why a diverse recruit is imperative for a strong user research study, provide examples of what we miss when the recruit is homogeneous, and offering tactics for addressing the issue.

Key Insights

  • Demographic criteria like race, gender, and socioeconomic status significantly impact user experiences but are often considered less important than visible traits like age or location in research recruitment.

  • Homogeneous participant pools (mostly white, middle-class, cisgender individuals) persist because demographic criteria are treated as flexible or optional during recruitment.

  • Ignoring demographic diversity risks centering dominant cultural perspectives and missing unique needs, which can limit the effectiveness of research outcomes.

  • Explicitly setting non-negotiable demographic quotas (e.g., minimum number of non-white participants) improves recruitment diversity with third-party recruiters.

  • Recruiters often default to convenience samples; strong client insistence is required to shift their priorities toward representativeness.

  • Diverse research teams can better identify recruitment barriers and help reach underrepresented user populations.

  • Case studies in healthcare research demonstrate that racial identity shapes patient experiences in ways unrelated to other factors like profession or age.

  • Not knowing what insights are missed by lacking diversity is a critical blind spot in user research.

  • Recruiting diverse participants requires going beyond familiar networks, including engaging with specific communities and non-English speakers.

  • Purposeful overrepresentation of marginalized groups in research may help correct historical overrepresentation of dominant demographics.

Notable Quotes

"We’re actually talking about increasing the representative numbers for communities who are frequently absent or excluded from research."

"If we just decide to ignore demographics, we’re missing huge swaths of the participant experience and an opportunity to better serve our users."

"Those criteria that have more invisible economic, social, and political structures around them are on the less important end, while visible structures like age are ranked higher."

"The viruses don’t discriminate based on race, but our healthcare system does."

"Recruiters have become conditioned to treat demographic criteria as flexible or optional, and I don’t think they should be."

"If you go into a study knowing that you want to recruit a diverse participant pool, be upfront with the recruiter and push back if they can’t meet those needs."

"We can’t pretend that people’s behaviors and experiences exist separate from the identities that society attaches to them."

"We don’t know what we missed by not yielding demographic diversity — that’s a blind spot in user research."

"Wider audiences equal more dollars — expanding diversity isn’t just ethical, it’s good business."

"Stagnation isn’t good for everyone at best and can actively do a disservice to our users at worst."

Ask the Rosenbot
Sha Hwang
The Lost Year
2021 • Design at Scale 2021
Gold
Satyam Kantamneni
Do You Have an Experience Vision? (Videoconference)
2023 • Enterprise Community
Sam Ladner
Data Exhaust and Personal Data: Learning from Consumer Products to Enhance Enterprise UX
2016 • Enterprise UX 2016
Gold
Bria Alexander
Opening Remarks
2021 • Design at Scale 2021
Gold
Kevin M. Hoffman
Theme 2: Enterprise Team Journey
2019 • Enterprise Experience 2019
Gold
Louis Rosenfeld
Coffee with Lou: Should You Write a (UX) Book? (Videoconference)
2024 • Rosenfeld Community
Cheryl Platz
Merging Improv with Design (Videoconference)
2019 • Enterprise Community
Theresa Marwah
How Atlassian is Operationalizing Respect in Research (Videoconference)
2020 • Advancing Research Community
Shipra Kayan
How we Built a VoC (Voice of the Customer) Practice at Upwork from the Ground Up
2021 • DesignOps Summit 2021
Gold
Sha Hwang
The First Fifty Years of Civic Design
2022 • Civic Design 2022
Gold
Saara Kamppari-Miller
DesignOps for Inclusive Design and Accessibility (Videoconference)
2022 • DesignOps Community
Melinda Belcher
Insider preview of Enterprise Experience 2020 (Videoconference)
2020 • Enterprise Community
Spencer L. A. Stultz
Why Social Justice Frameworks are Necessary for Successful DEI/JEDI Initiatives
2023 • DesignOps Summit 2023
Gold
Ariel Kennan
Building a Design Culture
2017 • Enterprise Experience 2017
Gold
Kevin Bethune
Reimagining Design: Unlocking Strategic Innovation
2022 • Design at Scale 2022
Gold
Andrew Webster
Scaling Design Capability: How Involved Should You Be?
2021 • DesignOps Summit 2021
Gold

More Videos

"Scale isn’t just about quantity, it’s about the quality and impact you have on the outcomes of the organization."

Standardizing Product Merits for Leaders, Designers, and Everyone

June 15, 2018

Simon Wardley

"The only people who can effectively map a space are those who work and understand that space intimately."

Simon Wardley

Maps and Topographical Intelligence (Videoconference)

January 31, 2019

Sandra Camacho

"White supremacy is the belief system of the superiority of whiteness that can embed itself in algorithms."

Sandra Camacho

Creating More Bias-Proof Designs

January 22, 2025

Darian Davis

"I held Jeff accountable by expecting criticism to come with rationale and intentional improvement."

Darian Davis

Lessons from a Toxic Work Relationship

January 8, 2024

Fisayo Osilaja

"Providing more holistic recommendations helped us gain more trust and buy-in from stakeholders, increasing UX maturity."

Fisayo Osilaja

[Demo] The AI edge: From researcher to strategist

June 4, 2024

Uday Gajendar

"Working with CEOs like Mark Templeton is like Dancing with the Stars — an interpretive dance of translating fuzzy ideas."

Uday Gajendar

The Wicked Craft of Enterprise UX

May 13, 2015

Davis Neable

"Investing in people and fostering collaboration always pays off in stronger teams and better user experiences."

Davis Neable Guy Segal

How to Drive a Design Project When you Don’t Have a Design Team

June 10, 2021

Eniola Oluwole

"TripAdvisor is really nine major business units each thinking like sub companies instead of one end-to-end user experience."

Eniola Oluwole

Lessons From the DesignOps Journey of the World's Largest Travel Site

October 24, 2019

Aurobinda Pradhan

"Finding a single source of truth for design documents and artifacts is extremely hard because most tools operate in silos."

Aurobinda Pradhan Shashank Deshpande

Introduction to Collaborative DesignOps using Cubyts

September 9, 2022