Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

What Did I Miss? The Hidden Costs of Deprioritizing Diversity in User Research
Gold
Friday, March 12, 2021 • Advancing Research 2021
Share the love for this talk
What Did I Miss? The Hidden Costs of Deprioritizing Diversity in User Research
Speakers: Megan Campos
Link:

Summary

Characteristics like race, ethnicity, gender, and disability status can have a significant impact on how we experience the world, and how the world experiences us. In UX research, diversity is the first thing to vanish from the recruit when the going gets tough; I will talk about what we miss when that happens, and what researchers can do about it in their own practice. This presentation will demonstrate why a diverse recruit is imperative for a strong user research study, provide examples of what we miss when the recruit is homogeneous, and offering tactics for addressing the issue.

Key Insights

  • Demographic criteria like race, gender, and socioeconomic status significantly impact user experiences but are often considered less important than visible traits like age or location in research recruitment.

  • Homogeneous participant pools (mostly white, middle-class, cisgender individuals) persist because demographic criteria are treated as flexible or optional during recruitment.

  • Ignoring demographic diversity risks centering dominant cultural perspectives and missing unique needs, which can limit the effectiveness of research outcomes.

  • Explicitly setting non-negotiable demographic quotas (e.g., minimum number of non-white participants) improves recruitment diversity with third-party recruiters.

  • Recruiters often default to convenience samples; strong client insistence is required to shift their priorities toward representativeness.

  • Diverse research teams can better identify recruitment barriers and help reach underrepresented user populations.

  • Case studies in healthcare research demonstrate that racial identity shapes patient experiences in ways unrelated to other factors like profession or age.

  • Not knowing what insights are missed by lacking diversity is a critical blind spot in user research.

  • Recruiting diverse participants requires going beyond familiar networks, including engaging with specific communities and non-English speakers.

  • Purposeful overrepresentation of marginalized groups in research may help correct historical overrepresentation of dominant demographics.

Notable Quotes

"We’re actually talking about increasing the representative numbers for communities who are frequently absent or excluded from research."

"If we just decide to ignore demographics, we’re missing huge swaths of the participant experience and an opportunity to better serve our users."

"Those criteria that have more invisible economic, social, and political structures around them are on the less important end, while visible structures like age are ranked higher."

"The viruses don’t discriminate based on race, but our healthcare system does."

"Recruiters have become conditioned to treat demographic criteria as flexible or optional, and I don’t think they should be."

"If you go into a study knowing that you want to recruit a diverse participant pool, be upfront with the recruiter and push back if they can’t meet those needs."

"We can’t pretend that people’s behaviors and experiences exist separate from the identities that society attaches to them."

"We don’t know what we missed by not yielding demographic diversity — that’s a blind spot in user research."

"Wider audiences equal more dollars — expanding diversity isn’t just ethical, it’s good business."

"Stagnation isn’t good for everyone at best and can actively do a disservice to our users at worst."

Ask the Rosenbot
Sam Proulx
SUS: A System Unusable for Twenty Percent of the Population
2021 • DesignOps Summit 2021
Gold
Dr. Karl Jeffries
The Science of Creativity for DesignOps
2024 • DesignOps Summit 2020
Gold
Jonathan Fairman
Integrating generative AI into enterprise products: A case study from dscout
2024 • Designing with AI 2024
Gold
Michaela Mora
Advanced Concept Testing Approaches To Guide Product Development and Business Decisions
2022 • Advancing Research 2022
Gold
Megan Blocker
A Selectively Scrappy Approach to ResearchOps
2018 • DesignOps Summit 2018
Gold
Greg Petroff
Software as Material—A Redux
2023 • Enterprise UX 2023
Gold
Ana Maria Montero Barrantes
The Authentic UX Talent Show
2024 • Enterprise Experience 2020
Gold
Erin Weigel
Get Your Whole Team Testing to Design for Impact
2024 • Rosenfeld Community
Kat Vellos
Opener: The Other L Word
2024 • DesignOps Summit 2020
Gold
Kevin Bethune
Gatekeepers and Servant Leadership (Videoconference)
2020 • DesignOps Community
Brad Peters
Short Take #1: UX/Product Lessons from Your Industry Peers
2022 • Design in Product 2022
Gold
Davis Neable
How to Drive a Design Project When you Don’t Have a Design Team
2021 • Design at Scale 2021
Gold
Sam Ladner
How Research Can Drive Strategic Foresight
2022 • Advancing Research 2022
Gold
Laine Riley Prokay
How DesignOps can Drive Inclusive Career Ladders for All
2021 • DesignOps Summit 2021
Gold
Steve Portigal
Looking Back…to Look Ahead
2024 • Advancing Research 2024
Gold
Dan Willis
Enterprise Storytelling Sessions
2015 • Enterprise UX 2015
Gold

More Videos

"Development requests were often pragmatic—shadowing, mentoring, and reviewing—not big training courses."

Shaping design, designers and teams

November 8, 2018

Sabrina Mach

"Selling the design system’s value continuously, especially as new teams and components are added, is essential."

Sabrina Mach Nina Wainwright

How to Design Your Design Operating Model

September 29, 2021

Samuel Proulx

"Accessible experiences are for everyone; they make things better for all users."

Samuel Proulx

Invisible barriers: Why accessible service design can’t be an afterthought

December 3, 2024

Saara Kamppari-Miller

"One of the superpowers of Ops humans is that we’re really good at taking problems and gaps and making them visible."

Saara Kamppari-Miller

DesignOps for Inclusive Design and Accessibility (Videoconference)

May 26, 2022

Briana Thomas

"We had no recipe, no formula, just vibes, and some mystery box of ingredients."

Briana Thomas

The Quiet Force: Uncovering Hidden Leadership in High-Impact Design Teams

September 24, 2024

Adam Cutler

"Don't be cool, be good—work hard at managing your teams because they need you to nail it."

Adam Cutler Karen Pascoe Ian Swinson Susan Worthman

Discussion

June 8, 2016

"By building tools around the natural workflow and how work was being done, we moved faster and worked more productively."

Operationalizing DesignOps

November 7, 2018

Leah Buley

"No VP cares about your research report; they want to know what this means for the business risks and decisions."

Leah Buley Joe Natoli

Ask Me Anything with Leah Buley and Joe Natoli, co-authors of The User Experience Team of One (2nd edition)

October 8, 2024

Nathan Shedroff

"You need to learn the vocabulary, tools, and processes your peers know and understand where they are inadequate."

Nathan Shedroff

Double Your Mileage: Use Your Research Strategically

March 31, 2020