What Did I Miss? The Hidden Costs of Deprioritizing Diversity in User Research
Summary
Key Insights
-
•
Researchers often undervalue race, ethnicity, gender, and sex in recruitment compared to other demographic criteria like age and location.
-
•
Homogeneous recruitment pools are usually predominantly white, cisgender, and economically middle class, limiting representativeness.
-
•
Ignoring demographic diversity risks reinforcing dominant cultural perspectives and missing key user needs and experiences.
-
•
Demographics such as race and gender significantly shape lived experiences and thus influence how users interact with products and services.
-
•
Specific and non-flexible demographic quotas improve success in recruiting diverse participants from third-party recruiters.
-
•
Recruiters often treat demographic criteria as optional, requiring pushback and clear communication to prioritize diversity.
-
•
Diverse research teams help identify recruitment barriers and blind spots that homogeneous teams may overlook.
-
•
Recruitment strategies must extend beyond familiar networks and include culturally appropriate outreach to marginalized communities.
-
•
Even when diversity isn’t the study focus, recruiting representative participants can surface critical differences in experience.
-
•
Overrepresenting marginalized groups in samples can compensate for historical overrepresentation of dominant groups and reveal nuanced insights.
Notable Quotes
"If we just decide to ignore demographics we're missing huge swaths of the participant experience and an opportunity to better serve our users."
"Demographic criteria is generally considered less important compared to project-specific or contextual criteria in recruitment."
"The viruses don't discriminate based on race, but our healthcare system does."
"We often center the point of view of dominant demographics and ignore the needs of those we never speak to."
"Recruiters have become conditioned to treat demographic criteria as flexible or optional, and I want to say they shouldn't be."
"If seeing a diverse participant pool is important to you, it's your responsibility to make sure your recruiters use it as a priority."
"We can't say with certainty what needs or pain points we missed when our recruits weren't demographically diverse."
"Age carries with it obvious visible differences and lived experience, while race often involves less visible but equally impactful structures."
"The best we do should be open to improvement and evolution to better serve clients' target audiences."
"When you have findings that serve smaller populations, it often tends to serve the broader population as well."
Or choose a question:
More Videos
"Ownership of VOC is a hot potato, so we built a coalition with a facilitator to keep it collaborative and effective."
Shipra KayanHow we Built a VoC (Voice of the Customer) Practice at Upwork from the Ground Up
September 30, 2021
"Categories are dangerous but not bad."
Peter MorvilleThe Architecture of Understanding
May 13, 2015
"I was going to use everything that I had experienced, all the skills, all the successes, and become my own superpower."
Renee ReidBecoming a ResearchH.E.R (Highly Enterprise Ready)
June 3, 2019
"The environment can disrupt critical interactions, like when Stacey gets caught up in cords and takes her eyes off the patient."
Dane DeSutterKeeping the Body in Mind: What Gestures and Embodied Actions Tell You That Users May Not
March 26, 2024
"A good two-factor system offers multiple methods, like authenticator apps, calls, and texts, with generous timeouts."
Sam ProulxOnline Shopping: Designing an Accessible Experience
October 3, 2023
"Aligning content to audience expectations requires understanding their intent through market research."
Andrew Custage Michael MallettThe Digital Journey: Research on Consumer Frustration and Loyalty
March 29, 2023
"Persisting conversations in Slack instead of Zoom chat means folks can revisit and join conversations asynchronously."
Shelby SwitzerMaking Space for Community Knowledge-sharing in a Distributed World
December 10, 2021
"More than a third of content on social media sites is AI generated, creating a training problem for new AI models."
Llewyn PaineCoexisting with AI: A practical guide for researchers to navigate tools, ethics, and integration
March 11, 2025
"The only thing any of us can control is how quickly we learn and then act based on that learning."
Robin BeersNavigating organizational systems: Rethinking researcher’s role in driving change
March 13, 2025
