What Did I Miss? The Hidden Costs of Deprioritizing Diversity in User Research
Summary
Characteristics like race, ethnicity, gender, and disability status can have a significant impact on how we experience the world, and how the world experiences us. In UX research, diversity is the first thing to vanish from the recruit when the going gets tough; I will talk about what we miss when that happens, and what researchers can do about it in their own practice. This presentation will demonstrate why a diverse recruit is imperative for a strong user research study, provide examples of what we miss when the recruit is homogeneous, and offering tactics for addressing the issue.
Key Insights
-
•
Researchers often undervalue race, ethnicity, gender, and sex in recruitment compared to other demographic criteria like age and location.
-
•
Homogeneous recruitment pools are usually predominantly white, cisgender, and economically middle class, limiting representativeness.
-
•
Ignoring demographic diversity risks reinforcing dominant cultural perspectives and missing key user needs and experiences.
-
•
Demographics such as race and gender significantly shape lived experiences and thus influence how users interact with products and services.
-
•
Specific and non-flexible demographic quotas improve success in recruiting diverse participants from third-party recruiters.
-
•
Recruiters often treat demographic criteria as optional, requiring pushback and clear communication to prioritize diversity.
-
•
Diverse research teams help identify recruitment barriers and blind spots that homogeneous teams may overlook.
-
•
Recruitment strategies must extend beyond familiar networks and include culturally appropriate outreach to marginalized communities.
-
•
Even when diversity isn’t the study focus, recruiting representative participants can surface critical differences in experience.
-
•
Overrepresenting marginalized groups in samples can compensate for historical overrepresentation of dominant groups and reveal nuanced insights.
Notable Quotes
"If we just decide to ignore demographics we're missing huge swaths of the participant experience and an opportunity to better serve our users."
"Demographic criteria is generally considered less important compared to project-specific or contextual criteria in recruitment."
"The viruses don't discriminate based on race, but our healthcare system does."
"We often center the point of view of dominant demographics and ignore the needs of those we never speak to."
"Recruiters have become conditioned to treat demographic criteria as flexible or optional, and I want to say they shouldn't be."
"If seeing a diverse participant pool is important to you, it's your responsibility to make sure your recruiters use it as a priority."
"We can't say with certainty what needs or pain points we missed when our recruits weren't demographically diverse."
"Age carries with it obvious visible differences and lived experience, while race often involves less visible but equally impactful structures."
"The best we do should be open to improvement and evolution to better serve clients' target audiences."
"When you have findings that serve smaller populations, it often tends to serve the broader population as well."
Or choose a question:
More Videos
"Sometimes the loudest voices dominate, but asynchronous collaboration helps give quieter voices a chance to speak."
Jerome “Axle” BrownHow to Use Self-Directed Learning to Ensure Your Research Insights are Heard and Acted Upon
March 11, 2021
"IBM Design Thinking is about collaborating around artifacts and frameworks, not prescribing the process teams must follow."
Phil GilbertA Consistent Culture of Design
May 14, 2015
"We’re not trying to change behavior, but help researchers in their existing processes to make research faster."
Kate Towsey Basel Fakhoury Oren Friedman Graham GardnerParticipant Recruitment and Management Tools
March 12, 2026
"Human behavior is complex and machine learning models need to understand those nuances."
Sohit KarolDesigning Delightful Listening Experiences: Mixed Methods Research in the Age of Machine Learning
March 31, 2020
"Developers were hungry for the bigger picture, but the only information available to them was a set of user stories."
Christopher Taylor Edwards Valerie RoskeDesign as a Team Practice, A Practical Guide to Cross-functional Collaboration
September 30, 2021
"Systems thinking can help us design more explicitly for resilience, as seen in distributed manufacturing of PPE during the pandemic."
Sheryl CababaExpanding Your Design Lens with Systems Thinking
February 23, 2023
"Design maturity results from behaviors and structures that enable delivering value to customers, business, ourselves, and society."
Francesca Barrientos, PhDYou Need Your Own Definition of Design Maturity
June 8, 2022
"Hospital workers were 45% more likely to wash hands properly when told it helped patients rather than themselves."
Allison SandersOperating with Purpose
January 8, 2024
"Words are how we express our values, our philosophies, why we do what we do as designers and researchers."
Saara Kamppari-Miller"Prototype" vs "Prototype"--Breaking Down and Rebuilding Our Understanding of What We Do
October 24, 2019
Latest Books All books
Dig deeper with the Rosenbot
Is it possible to bypass HIPAA by initially targeting veterinary markets for clinical app development?
In what ways can AI automate UX research tasks, and what limitations does it currently have?
In what clinical workflow areas is AI currently being integrated and what are the main UX challenges associated?