Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

The Five Dysfunctions of Democratized Research at Scale
Gold
Monday, March 30, 2020 • Advancing Research 2020
Share the love for this talk
The Five Dysfunctions of Democratized Research at Scale
Speakers: Leisa Reichelt
Link:

Summary

As more organizations embrace research we move on to the second generation question – how do we scale this user centered behavior to support demand? There are fairly systemic issues that can undermine our best intentions. At best, it can render our research wasteful and inefficient, and at worst it can introduce significant risks in the decision making that our teams make. This talk considers five of the most likely challenges you’ll rub up against – speed, silos, teams, numbers and failure to mature. We’ll then discuss what causes these and what you can do to mitigate risks for your organization.

Key Insights

  • Democratizing research requires differentiating between building empathy and gathering evidence, as these need different methods and skills.

  • Speed pressures often lead teams to cut corners on participant recruitment and analysis, compromising research quality.

  • Siloed or overly narrow research focus raises the risk of false positives and missing critical user context.

  • Weaponizing research data in team conflicts can reduce designers' ability to argue design thoughtfully, shifting debate to data as a battleground.

  • Focusing research on end-to-end user journeys helps maintain big-picture priorities and delivers more reliable, realistic insights.

  • Quantitative data is highly valued by organizations, but good surveys require expertise and are best combined with qualitative methods.

  • One usability test is better than none for beginners, but research maturity means growing beyond minimal effort based on risk.

  • Risk management framing helps teams decide the appropriate level of research effort, balancing speed, cost, and uncertainty.

  • Collaborative quality conversations between product managers, designers, and engineers improve trust and research decisions.

  • Existing teams already hold many tools to improve scaled research; activating them with planning, ease, and education is crucial.

Notable Quotes

"Democratizing research is much more than just telling everybody that they should go and talk to our customers."

"Getting closer to customers is about building empathy for different contexts, not just our own experience."

"Teams pleasing stakeholders often take the most expedient and effortless path forward, risking research quality."

"We used to have a rule of thumb that analysis should take twice as long as fieldwork to counter cognitive biases."

"People can make up an opinion about anything if asked – we often get users commenting on things that don't actually matter."

"Too tightly focused usability testing tends to give more positive results than when tested in realistic, end-to-end contexts."

"Designers are not trusted unless they bring data to the table, leading to a combative relationship with product managers."

"Research one user is 100% better than testing none, but that’s advice for getting started, not an end-state."

"Our main job in research is to reduce the risk of investing in the wrong place or in the wrong way."

"The ultimate decision about research investments usually comes down to the product manager."

Ask the Rosenbot
Dr. Jamika D. Burge
A Genuine Conversation about the Future of UX Research (Videoconference)
2024 • Advancing Research Community
Michelle Morrison
Practice What You Preach
2024 • DesignOps Summit 2020
Gold
Libby Maurer
Treating Diversity & Inclusion in Hiring as a Design Problem (Videoconference)
2019 • Enterprise Community
World Usability Day Panel Discussion (Videoconference)
2022 • DesignOps Community
Alla Weinberg
Workers Are Sick of Change: The Cure is Psychological Safety
2023 • Enterprise UX 2023
Gold
Bria Alexander
Opening Remarks
2021 • DesignOps Summit 2021
Gold
Lavy Kumar
Future of Work
2021 • Design at Scale 2021
Gold
Matt Bernius
Trauma-informed Research: A Panel Discussion (Videoconference)
2021 • Advancing Research Community
Laura Klein
Unique challenges of innovation in enterprises (Videoconference)
2020 • Enterprise Community
Wendy Johansson
Design at Scale: Behind the Scenes (Videoconference)
2021 • Enterprise Community
Rachel Radway
The Many Paths Of Design Operations
2022 • DesignOps Summit 2022
Gold
Jackie Ho
Lead Effectively While Preserving Team Autonomy with Growth Boards
2024 • Enterprise Experience 2020
Gold
Alexandra Schmidt
Enterprise UX Playbook (Videoconference)
2022 • Enterprise Community
Bria Alexander
Opening Remarks Day 2
2024 • Advancing Research 2024
Gold
Sarah Williams
A Framework for CX Transformation
2021 • Design at Scale 2021
Gold
Marina Martin
Lives on the Line: The Stakes of UX at the Scale of Government
2018 • Enterprise Experience 2018
Gold

More Videos

"We want teams to have autonomy and power to make pivot, shelve, and proceed decisions, not leadership dictating."

Standardizing Product Merits for Leaders, Designers, and Everyone

June 15, 2018

Simon Wardley

"Most strategy today is guesswork based on what others are doing, not based on situational awareness."

Simon Wardley

Maps and Topographical Intelligence (Videoconference)

January 31, 2019

Sandra Camacho

"Bias is a tendency, feeling or opinion for or against something without reason or evidence."

Sandra Camacho

Creating More Bias-Proof Designs

January 22, 2025

Darian Davis

"By observing Jeff’s concerns and asking questions, I was able to show empathy and focus on the problem rather than get defensive."

Darian Davis

Lessons from a Toxic Work Relationship

January 8, 2024

Fisayo Osilaja

"Providing more holistic recommendations helped us gain more trust and buy-in from stakeholders, increasing UX maturity."

Fisayo Osilaja

[Demo] The AI edge: From researcher to strategist

June 4, 2024

Uday Gajendar

"There is a common thread in craft: dignity, purpose, utility, and beauty."

Uday Gajendar

The Wicked Craft of Enterprise UX

May 13, 2015

Davis Neable

"No official kickoff was held, which meant shifting expectations and lack of alignment."

Davis Neable Guy Segal

How to Drive a Design Project When you Don’t Have a Design Team

June 10, 2021

Eniola Oluwole

"Once cash prizes were gone, people stopped feeling ownership of the design system."

Eniola Oluwole

Lessons From the DesignOps Journey of the World's Largest Travel Site

October 24, 2019

Aurobinda Pradhan

"Our two-way Jira integration allows you to link design activities directly with epics, user stories, and tasks."

Aurobinda Pradhan Shashank Deshpande

Introduction to Collaborative DesignOps using Cubyts

September 9, 2022