Right horses for the right courses – how and when to democratize research
Summary
“Research democratization” has become a rallying cry in many organizations — but also a source of tension. Should everyone be able to run studies, or should research stay tightly centralized? The truth is, both extremes create waste, confusion, and risk. In this talk, I’ll share a practical framework for when to democratize and when to centralize research. You’ll learn how to weigh risk, reversibility, and audience impact; how to put guardrails around democratized research; and how AI can enable broader participation without chaos. You’ll leave with a decision matrix and a “democratization charter” you can adapt to your org, so the right people are on the right horses for the right courses.
Key Insights
-
•
Democratization of research exists on a spectrum and must be customized to each organization's context, risk tolerance, and regulatory environment.
-
•
Not all research tasks should be democratized; high-risk or unclear problems require specialist researcher involvement.
-
•
AI tools are enabling broader roles for PMs and designers, allowing faster prototyping and product documentation, blurring specialist boundaries.
-
•
Effective democratization requires elegant guardrails to protect participant safety, data privacy, and research quality.
-
•
Democratization can massively increase organizational research capacity, as Flight Center’s example shows, tripling volume while maintaining quality.
-
•
Training and certification are critical to enable non-researchers to run low-risk studies effectively and ethically.
-
•
Bias awareness and anti-bias training are essential components of democratization to maintain the integrity of insights.
-
•
A democratization charter outlining who can conduct research, with which audiences and methods, helps set clear expectations and governance.
-
•
Research maturity assessment helps determine an organization's readiness for democratization and identifies needed upskilling.
-
•
Research quality control currently relies on script review and coaching but is evolving toward AI-supported automatic quality feedback.
Notable Quotes
"Democratization is here to stay, and it’s a positive force for good in product development."
"The democratization spectrum ranges from everyone accessing feedback to a free-for-all, but I don’t advocate for a free-for-all."
"We need elegant guardrails to keep the business safe, keep participants safe, and make democratization ethical."
"Flight Center went from 10 researchers running research to over 130 people trained to safely do interviews."
"When done right, democratization multiplies the impact of research rather than diluting it."
"The goal is to lower the floor for who can access research while raising the ceiling of what’s possible."
"It should be as easy to run research as brushing your teeth."
"AI will soon enable us to automatically flag leading questions and coach researchers for quality."
"Not every problem needs research; sometimes it’s fine to ship quickly and learn after."
"Training non-researchers in bias awareness and methodology is essential to prevent poor data and insights."
Or choose a question:
More Videos
"My research team focused too much on scientific rigor, while design teams improved intuition with reflection and demonstration."
Yoel SumitroActions and Reflections: Bridging the Skills Gap among Researchers
March 9, 2022
"The cognitive load saved by not having to manage security software on mobile phones is a huge accessibility win."
Sam ProulxMobile Accessibility and You
June 9, 2022
"Stakeholders aren’t leaving us out on purpose; they make reasonable decisions with imperfect information."
Dalia El-ShimySo You've Got a Seat at the Table. Now What?
March 31, 2020
"Collaboration is much more than creating a meeting or structure; if there’s no trust and respect, people won’t show up."
Jemma Ahmed Subhasree Chatterjee Robert Fabricant Alexandra Jayeun Lee Ben RobinsCollaboration: learning from other fields beyond our own [Advancing Research Community Workshop Series]
August 7, 2024
"Do I find a way to make this conversation more about the software as scheduled or do I show Laura how to react to the unplanned?"
Randolph Duke IIWar Stories LIVE! Randy Duke II
March 30, 2020
"Why am I talking? Sometimes it’s better to ask a question and be silent."
Laura WeissThere is No Playbook: Leader as Coach During Challenging Times
April 26, 2024
"Driver modeling tells you which research initiatives matter most based on their impact on key outcome metrics."
Landon BarnesAre My Research Findings Actually Meaningful?
March 10, 2022
"The best large language model is right under your nose: the human brain with 300,000 years of ancestral development."
Dr. Jamika D. Burge Nick Fine Alexandra Jayeun Lee Greg Nudelman Bo WangHow UX researchers can partner with (and not be replaced by) AI [Advancing Research Community Workshop Series]
August 31, 2023
"The oldest lesson is that failure is a far better teacher than success, but this year I found resilience in something stronger: hope."
Jonathon ColmanHow to Maximize the Impact of Content Design
January 8, 2024
Latest Books All books
Dig deeper with the Rosenbot
What impact does AI have on the speed and demand for user research according to Basil Faqiri?
How can play help overcome the ‘messy middle’ between research insights and decision-making in organizations?
Who are natural allies for healthcare UX professionals inside complex healthcare systems, and how do you engage them?