Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Dark Side of Democratization (Videoconference)
Friday, October 13, 2023 • Advancing Research Community
Share the love for this talk
Dark Side of Democratization (Videoconference)
Speakers: Ari Zelmanow
Link:

Summary

The democratization of research practices has become almost ubiquitous, and an increasingly expanding part of many research teams. There has been a lot of discussion and sharing about the benefits of democratization programs, and case studies shared on how to make them effectively work. As the reach of this approach grows though, there are a number of emerging voices who are starting to question the way in which democratization programs are being used and rolled out. As well as asking difficult questions about the extent to which they should be deployed in the first place, and how they are able to work, rather than undermine, traditional research sciences.

Key Insights

  • Democratization of research is often misunderstood and misleading as a term, likened to propaganda.

  • Research is a specialized skill requiring training, education, and experience similar to professions like medicine.

  • There are three key research phases: impartial evidence collection, partial insight generation, and advocating case presentation.

  • Allowing untrained non-researchers to conduct foundational research risks contamination, bias, and poor business decisions.

  • The Dunning-Kruger effect causes non-experts to overestimate their research competence, leading to bad outcomes.

  • Usability testing by non-researchers can be acceptable but should be governed and clearly limited in scope.

  • There is no established research governance or standardized certification akin to other professions.

  • Research should focus on delivering points of view informed by evidence rather than just data or reports.

  • Businesses often misuse democratization as a cost-cutting method instead of properly funding research capacity.

  • A successful democratization program requires guardrails, governance, coaching, and clear boundaries.

Notable Quotes

"The very word democratization in research is misleading, it’s almost akin to propaganda."

"Research is a systematic investigation in order to establish facts and reach new conclusions."

"Good enough isn’t always good enough — especially in high stakes decisions."

"Who would you rather have conduct heart surgery? A part-time surgeon or a full-time surgeon? That’s specialization."

"The risk of contaminating the evidence at the start of research can ruin the whole case."

"The problem with democratization is that there are no guardrails."

"Your value as a researcher isn’t in your ability to use a method, it’s the point of view you develop from a body of evidence."

"If anybody could do research, why do businesses still hire specialized researchers?"

"Making insights ubiquitous across a business is different from democratizing research itself."

"Democratization without governance leads to a wild west of inquiry, which is dangerous for a business."

Leah Buley
Ask Me Anything with Leah Buley and Joe Natoli, co-authors of The User Experience Team of One (2nd edition)
2024 • Rosenfeld Community
Gregg Bernstein
Opportunistic Research with Gregg Bernstein (Videoconference)
2019 • Advancing Research Community
Gonzalo Goyanes
Design ROI: Cover a Little, Get a Lot
2022 • DesignOps Summit 2022
Gold
Laura Weiss
There is No Playbook: Leader as Coach During Challenging Times (Videoconference)
2024 • Rosenfeld Community
Alnie Figueroa
Teamwork: Strategies for Effective Collaboration with Other Program Management Teams
2022 • DesignOps Summit 2022
Gold
Rachael Dietkus, LCSW
Everything You Need to Know about the Civic Design 2022 Call for Presentations (Videoconference)
2022 • Civic Design Community
Sam Proulx
Online Shopping: Designing an Accessible Experience
2023 • Enterprise UX 2023
Gold
Meredith Black
Building Community and Common Trends to Look for in 2021 (Videoconference)
2020 • DesignOps Community
Catt Small
What's Next for ICs: Exploring Staff and Principal Designer Roles (Videoconference)
2024 • Rosenfeld Community
Yasmine Khan
Checking Bias and Listening to Financially Vulnerable Americans
2020 • Advancing Research 2020
Gold
Jon Fukuda
Storytelling for DesignOps (Videoconference)
2023 • DesignOps Community
Louis Rosenfeld
Opening Remarks
2023 • DesignOps Summit 2023
Gold
Jemma Ahmed
Theme 2 Intro
2024 • Advancing Research 2024
Gold
Dr. Karl Jeffries
The Science of Creativity for DesignOps
2024 • DesignOps Summit 2020
Gold
Product and Design at Bloomberg: A 15-year Evolution
2022 • Design in Product 2022
Gold
Steve Sanderson
Discussion
2015 • Enterprise UX 2015
Gold

More Videos

Wyatt Hayman

"Survey question volume can range from one question to up to 40, but most participants answer around 20 questions."

Wyatt Hayman

Global Research Panels (Videoconference)

August 8, 2020

PJ Buddhari

"Our team does not actually build the components consumed by product teams due to how Adobe's teams are structured."

PJ Buddhari Nate Baldwin

Meet Spectrum, Adobe’s Design System

June 9, 2021

Sarah Gallimore

"What if by 2040 writing an essay with AI was actually the assignment to train students in policy translation?"

Sarah Gallimore

Inspire Progress with Artifacts from the Future

November 18, 2022

Peter Merholz

"UX directors often feel like this poor person in the middle here getting pulled in all these directions."

Peter Merholz

The Trials and Tribulations of Directors of UX (Videoconference)

July 13, 2023

Dr. Jamika D. Burge

"More inclusive teams are more productive and effective, especially women-led teams that inspire community."

Dr. Jamika D. Burge Mansi Gupta

Advancing the Inclusion of Womxn in Research Practices (Videoconference)

September 15, 2022

Amy Marquez

"Showing instead of telling really sparks people’s interest and often leads engineers to fix problems even on weekends."

Amy Marquez

INVEST: Discussion

June 15, 2018

Dane DeSutter

"Games are not a point in time you run away from — you don’t just drop the cartridge and walk away."

Dane DeSutter Natalie Gedeon Deborah Hendersen Cheryl Platz

Beyond the Console: The rise of the Gamer Experience and how gaming will impact UX Research across industries (Videoconference)

May 17, 2024

Zariah Cameron

"Denying the body is not an antidote to the suffering of the world. When we protect our rest, we protect our dreaming."

Zariah Cameron

ReDesigning Wellbeing for Equitable Care in the Workplace

September 23, 2024

Jessica Norris

"ADHD isn’t a deficit of attention, but trouble regulating it, which leads to hyperfocus on interesting tasks."

Jessica Norris

ADHD: A DesignOps Superpower

September 9, 2022