Rosenverse
Dark Side of Democratization

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Dark Side of Democratization

Friday, October 13, 2023 • Advancing Research Community
Share the love for this talk
Dark Side of Democratization
Speakers: Ari Zelmanow
Link:

Summary

The democratization of research practices has become almost ubiquitous, and an increasingly expanding part of many research teams. There has been a lot of discussion and sharing about the benefits of democratization programs, and case studies shared on how to make them effectively work. As the reach of this approach grows though, there are a number of emerging voices who are starting to question the way in which democratization programs are being used and rolled out. As well as asking difficult questions about the extent to which they should be deployed in the first place, and how they are able to work, rather than undermine, traditional research sciences.

Key Insights

  • The term 'democratization' in research is often misleading and functions as propaganda framing critics negatively.

  • Research involves three phases: impartial evidence collection, partial insight generation, and case presentation with a point of view.

  • Good enough research is often not actually good enough; the risks of poor-quality research can undermine business decisions.

  • The Dunning-Kruger effect leads untrained non-researchers to overestimate their research competence.

  • Democratization without guardrails creates a 'wild west' in organizations where research quality and ethics suffer.

  • Researchers have specialized training akin to physicians or detectives, which cannot be casually transferred.

  • Well-designed democratization programs require explicit governance, training, coaching, and clear boundaries on what non-experts can do.

  • Making insights ubiquitous and accessible across the business is more beneficial than broadly democratizing research tasks.

  • Research value lies more in developing informed points of view and strategic decision support than in merely delivering data or reports.

  • The research profession struggles with balancing rigor and protecting the domain without resorting to excessive gatekeeping.

Notable Quotes

"The very word democratization in research is misleading, almost akin to propaganda."

"Good enough research? Sometimes good enough isn’t good enough."

"Who would you rather have conduct heart surgery? A part-time or full-time surgeon? That’s specialization."

"The risk of using bad data is worse than using no data."

"There are no guardrails in democratization, and that is dangerous."

"Researchers are like detectives. We turn data into stories, stories into strategy, strategy into outcome."

"Overconfidence is a problem caused by the Dunning-Kruger effect in research democratization."

"Making insights ubiquitous is different from allowing anyone to do research."

"Businesses don’t democratize functions like finance or engineering; why research?"

"Our value as researchers is the diversity of thought and experience to develop a point of view."

Ask the Rosenbot
Russell Blair
Killing the blank page
2024 • Designing with AI 2024
Gold
JJ Kercher
A Roadmap for Maturing Design in the Enterprise
2018 • Enterprise Experience 2018
Gold
Dem Gerolemou
Climate technology fundamentals
2024 • Climate UX Interest Group
Lija Hogan
Contexts of Use: A Framework for Connection
2021 • Civic Design 2021
Gold
Kevin M. Hoffman
Theme 2: Enterprise Team Journey
2019 • Enterprise Experience 2019
Gold
Patrick Commarford
Design Staffing for Impact
2024 • DesignOps Summit 2020
Gold
Nick Cochran
Growing in Enterprise Design through Making Connections
2019 • Enterprise Experience 2019
Gold
Uday Gajendar
Theme One Intro
2023 • Enterprise UX 2023
Gold
George Abraham
Design Systems To-Go: Reimagining Developer Handoff, and Introducing App Builder (Part 2)
2021 • DesignOps Summit 2021
Gold
Eniola Oluwole
Lessons From the DesignOps Journey of the World's Largest Travel Site
2019 • DesignOps Summit 2019
Gold
Bria Alexander
Reflect and Chart Forward
2021 • Civic Design 2021
Gold
Laine Riley Prokay
How DesignOps can Drive Inclusive Career Ladders for All
2021 • DesignOps Summit 2021
Gold
Bria Alexander
OKRs—Helpful or Harmful?
2022 • DesignOps Community
Aaron Stienstra
Leveraging Civic Design to Advance Equity and Rebuild Trust in the US Federal Government
2021 • Civic Design 2021
Gold
Marc Majers
Interrupted UX - Add A Dose of Reality To Usability Testing
2022 • Advancing Research 2022
Gold
Julie Baher
Culture Change—My Journey
2015 • Enterprise UX 2015
Gold

More Videos

Lavy Kumar

"With how of work now separated from where we work, the design process stays the same—thinking holistically for all personas and touchpoints."

Lavy Kumar Kat Temple Shan Sebastian Tara Jensen Jenn Chou

Future of Work

June 9, 2021

Andreas Huebner

"It’s really been helpful that research supports design not just in discovery but also in validating that what we build meets customer expectations."

Andreas Huebner Amy Takata Craig Brookes

What Is It Like To Be Part of The UX Team at Compass?

March 11, 2021

Ricardo Martins

"Sixty-one factors influence students’ decisions when choosing a college—that’s a lot more than you might think."

Ricardo Martins

Unlocking the power of advanced quantitative methods

March 12, 2025

Monty Hammontree

"The fastest way to gain influence is to get somebody else promoted."

Monty Hammontree

The Future of UX Research

December 3, 2020

Benjamin Real

"It’s basically impossible for the design team to work without the design ops team."

Benjamin Real

Showing the Value of DesignOps by Not Having a DesignOps Team

October 21, 2020

Kate Towsey

"You can own the infrastructure that allows knowledge to flow but you can't actually own the knowledge itself."

Kate Towsey

Ask Me Anything (AMA) with Kate Towsey

April 2, 2025

Steve Portigal

"Building an internal research practice is critical for long-term value and integration of insights."

Steve Portigal Chris Chapo Kelly Goto Christian Rohrer

Discussion

May 13, 2015

Sam Proulx

"Browser autofill isn’t just convenience; it removes barriers to purchase for people with physical disabilities."

Sam Proulx

Online Shopping: Designing an Accessible Experience

March 28, 2023

Sam Proulx

"Screen magnification is really about making the screen larger, changing color contrast, reducing motion, and panning around the magnified area."

Sam Proulx

Prototype Reviews, People With Disabilities, and You

October 1, 2021