Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Dark Metrics: Illuminating the Negative Impact of Digital Health Design
Gold
Friday, March 12, 2021 • Advancing Research 2021
Share the love for this talk
Dark Metrics: Illuminating the Negative Impact of Digital Health Design
Speakers: Raven Veal
Link:

Summary

Traditional design metrics and KPIs are often geared towards measuring product success. Dark metrics challenge this paradigm by proactively measuring the unintended yet harmful psychological, social, and physical effects of our technologies. The examples within digital health are plentiful. From accelerating burnout among clinicians to widening racial disparities in quality of care, we can only reach the height of our most courageous solutions when we expose our deepest failures.

Key Insights

  • Traditional product metrics often ignore the broader individual and societal impacts of digital health technologies.

  • Dark Metrics is a framework focusing on measuring disempowerment, exclusion, addiction, and distraction caused by health tech.

  • Disempowerment occurs when technology undermines user autonomy, especially in sensitive healthcare decision-making.

  • Racial bias in AI can manifest indirectly, as in algorithms using proxies like healthcare costs that perpetuate inequities.

  • Co-creating design solutions with diverse voices is critical to proactively identifying unintended consequences.

  • Measuring unhealthy engagement requires going beyond 'engagement' metrics to include wellbeing indicators like stress or eye strain.

  • Distraction from clinical tools (e.g., EMRs) can reduce quality of care by pulling medical professionals away from patient interaction.

  • Embedding racial equity rubrics into the design process helps ensure inclusive user experiences beyond just product visuals.

  • Augmented intelligence should support, not replace, human decision-making especially in healthcare.

  • Early, collaborative risk ideation exercises like 'premortems' are recommended to anticipate potential harms before launch.

Notable Quotes

"Traditional product metrics focus narrowly on the product itself, missing what success means for the people using our technologies."

"Our tools are meant to support and enhance, not to take over — we call this augmented intelligence at IBM Watson."

"An algorithm that doesn’t explicitly use race but uses healthcare costs as a proxy can perpetuate racial discrimination."

"Exclusion doesn’t have to be explicit — you just have to be indifferent to it."

"The difference between technology and slavery is that slaves are fully aware they are not free."

"Doctors don’t want to be on a machine all day; they want to help people."

"Designing for people means acknowledging where we might be exclusionary and embedding equity like accessibility."

"If the product doesn’t allow people to override decisions or control their data, it’s likely disempowering."

"Collaborative conversations and diverse co-creation help catch blind spots and biases in design."

"We have to ask before building something new: what could possibly go wrong?"

Ask the Rosenbot
John Calhoun
Bring your DesignOps Story to Life! The Definitive DesignOps Book Jam
2023 • DesignOps Summit 2023
Gold
John Mortimer
Panel Discussion
2024 • Advancing Service Design 2024
Gold
Bria Alexander
Opening Remarks Day 2
2024 • Advancing Research 2024
Gold
Billy Carlson
Ideation tips for Product Managers
2022 • Design in Product 2022
Gold
Gregg Bernstein
Opportunistic Research with Gregg Bernstein (Videoconference)
2019 • Advancing Research Community
Christian Crumlish
AMA with Christian Crumlish, author of Product Management for UX People (Videoconference)
2022 • Enterprise Community
Harry Max
Prioritization for Leaders (2nd of 3 seminars) (Videoconference)
2024 • Rosenfeld Community
Matt LeMay
You Don’t “Get” Anyone to Do Anything
2022 • Design in Product 2022
Gold
Dave Hora
A Research Skills Evolution
2021 • Advancing Research 2021
Gold
Saara Kamppari-Miller
Key Metrics: Comparing Three Letter Acronym Metrics That Include the Word “Key”
2024 • DesignOps Community
What DesignOps Can Learn From DevOps
2017 • DesignOps Summit 2017
Gold
Victor Udoewa
Radical Participatory Research: Decolonizing Participatory Processes
2022 • Advancing Research 2022
Gold
Megan Kierstead
You Are a Badass at UX: Overcoming Imposter Syndrome
2021 • Advancing Research 2021
Gold
Magdalena Zadara
Zero Hour: How to Get Far Quickly When Starting Your Digital Service Unit Late
2022 • Civic Design 2022
Gold
Kristin Skinner
Theme 2: Introduction and Provocation
2024 • DesignOps Summit 2020
Gold
Louis Rosenfeld
Becoming a Civic Designer: Making the Move from Private to Public Sector
2022 • Civic Design 2022
Gold

More Videos

Alex Hurworth

"Policies must evolve to reflect the urgency of our situation."

Alex Hurworth Bonnie John Fahd Arshad Antoine Marin

Designing a Contact Tracing App for Universal Access

October 23, 2020

Laine Riley Prokay

"These brand new practitioners can bring fresh perspectives and new ways of thinking to hopefully see current problems in a new light."

Laine Riley Prokay Lisa Gordon

Carving a Path for Early Career DesignOps Practitioners

September 9, 2022

Eniola Oluwole

"Launching a design system is not a sprint, there’s no end, it’s always a continuous process."

Eniola Oluwole

Lessons From the DesignOps Journey of the World's Largest Travel Site

October 24, 2019

Nathan Shedroff

"The most important value delivered to customers is always the qualitative value—the emotional and experiential impact."

Nathan Shedroff

Double Your Mileage: Use Your Research Strategically

March 31, 2020

Sam Proulx

"Apple premiered mobile accessibility in a very exciting way with the iPhone 3GS and VoiceOver announcement at WWDC."

Sam Proulx

Mobile Accessibility: Why Moving Accessibility Beyond the Desktop is Critical in a Mobile-first World

November 17, 2022

Feleesha Sterling

"Rapid research is a flexible framework for quickly executing UX research for fast and often tactical or evaluative design decisions."

Feleesha Sterling

Building a Rapid Research Program (Videoconference)

May 18, 2023

Neil Barrie

"You have the power, like Navy Seals of user research, to influence the biggest issues of our time, one interaction at a time."

Neil Barrie

Widening the Aperture: The Case for Taking a Broader Lens to the Dialogue between Products and Culture

March 25, 2024

John Devanney

"Knowledge management isn’t just about preserving work, it’s about retaining motivated, growing people."

John Devanney

The Design Management Office

November 6, 2017

Katy Mogal

"We decided to jump off the wall — it was scary but the opportunity was too big to pass up."

Katy Mogal

But Do Your Insights Scale?

March 12, 2021