Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Dark Metrics: Illuminating the Negative Impact of Digital Health Design
Gold
Friday, March 12, 2021 • Advancing Research 2021
Share the love for this talk
Dark Metrics: Illuminating the Negative Impact of Digital Health Design
Speakers: Raven Veal
Link:

Summary

Traditional design metrics and KPIs are often geared towards measuring product success. Dark metrics challenge this paradigm by proactively measuring the unintended yet harmful psychological, social, and physical effects of our technologies. The examples within digital health are plentiful. From accelerating burnout among clinicians to widening racial disparities in quality of care, we can only reach the height of our most courageous solutions when we expose our deepest failures.

Key Insights

  • Traditional product metrics often ignore the broader individual and societal impacts of digital health technologies.

  • Dark Metrics is a framework focusing on measuring disempowerment, exclusion, addiction, and distraction caused by health tech.

  • Disempowerment occurs when technology undermines user autonomy, especially in sensitive healthcare decision-making.

  • Racial bias in AI can manifest indirectly, as in algorithms using proxies like healthcare costs that perpetuate inequities.

  • Co-creating design solutions with diverse voices is critical to proactively identifying unintended consequences.

  • Measuring unhealthy engagement requires going beyond 'engagement' metrics to include wellbeing indicators like stress or eye strain.

  • Distraction from clinical tools (e.g., EMRs) can reduce quality of care by pulling medical professionals away from patient interaction.

  • Embedding racial equity rubrics into the design process helps ensure inclusive user experiences beyond just product visuals.

  • Augmented intelligence should support, not replace, human decision-making especially in healthcare.

  • Early, collaborative risk ideation exercises like 'premortems' are recommended to anticipate potential harms before launch.

Notable Quotes

"Traditional product metrics focus narrowly on the product itself, missing what success means for the people using our technologies."

"Our tools are meant to support and enhance, not to take over — we call this augmented intelligence at IBM Watson."

"An algorithm that doesn’t explicitly use race but uses healthcare costs as a proxy can perpetuate racial discrimination."

"Exclusion doesn’t have to be explicit — you just have to be indifferent to it."

"The difference between technology and slavery is that slaves are fully aware they are not free."

"Doctors don’t want to be on a machine all day; they want to help people."

"Designing for people means acknowledging where we might be exclusionary and embedding equity like accessibility."

"If the product doesn’t allow people to override decisions or control their data, it’s likely disempowering."

"Collaborative conversations and diverse co-creation help catch blind spots and biases in design."

"We have to ask before building something new: what could possibly go wrong?"

Ask the Rosenbot
Dorelle Rabinowitz
The Magic Word is Trust
2018 • Enterprise Experience 2018
Gold
Jennifer Kanyamibwa
Creating the Blueprint: Growing and Building Design Teams
2018 • DesignOps Summit 2018
Gold
Sarah Williams
Verizon_A Framework for CX Transformation
2024 • Design at Scale 2021
Gold
Davis Neable
How to Drive a Design Project When you Don’t Have a Design Team
2021 • Design at Scale 2021
Gold
Bria Alexander
Theme 1 Intro
2024 • DesignOps 2024
Gold
Aurobinda Pradhan
Introduction to Collaborative DesignOps using Cubyts
2022 • DesignOps Summit 2022
Gold
Christian Crumlish
Introduction by our Conference Chair
2022 • Design in Product 2022
Gold
Steve Portigal
Discussion
2015 • Enterprise UX 2015
Gold
Catherine Courage
The Enterprise UX Journey: Lessons From the Voyage & The Opportunity Ahead
2015 • Enterprise UX 2015
Gold
Samuel Proulx
Invisible barriers: Why accessible service design can’t be an afterthought
2024 • Advancing Service Design 2024
Gold
Silke Bochat
5 Antifragile Strategies for a DesignOps 2.0
2024 • DesignOps 2024
Gold
Deanna Smith
Leading Change with Confidence: Strategies for Optimizing Your Process
2024 • DesignOps 2024
Gold
Etienne Fang
The Power of Care: From Human-Centered Research to Humanity-Centered Leadership
2021 • Advancing Research 2021
Gold
Dr. Jamika D. Burge
Broad Strokes: Connecting Design, Research, and AI to the World Around Us
2023 • Enterprise UX 2023
Gold
Marissa Cui
Climate Design Product Showcase (Videoconference)
2024 • Climate UX Interest Group (Rosenfeld Community)
Amy Jiménez Márquez
The Atypical UX Manager Path (Videoconference)
2020 • Enterprise Community

More Videos

Catt Small

"I think there isn’t one linear path and sometimes you face career stumbles but you need to get back up and find momentum."

Catt Small Micah Bennett Brian Carr Jessica Harllee

What's Next for ICs: Exploring Staff and Principal Designer Roles (Videoconference)

February 22, 2024

Jennifer Kong

"Employees were graded on note quality, and their scores declined by about 10% after using the AI tool, impacting morale."

Jennifer Kong

[Case study] Journeying toward AI-assisted documentation in healthcare

June 5, 2024

Sara Logel

"Storytelling leads to better understanding and recall of key points at a later date."

Sara Logel

Your Colleagues are Your Users Too

March 29, 2023

Veevi Rosenstein

"Our UX research team leveraged detailed analyses to create Zendesk’s first set of role-based profiles as a foundation for user personas."

Veevi Rosenstein

Building for Scale: Creating the Zendesk UX Research Practice

January 8, 2024

Michelle Bejian Lotia

"Once we put all these insights into the repository, things we already have get so much more value."

Michelle Bejian Lotia Anne-Marie Morell

Rolling Out a Repository: How Zapier Centralizes Insights from Across their Organization

March 28, 2023

Tutti Taygerly

"Labeling someone difficult is dangerous; challenge your feelings, the facts, and your interpretations first."

Tutti Taygerly

Videconference: How to Work with Difficult People with Tutti Taygerly

June 25, 2020

Patrick Commarford

"We automated our staffing records and updated our staffing score weekly, watching it grow from 44 to nearly 80."

Patrick Commarford

Design Staffing for Impact

January 8, 2024

Frances Yllana

"How might we humanize how and what we measure and recognize as impact?"

Frances Yllana

Theme 2 Intro

September 24, 2024

Mujtaba Hameed

"The eye is an extension of the brain; processing visuals fires new neurons and helps you think differently."

Mujtaba Hameed

Frameworks for Excellence: Using Visual Thinking and Communication to Elevate Your Research

March 26, 2024