Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Dark Metrics: Illuminating the Negative Impact of Digital Health Design
Gold
Friday, March 12, 2021 • Advancing Research 2021
Share the love for this talk
Dark Metrics: Illuminating the Negative Impact of Digital Health Design
Speakers: Raven Veal
Link:

Summary

Traditional design metrics and KPIs are often geared towards measuring product success. Dark metrics challenge this paradigm by proactively measuring the unintended yet harmful psychological, social, and physical effects of our technologies. The examples within digital health are plentiful. From accelerating burnout among clinicians to widening racial disparities in quality of care, we can only reach the height of our most courageous solutions when we expose our deepest failures.

Key Insights

  • Traditional product metrics often ignore the broader individual and societal impacts of digital health technologies.

  • Dark Metrics is a framework focusing on measuring disempowerment, exclusion, addiction, and distraction caused by health tech.

  • Disempowerment occurs when technology undermines user autonomy, especially in sensitive healthcare decision-making.

  • Racial bias in AI can manifest indirectly, as in algorithms using proxies like healthcare costs that perpetuate inequities.

  • Co-creating design solutions with diverse voices is critical to proactively identifying unintended consequences.

  • Measuring unhealthy engagement requires going beyond 'engagement' metrics to include wellbeing indicators like stress or eye strain.

  • Distraction from clinical tools (e.g., EMRs) can reduce quality of care by pulling medical professionals away from patient interaction.

  • Embedding racial equity rubrics into the design process helps ensure inclusive user experiences beyond just product visuals.

  • Augmented intelligence should support, not replace, human decision-making especially in healthcare.

  • Early, collaborative risk ideation exercises like 'premortems' are recommended to anticipate potential harms before launch.

Notable Quotes

"Traditional product metrics focus narrowly on the product itself, missing what success means for the people using our technologies."

"Our tools are meant to support and enhance, not to take over — we call this augmented intelligence at IBM Watson."

"An algorithm that doesn’t explicitly use race but uses healthcare costs as a proxy can perpetuate racial discrimination."

"Exclusion doesn’t have to be explicit — you just have to be indifferent to it."

"The difference between technology and slavery is that slaves are fully aware they are not free."

"Doctors don’t want to be on a machine all day; they want to help people."

"Designing for people means acknowledging where we might be exclusionary and embedding equity like accessibility."

"If the product doesn’t allow people to override decisions or control their data, it’s likely disempowering."

"Collaborative conversations and diverse co-creation help catch blind spots and biases in design."

"We have to ask before building something new: what could possibly go wrong?"

Ask the Rosenbot
Joanna Vodopivec
One Research Team for All - Influence Without Authority
2022 • Advancing Research 2022
Gold
Sam Proulx
Accessibility: An Opportunity to Innovate
2022 • DesignOps Summit 2022
Gold
Sarah Fathallah
Lessening the Research Burden on Vulnerable Communities
2020 • Advancing Research 2020
Gold
Rima Campbell
Increase Productivity and Drive Business Impact
2024 • DesignOps 2024
Gold
Jennifer Bolduc
What's involved with getting people back to work?: A panel discussion (Videoconference)
2021 • DesignOps Community
Jackie Ho
Lead Effectively While Preserving Team Autonomy with Growth Boards
2024 • Enterprise Experience 2020
Gold
Ellen Chisa
The Values of Design
2023 • Design in Product 2023
Gold
Erik Flowers
Introduction to MURAL for UX
2021 • Design at Scale 2021
Gold
George Zhang
UX Research Excellence Framework
2021 • Advancing Research 2021
Gold
Luke Roberts
Panel Discussion
2024 • Advancing Service Design 2024
Gold
Lin Nie
When Thought-worlds Collide: Collaborating Between Research and Practice
2021 • Advancing Research 2021
Gold
Lona Moore
Scaling Design Beyond Designers
2021 • Design at Scale 2021
Gold
Michelle Bejian Lotia
Rolling Out a Repository: How Zapier Centralizes Insights from Across their Organization
2023 • Advancing Research 2023
Gold
Sylvie Abookire
A Civic Designer's Guide to Mindful Conflict Navigation
2022 • Civic Design 2022
Gold
Nicole Aleong
Future Orientations to Everyday Life: Futures Anthropology as a Methodology
2024 • Advancing Research 2024
Gold
Veevi Rosenstein
Building for Scale: Creating the Zendesk UX Research Practice
2024 • Enterprise Experience 2020
Gold

More Videos

Zariah Cameron

"A kickback is a free flowing and life giving gathering that transforms and electrifies throughout the night."

Zariah Cameron

ReDesigning Wellbeing for Equitable Care in the Workplace

September 23, 2024

John Cutler

"Ownership means belonging to the person who anticipates, observes, or monitors the prioritization process—not distributed ownership."

John Cutler Harry Max

Prioritization for designers and product managers (1st of 3 seminars) (Videoconference)

June 13, 2024

Nick Cochran

"Sense-making is a motivated, continuous effort to understand connections and act effectively."

Nick Cochran

Growing in Enterprise Design through Making Connections

June 3, 2019

Deanna Smith

"Set measurable goals connected to the specific problem to track if a change is effective."

Deanna Smith

Leading Change with Confidence: Strategies for Optimizing Your Process

September 23, 2024

Magdalena Zadara

"The digital identity card is an existing asset that we didn’t have to reinvent, but the user experience on top was lacking."

Magdalena Zadara

Zero Hour: How to Get Far Quickly When Starting Your Digital Service Unit Late

November 16, 2022

Nova Wehman-Brown

"We asked people to step out of their comfort zones and do things they'd never done before."

Nova Wehman-Brown

We've Never Done This Before

June 4, 2019

Liwei Dai

"We human researchers can help go way beyond proxy metrics such as button clicks and provide true validation of model accuracy."

Liwei Dai

The Heart and Brain of the AI Research

March 31, 2020

Gordon Ross

"The arrival of workers during COVID lockdown meant coordinating across government ministries, airport authority, federal border services and public health – this was a design problem."

Gordon Ross

12 Months of COVID-19 Design and Digital Response with the British Columbia Government

December 8, 2021

Tutti Taygerly

"People will forget what you said, people will forget what you did, but people will never forget how you made them feel."

Tutti Taygerly

Make Space to Lead

June 12, 2021