Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Dark Metrics: Illuminating the Negative Impact of Digital Health Design
Gold
Friday, March 12, 2021 • Advancing Research 2021
Share the love for this talk
Dark Metrics: Illuminating the Negative Impact of Digital Health Design
Speakers: Raven Veal
Link:

Summary

Traditional design metrics and KPIs are often geared towards measuring product success. Dark metrics challenge this paradigm by proactively measuring the unintended yet harmful psychological, social, and physical effects of our technologies. The examples within digital health are plentiful. From accelerating burnout among clinicians to widening racial disparities in quality of care, we can only reach the height of our most courageous solutions when we expose our deepest failures.

Key Insights

  • Traditional product metrics often ignore the broader individual and societal impacts of digital health technologies.

  • Dark Metrics is a framework focusing on measuring disempowerment, exclusion, addiction, and distraction caused by health tech.

  • Disempowerment occurs when technology undermines user autonomy, especially in sensitive healthcare decision-making.

  • Racial bias in AI can manifest indirectly, as in algorithms using proxies like healthcare costs that perpetuate inequities.

  • Co-creating design solutions with diverse voices is critical to proactively identifying unintended consequences.

  • Measuring unhealthy engagement requires going beyond 'engagement' metrics to include wellbeing indicators like stress or eye strain.

  • Distraction from clinical tools (e.g., EMRs) can reduce quality of care by pulling medical professionals away from patient interaction.

  • Embedding racial equity rubrics into the design process helps ensure inclusive user experiences beyond just product visuals.

  • Augmented intelligence should support, not replace, human decision-making especially in healthcare.

  • Early, collaborative risk ideation exercises like 'premortems' are recommended to anticipate potential harms before launch.

Notable Quotes

"Traditional product metrics focus narrowly on the product itself, missing what success means for the people using our technologies."

"Our tools are meant to support and enhance, not to take over — we call this augmented intelligence at IBM Watson."

"An algorithm that doesn’t explicitly use race but uses healthcare costs as a proxy can perpetuate racial discrimination."

"Exclusion doesn’t have to be explicit — you just have to be indifferent to it."

"The difference between technology and slavery is that slaves are fully aware they are not free."

"Doctors don’t want to be on a machine all day; they want to help people."

"Designing for people means acknowledging where we might be exclusionary and embedding equity like accessibility."

"If the product doesn’t allow people to override decisions or control their data, it’s likely disempowering."

"Collaborative conversations and diverse co-creation help catch blind spots and biases in design."

"We have to ask before building something new: what could possibly go wrong?"

Michaela Mora
Advanced Concept Testing Approaches To Guide Product Development and Business Decisions
2022 • Advancing Research 2022
Gold
Melinda Belcher
Bridging the Gap: Making the Most of the Differences Between Agency and Enterprise
2024 • Enterprise Experience 2020
Gold
Elizabeth Churchill
Exploring Cadence: You, Your Team, and Your Enterprise
2017 • Enterprise Experience 2017
Gold
Patrizia Bertini
DesignOps + KPIs = Measure your Impact!
2024 • DesignOps Summit 2020
Gold
Zen Ren
Taking Inspiration from Instructional Design for Research
2022 • Advancing Research 2022
Gold
Shazia Ali
Communication: Innovative techniques for making your voice heard [Advancing Research Community Workshop Series]
2024 • Advancing Research Community
Alla Weinberg
Healing Toxic Stress
2024 • DesignOps 2024
Gold
Savannah Carlin
[Case Study] Don't botch the bot: Designing interactions for AI
2024 • Designing with AI 2024
Gold
Hana Nagel
Turning Research Ripples into Waves
2018 • DesignOps Summit 2018
Gold
Chris Geison
What's Next for Research? (Videoconference)
2021 • Advancing Research Community
Christian Madsbjerg
Influencing Strategy
2020 • Advancing Research 2020
Gold
Jorge Arango
The Best of Both Worlds: How to Integrate Paper and Digital Notes (1st of 3 seminars) (Videoconference)
2024 • Rosenfeld Community
B. Pagels-Minor
Breaking the Tension: The Power of Enabling Your Employees to Show Up Authentically
2022 • Design at Scale 2022
Gold
World Usability Day Panel Discussion (Videoconference)
2022 • DesignOps Community
William Newton
How to Lead With Data, and Without Data
2023 • Enterprise UX 2023
Gold
Ana Ferreira
Designing Distributed: Leading Doist’s Fully Remote Design Team in Six Countries
2024 • DesignOps Summit 2020
Gold

More Videos

Bria Alexander

"We’re using Slack as the heart and soul of this conference — it's where the party is."

Bria Alexander Louis Rosenfeld

Welcome

September 8, 2022

Mike Oren

"I helped a company save 12 million dollars by not investing in an iris scanner after just one week of research."

Mike Oren

Why Pharmaceutical's Research Model Should Replace Design Thinking

March 28, 2023

Jodi Forlizzi

"AI ethics teams at Facebook and small companies will look very different; there’s no one size fits all approach."

Jodi Forlizzi

Design and AI innovation

June 5, 2024

Bria Alexander

"The digital swag bag is one of the really cool parts about any conference. Don’t miss out on the awesome offers."

Bria Alexander

Opening Remarks

October 3, 2023

Michael Weir

"Changes to a website nobody sees won’t move the needle; focus on high traffic and drop-off areas first."

Michael Weir

Mixed Methods and Behavioural Science (Videoconference)

May 26, 2023

Molly Fargotstein

"Marketing what UX research does creates advocates and makes the company smarter by customer insights."

Molly Fargotstein

Multipurpose Communication & UX Research Marketing (Videoconference)

September 12, 2019

Verónica Urzúa

"There are many ways to be a good researcher; Latin researchers should create our standards and fight for them."

Verónica Urzúa Jorge Montiel

The B-side of the Research Impact

March 12, 2021

Husani Oakley

"You can’t collaborate without or communicate upfront shared context."

Husani Oakley

Theme Two Intro

June 6, 2023

George Abraham

"Changing branding and different aspects of the design system should be possible with very quick and easy interactions."

George Abraham Stefan Ivanov

Design Systems To-Go: Reimagining Developer Handoff, and Introducing App Builder (Part 2)

October 1, 2021