Summary
Traditional design metrics and KPIs are often geared towards measuring product success. Dark metrics challenge this paradigm by proactively measuring the unintended yet harmful psychological, social, and physical effects of our technologies. The examples within digital health are plentiful. From accelerating burnout among clinicians to widening racial disparities in quality of care, we can only reach the height of our most courageous solutions when we expose our deepest failures.
Key Insights
-
•
Traditional product metrics often ignore the broader individual and societal impacts of digital health technologies.
-
•
Dark Metrics is a framework focusing on measuring disempowerment, exclusion, addiction, and distraction caused by health tech.
-
•
Disempowerment occurs when technology undermines user autonomy, especially in sensitive healthcare decision-making.
-
•
Racial bias in AI can manifest indirectly, as in algorithms using proxies like healthcare costs that perpetuate inequities.
-
•
Co-creating design solutions with diverse voices is critical to proactively identifying unintended consequences.
-
•
Measuring unhealthy engagement requires going beyond 'engagement' metrics to include wellbeing indicators like stress or eye strain.
-
•
Distraction from clinical tools (e.g., EMRs) can reduce quality of care by pulling medical professionals away from patient interaction.
-
•
Embedding racial equity rubrics into the design process helps ensure inclusive user experiences beyond just product visuals.
-
•
Augmented intelligence should support, not replace, human decision-making especially in healthcare.
-
•
Early, collaborative risk ideation exercises like 'premortems' are recommended to anticipate potential harms before launch.
Notable Quotes
"Traditional product metrics focus narrowly on the product itself, missing what success means for the people using our technologies."
"Our tools are meant to support and enhance, not to take over — we call this augmented intelligence at IBM Watson."
"An algorithm that doesn’t explicitly use race but uses healthcare costs as a proxy can perpetuate racial discrimination."
"Exclusion doesn’t have to be explicit — you just have to be indifferent to it."
"The difference between technology and slavery is that slaves are fully aware they are not free."
"Doctors don’t want to be on a machine all day; they want to help people."
"Designing for people means acknowledging where we might be exclusionary and embedding equity like accessibility."
"If the product doesn’t allow people to override decisions or control their data, it’s likely disempowering."
"Collaborative conversations and diverse co-creation help catch blind spots and biases in design."
"We have to ask before building something new: what could possibly go wrong?"
Or choose a question:
More Videos
"The program is built to last until 2025 and 2030, not just to deliver short-term outcomes."
Marc Rettig Julie Baher Phil Gilbert Nathan ShedroffDiscussion
May 14, 2015
"Physiological signals like heart rate and pupil dilation are noisy for day-to-day software usage and not practical for measuring delight."
Discussion
June 9, 2017
"By owning your positionality and specificity, you open yourself to diasporic experiences and deeper conversations."
Florence OkoyeAfroFuturism and UX Research
March 27, 2023
"How do we scale our processes, maximize efficiency and quality, and keep the experience from getting disjointed as teams multiply?"
Jemma AhmedTheme 2 Intro
January 8, 2024
"Spending time with 300 data analysts helped designers understand their workflow so they could build a product that accelerates insight delivery."
Chris ChapoData Science and Design: A Tale of Two Tribes
May 13, 2015
"If something is only visible via hover, it needs to be visible to the screen reader at all times or have an alternative."
Sam ProulxDesigning For Screen Readers: Understanding the Mental Models and Techniques of Real Users
December 10, 2021
"Knowing in action is the intuition that designers like to refer to as the core of artistry."
Yoel SumitroActions and Reflections: Bridging the Skills Gap among Researchers
March 9, 2022
"Using assistive technology is a skill, not something you can just pick up and be effective with."
Sam ProulxUnderstanding Screen Readers on Mobile: How And Why to Learn from Native Users
October 2, 2023
"Boards keep bringing people they trust—a self-fulfilling prophecy aging the board makeup."
Iram ShahClosing Keynote: The View from the Top
June 4, 2019