Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Survival Metrics – Making Change in a Fast, Data-Informed, and Politically Safe Way
Gold
Tuesday, December 6, 2022 • Design in Product 2022
Share the love for this talk
Survival Metrics – Making Change in a Fast, Data-Informed, and Politically Safe Way
Speakers: Adam Thomas
Link:

Summary

When teams don’t know how to pivot, the resulting waste can lead to a slow down in product delivery. Unfortunately, such confusion occurs commonly in UX/Product teams where roles can blur, and overlap between responsibilities can be rampant. In this session, product expert Adam Thomas introduces the concept of “Survival Metrics” — an approach to team collaboration that not only encourages healthy pivots, but puts in place the mechanisms to achieve them. Stick around to join the conversation and ask Adam your questions during our post-session Q+A, moderated by Christian Crumlish.

Key Insights

  • 60 to 90% of product ideas fail to improve their intended metrics, illustrating the need to stop defaulting to 'go'.

  • Good strategy involves clear diagnosis, guiding policy with identity, and coherent action to address challenges effectively.

  • Repeated incongruence—leveraging competing incentives—helps teams adjust strategies by surfacing disagreements and truth.

  • Building political safety through trust—recognizing excellence, inducing stress, sharing info, and showing vulnerability—is key for decisions.

  • Data-informed decision making balances qualitative insight and quantitative data, avoiding data-driven pitfalls like the Challenger disaster.

  • Survival metrics are time-bound, contextualized, and tied to decision points, enabling teams to stop, pivot, or invest as needed.

  • Avoid sunk cost fallacy by cultivating repetition and muscle for re-diagnosis, adjusting guiding policies, and coherent actions.

  • Feature roadmaps and strict delivery dates erode trust due to noise buildup; decision journals and retrospectives improve transparency.

  • Anti-fragile organizations benefit from stress and shocks by avoiding technical, UX, and political debt through early small stress tests.

  • Storytelling frameworks like ABT (And, But, Therefore) enhance communication by framing strategy around problems, actions, and villains.

Notable Quotes

"60 to 90% of our ideas do not improve the metrics they were intended to improve."

"A good strategy honestly acknowledges the challenges being faced and provides an approach to overcoming them."

"Everyone has a plan until they get punched in the mouth, but a plan is an anchor for pivoting and changing direction."

"Feature roadmaps are bad because coherent actions start to become noise over time in complex environments."

"Being data informed is not being data driven; the Challenger exploded because people wanted more data but ignored qualified gut."

"We want to trust the data that comes in but we do not necessarily care who gives it to us — privacy over secrecy."

"Stop means a bright line is crossed, so there is no wiggle room; pivot means iterating based on new information."

"Burn down theater is when a team shows ticket progress but has made no real decisions in months."

"Antifragility is creating an organization that benefits from shocks, randomness, disorder, and stressors."

"We live in organizations like organisms; find analogies that your company understands and build your communication around them."

Jonathon Colman
How to Maximize the Impact of Content Design
2024 • DesignOps Summit 2020
Gold
Alison Rand
Scaling Impact with Service Design (Videoconference)
2021 • DesignOps Community
Sam Proulx
SUS: A System Unusable for Twenty Percent of the Population
2021 • Civic Design 2021
Gold
Jamie Beck Alexander
How can you find your role in climate? (Videoconference)
2024 • Climate UX Interest Group (Rosenfeld Community)
Emily Eagle
Can't Rewind: Radio and Retail
2019 • Enterprise Experience 2019
Gold
How to Identify and Increase your "Experience Quotient"
2018 • Enterprise Experience 2018
Gold
John Calhoun
Meters, Miles, and Madness: New Frameworks to Measure the (Elusive) Value of DesignOps
2024 • DesignOps 2024
Gold
Craig Villamor
Design Systems for Ethical Design (Videoconference)
2023 • Enterprise Community
Erik Flowers
Introduction to MURAL for UX
2021 • Design at Scale 2021
Gold
Saara Kamppari-Miller
Theme Three Intro
2022 • DesignOps Summit 2022
Gold
Robin Beers
Research as a Catalyst for Organizational Transformation
2021 • Advancing Research 2021
Gold
Jeff Ephraim Bander
Eye Tracking Gamechanger: Why Smartphone Eye Tracking will Revolutionize Your UX Research
2022 • Advancing Research 2022
Gold
Anna Avrekh
Diversity In and For Design: Building Conscious Diversity in Design and Research
2021 • Design at Scale 2021
Gold
Anna Avrekh
Expert Panel: Leading in and with Research
2022 • Advancing Research 2022
Gold
Jennifer Kong
[Case study] Journeying toward AI-assisted documentation in healthcare
2024 • Designing with AI 2024
Gold
Luz Bratcher
This Is a Talk for Tired People
2022 • Design at Scale 2022
Gold

More Videos

Monty Hammontree

"UX research needed to be a team sport involving all disciplines rather than the few learning on behalf of the many."

Monty Hammontree

The Future of UX Research (Videoconference)

December 3, 2020

Liz Ebengo

"Hope is not passive; it is proactive and must be facilitated carefully, especially where optimism is scarce."

Liz Ebengo

The Burden on Children: The Cost of Insufficient Post-Conflict Services and Pathways Forward

December 4, 2024

Billy Carlson

"Wireframes plus a little bit of storytelling is awesome."

Billy Carlson

Tips to Utilize Wireframes to Tell an Effective Product Story

June 6, 2023

Saara Kamppari-Miller

"Don’t be ideal, do better — the ideal will always be out of reach, but we should strive towards it regardless."

Saara Kamppari-Miller

Inclusive Design is DesignOps

September 29, 2021

Ian Swinson

"Communication is mundane but key: sending an email full of mistakes to an executive changes their entire impression of you."

Ian Swinson

Designing and Driving UX Careers

June 8, 2016

Jonathon Colman

"The biggest drain on motivation is unfulfilled potential combined with being blocked from living up to it."

Jonathon Colman

How to Maximize the Impact of Content Design

January 8, 2024

Maria Skaaden

"One eye on the horizon and the other on the next wave—that's the perspective product teams need to deliver quality digital products."

Maria Skaaden

Continuous Design: One eye on the horizon and the other on the next wave

November 8, 2018

Bryce Benton

"Public data has a life of its own; it’s sometimes one thing and sometimes another depending on context and display."

Bryce Benton

[Demo] AI-powered UX enhancement: Aligning GitHub documentation with USWDS at Austin Public Library

June 4, 2024

Marc Fonteijn

"We do not take cost of living, inflation, or taxes into account, so it’s your homework to contextualize the salary data."

Marc Fonteijn

First Insights from the 2025 Service Design Salary(+) Report

December 4, 2024