Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Survival Metrics – Making Change in a Fast, Data-Informed, and Politically Safe Way

Gold
Tuesday, December 6, 2022 • Design in Product 2022
Share the love for this talk
Survival Metrics – Making Change in a Fast, Data-Informed, and Politically Safe Way
Speakers: Adam Thomas
Link:

Summary

When teams don’t know how to pivot, the resulting waste can lead to a slow down in product delivery. Unfortunately, such confusion occurs commonly in UX/Product teams where roles can blur, and overlap between responsibilities can be rampant. In this session, product expert Adam Thomas introduces the concept of “Survival Metrics” — an approach to team collaboration that not only encourages healthy pivots, but puts in place the mechanisms to achieve them. Stick around to join the conversation and ask Adam your questions during our post-session Q+A, moderated by Christian Crumlish.

Key Insights

  • 60-90% of product ideas do not improve intended metrics, causing waste and burnout.

  • Steve Jobs’ reality distortion field exemplifies pushing forward without feedback, which can lead to failure in today’s environment.

  • Good strategy consists of diagnosis of the problem, a clear guiding policy, and coherent actions aligned to it.

  • Repeated incongruence—continuously reassessing incentives and data—strengthens decision-making muscles vital for pivots.

  • Building trust through recognition, challenge stress, discretion, and vulnerability is key to politically safe change.

  • Moving fast requires limiting options through predefined language and focusing on reversible, coin-flip decisions.

  • Being data-informed means using data to inform decisions, not blindly driving them; ignoring gut and context can be fatal (e.g., Challenger disaster).

  • Sensing metrics are time-bound, contextual, tied to decisions, and linked back to strategy—unlike traditional feature-focused roadmaps.

  • Stopping, pivoting, and investing early are essential decisions teams must iterate on to avoid sunk cost fallacy.

  • A clear story anchored in company culture with a villain (problem) helps communicate strategy and build trust for decision-making.

Notable Quotes

"60 to 90% of our ideas do not improve the metrics they were intended to improve."

"Everyone has a plan until they get punched in the mouth, said Mike Tyson."

"Feature roadmaps are bad because over time coherent actions become noise."

"Being data informed is not data driven—blindly following data can kill you, like the Challenger explosion."

"Stop, pivot, or invest early—these are the survival metric decisions that save companies."

"Trust is built by recognizing excellence, inducing challenge stress, giving discretion, and showing vulnerability."

"Most decisions are coin flip decisions—easily reversible and should be treated as defaults."

"You have to ask, what are we deciding, and what are we quitting, on a regular basis."

"If you’re not investing or quitting something, what is the point of having a strategy?"

"Repetition, representation, and association are the keys to great theater and great product development."

Ask the Rosenbot
Matt Webb
Context Window: Five Futures for AI
2025 • Designing with AI 2025
Gold
Dr. Jamika D. Burge
Theme 3 Intro
2022 • Advancing Research 2022
Gold
Zen Ren
Taking Inspiration from Instructional Design for Research
2022 • Advancing Research 2022
Gold
Jon Fukuda
The Big Question about Innovation: A Panel Discussion
2024 • DesignOps Summit 2024
Gold
Dem Gerolemou
Climate technology fundamentals
2024 • Climate UX Interest Group
Ash Brown
Silver Linings: What DesignOps Learned in the Shift to WFH
2020 • DesignOps Summit 2020
Gold
Sam Proulx
Online Shopping: Designing an Accessible Experience
2023 • DesignOps Summit 2023
Gold
Maria Giudice
Remaking the Making Company: Moving from Product to Experience
2016 • Enterprise UX 2016
Gold
Steve Baty
Discussion
2016 • Enterprise UX 2016
Gold
Louis Rosenfeld
How AI will Change DesignOps Tooling
2023 • DesignOps Summit 2023
Gold
Nova Wehman-Brown
We've Never Done This Before
2019 • Enterprise Experience 2019
Gold
Mark Boulton
Ops without Designers
2018 • DesignOps Summit 2018
Gold
Christian Crumlish
Introduction by our Conference Chair
2022 • Design in Product 2022
Gold
Erin Weigel
UX Lessons from running more than 1,200 A/B Tests
2024 • Rosenfeld Community
Kate Kalcevich
Designing inclusively with AI
2024 • Designing with AI 2024
Gold
Bria Alexander
Theme Two Intro
2023 • DesignOps Summit 2023
Gold

More Videos

Taylor Jennings

"Setting up a repository as a team of one or two is actually the prime time to establish processes like that."

Taylor Jennings Joe Nelson Alex Knoll

Repository Retrospective: Learnings from Introducing a Central Place for UX Research

March 9, 2022

Nicole Aleong

"Anticipation involves preparatory actions to manage uncertainty about future conditions."

Nicole Aleong

Future Orientations to Everyday Life: Futures Anthropology as a Methodology

March 26, 2024

Jeff Gothelf

"The innovation studio bakes in strategic vision, leadership, funding, and ownership."

Jeff Gothelf

Innovation Studios: the Engines of Enterprise Experimentation

May 14, 2015

Saara Kamppari-Miller

"Meeting designers where they spend their time, like integrating accessibility plugins into Figma, is the most effective way to make progress."

Saara Kamppari-Miller

DesignOps for Inclusive Design and Accessibility

May 26, 2022

Tess Dixon

"Creating moments of joy in the day can encourage positive behaviors and brighten people’s days."

Tess Dixon

C'mon Get Happy

September 29, 2021

Liam Thurston

"All your team wants to do is win at career Bingo or career Snakes and Ladders, hopefully more ladders."

Liam Thurston

Why Your Design Team Is Quitting, And How To Fix It

June 10, 2022

Ian Swinson

"It’s huge to have a framework so managers and employees speak the same language around skills and growth."

Ian Swinson

Designing and Driving UX Careers

June 8, 2016

Leisa Reichelt

"At DTA, distributed teams and lack of local diversity meant everyone was out in the field a lot to get diverse input."

Leisa Reichelt

Opening Keynote: Operating in Context

November 7, 2018

Rachael Greene

"Without a design ops function, teams make their own flavors that dilute brand and accessibility."

Rachael Greene Alison Davis

Building a Design Ops Practice that Really Works (Most of the Time)

October 2, 2025