Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Survival Metrics – Making Change in a Fast, Data-Informed, and Politically Safe Way
Gold
Tuesday, December 6, 2022 • Design in Product 2022
Share the love for this talk
Survival Metrics – Making Change in a Fast, Data-Informed, and Politically Safe Way
Speakers: Adam Thomas
Link:

Summary

When teams don’t know how to pivot, the resulting waste can lead to a slow down in product delivery. Unfortunately, such confusion occurs commonly in UX/Product teams where roles can blur, and overlap between responsibilities can be rampant. In this session, product expert Adam Thomas introduces the concept of “Survival Metrics” — an approach to team collaboration that not only encourages healthy pivots, but puts in place the mechanisms to achieve them. Stick around to join the conversation and ask Adam your questions during our post-session Q+A, moderated by Christian Crumlish.

Key Insights

  • 60 to 90% of product ideas fail to improve their intended metrics, illustrating the need to stop defaulting to 'go'.

  • Good strategy involves clear diagnosis, guiding policy with identity, and coherent action to address challenges effectively.

  • Repeated incongruence—leveraging competing incentives—helps teams adjust strategies by surfacing disagreements and truth.

  • Building political safety through trust—recognizing excellence, inducing stress, sharing info, and showing vulnerability—is key for decisions.

  • Data-informed decision making balances qualitative insight and quantitative data, avoiding data-driven pitfalls like the Challenger disaster.

  • Survival metrics are time-bound, contextualized, and tied to decision points, enabling teams to stop, pivot, or invest as needed.

  • Avoid sunk cost fallacy by cultivating repetition and muscle for re-diagnosis, adjusting guiding policies, and coherent actions.

  • Feature roadmaps and strict delivery dates erode trust due to noise buildup; decision journals and retrospectives improve transparency.

  • Anti-fragile organizations benefit from stress and shocks by avoiding technical, UX, and political debt through early small stress tests.

  • Storytelling frameworks like ABT (And, But, Therefore) enhance communication by framing strategy around problems, actions, and villains.

Notable Quotes

"60 to 90% of our ideas do not improve the metrics they were intended to improve."

"A good strategy honestly acknowledges the challenges being faced and provides an approach to overcoming them."

"Everyone has a plan until they get punched in the mouth, but a plan is an anchor for pivoting and changing direction."

"Feature roadmaps are bad because coherent actions start to become noise over time in complex environments."

"Being data informed is not being data driven; the Challenger exploded because people wanted more data but ignored qualified gut."

"We want to trust the data that comes in but we do not necessarily care who gives it to us — privacy over secrecy."

"Stop means a bright line is crossed, so there is no wiggle room; pivot means iterating based on new information."

"Burn down theater is when a team shows ticket progress but has made no real decisions in months."

"Antifragility is creating an organization that benefits from shocks, randomness, disorder, and stressors."

"We live in organizations like organisms; find analogies that your company understands and build your communication around them."

Ask the Rosenbot
Bria Alexander
Opening Remarks
2021 • DesignOps Summit 2021
Gold
Uday Gajendar
Theme 1: Introduction
2021 • Design at Scale 2021
Gold
Sharbani Dhar
Breathing Room for Delight
2024 • Enterprise Experience 2020
Gold
Maggie Dieringer
Cutting through the Noise (Videoconference)
2020 • DesignOps Community
B. Pagels-Minor
Breaking the Tension: The Power of Enabling Your Employees to Show Up Authentically
2022 • Design at Scale 2022
Gold
Russell Blair
[Case study] Killing the blank page
2024 • Designing with AI 2024
Gold
Amy Marquez
INVEST: Discussion
2018 • Enterprise Experience 2018
Gold
Mariah Hay
BUILD: Discussion
2018 • Enterprise Experience 2018
Gold
Discussion
2017 • Enterprise Experience 2017
Gold
Kevin M. Hoffman
Theme 2: Enterprise Team Journey
2019 • Enterprise Experience 2019
Gold
Billy Carlson
Principles of Team Wireframing
2023 • DesignOps Summit 2023
Gold
Frances Yllana
The Big Question about Impact: A Panel Discussion
2024 • DesignOps 2024
Gold
Dan Hill
Strategic design, slowdown, and the infrastructures of everyday life (Videoconference)
2022 • Enterprise Community
Xenia Adjoubei
Empowering Communities Through the Researcher in Residence Program
2023 • Advancing Research 2023
Gold
Theresa Neil
Designing for Wellness: Specializing in Healthcare (Videoconference)
2024 • Rosenfeld Community
Phil Hesketh
Designing Accessible Research Workflows
2021 • DesignOps Summit 2021
Gold

More Videos

Adam Cutler

"Don't be cool, be good—work hard at managing your teams because they need you to nail it."

Adam Cutler Karen Pascoe Ian Swinson Susan Worthman

Discussion

June 8, 2016

Peter Merholz

"Sometimes the director is the most senior design person in the org and ends up playing the executive role without the title or support."

Peter Merholz

The Trials and Tribulations of Directors of UX (Videoconference)

July 13, 2023

Lisa Welchman

"Human biases are the real problem behind algorithmic bias, not the algorithms themselves."

Lisa Welchman

Cleaning Up Our Mess: Digital Governance for Designers

June 14, 2018

Vincent Brathwaite

"Sustainable practices are not just a luxury; they are a necessity for our survival."

Vincent Brathwaite

Opener: Past, Present, and Future—Closing the Racial Divide in Design Teams

October 22, 2020

Brenna Fallon

"If you forget the individual, you cut out psychological safety, and that’s the foundation of strong teams."

Brenna Fallon

Learning Over Outcomes

October 24, 2019

Tricia Wang

"Factory owners manipulated people’s time so much that workers were afraid to carry a watch."

Tricia Wang

Spatial Collapse: Designing for Emergent Culture

January 8, 2024

Edgar Anzaldua Moreno

"We aimed for research that is actionable, not just insightful or pretty to look at."

Edgar Anzaldua Moreno

Using Research to Determine Unique Value Proposition

March 11, 2021

"Context-related data gathered through qualitative research is the first to reach our decision-making centers in the brain."

Designing Systems at Scale

November 7, 2018

Erin Weigel

"Conversion design means to create intentional change."

Erin Weigel

Get Your Whole Team Testing to Design for Impact

July 24, 2024