Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Survival Metrics – Making Change in a Fast, Data-Informed, and Politically Safe Way
Gold
Tuesday, December 6, 2022 • Design in Product 2022
Share the love for this talk
Survival Metrics – Making Change in a Fast, Data-Informed, and Politically Safe Way
Speakers: Adam Thomas
Link:

Summary

When teams don’t know how to pivot, the resulting waste can lead to a slow down in product delivery. Unfortunately, such confusion occurs commonly in UX/Product teams where roles can blur, and overlap between responsibilities can be rampant. In this session, product expert Adam Thomas introduces the concept of “Survival Metrics” — an approach to team collaboration that not only encourages healthy pivots, but puts in place the mechanisms to achieve them. Stick around to join the conversation and ask Adam your questions during our post-session Q+A, moderated by Christian Crumlish.

Key Insights

  • 60 to 90% of product ideas fail to improve their intended metrics, illustrating the need to stop defaulting to 'go'.

  • Good strategy involves clear diagnosis, guiding policy with identity, and coherent action to address challenges effectively.

  • Repeated incongruence—leveraging competing incentives—helps teams adjust strategies by surfacing disagreements and truth.

  • Building political safety through trust—recognizing excellence, inducing stress, sharing info, and showing vulnerability—is key for decisions.

  • Data-informed decision making balances qualitative insight and quantitative data, avoiding data-driven pitfalls like the Challenger disaster.

  • Survival metrics are time-bound, contextualized, and tied to decision points, enabling teams to stop, pivot, or invest as needed.

  • Avoid sunk cost fallacy by cultivating repetition and muscle for re-diagnosis, adjusting guiding policies, and coherent actions.

  • Feature roadmaps and strict delivery dates erode trust due to noise buildup; decision journals and retrospectives improve transparency.

  • Anti-fragile organizations benefit from stress and shocks by avoiding technical, UX, and political debt through early small stress tests.

  • Storytelling frameworks like ABT (And, But, Therefore) enhance communication by framing strategy around problems, actions, and villains.

Notable Quotes

"60 to 90% of our ideas do not improve the metrics they were intended to improve."

"A good strategy honestly acknowledges the challenges being faced and provides an approach to overcoming them."

"Everyone has a plan until they get punched in the mouth, but a plan is an anchor for pivoting and changing direction."

"Feature roadmaps are bad because coherent actions start to become noise over time in complex environments."

"Being data informed is not being data driven; the Challenger exploded because people wanted more data but ignored qualified gut."

"We want to trust the data that comes in but we do not necessarily care who gives it to us — privacy over secrecy."

"Stop means a bright line is crossed, so there is no wiggle room; pivot means iterating based on new information."

"Burn down theater is when a team shows ticket progress but has made no real decisions in months."

"Antifragility is creating an organization that benefits from shocks, randomness, disorder, and stressors."

"We live in organizations like organisms; find analogies that your company understands and build your communication around them."

Ask the Rosenbot
Jacqui Frey
Flow and Superfluidity for Design Orgs
2018 • DesignOps Summit 2018
Gold
Josina Vink
Navigating the pitfalls of systems thinking in service design
2024 • Advancing Service Design 2024
Gold
Sahibzada Mayed
Cultivating Design Ecologies of Care, Community, and Collaboration
2023 • DesignOps Summit 2023
Gold
Chris Geison
Theme 1 Intro
2022 • Advancing Research 2022
Gold
Dominique Ward
The Most Exciting Time for DesignOps is Now
2022 • DesignOps Summit 2022
Gold
Steve Chaparro
Bringing Into Alignment Brand, Culture and Space (Videoconference)
2020 • DesignOps Community
Mariah Hay
BUILD: Discussion
2018 • Enterprise Experience 2018
Gold
Andrew Michael
Building a Product Insights Team
2022 • Advancing Research 2022
Gold
Meredith Black
Scaling Design Culture
2017 • DesignOps Summit 2017
Gold
Caitlyn Hampton
Compass 101: Growing Your Career In A Startup World
2021 • Design at Scale 2021
Gold
Billy Carlson
Pro-level UI Tips for Beginners
2022 • DesignOps Summit 2022
Gold
Heidi Trost
To Protect People, You Have to Protect Information: A Human-Centered Design Approach to Cybersecurity
2025 • Rosenfeld Community
Jonathon Colman
How to Maximize the Impact of Content Design
2024 • DesignOps Summit 2020
Gold
Jules Monza
Use These Words and Count These Things
2024 • DesignOps 2024
Gold
Steve Baty
Breaking Out of Ruts: Tips for Overcoming the Fear of Change
2016 • Enterprise UX 2016
Gold
Emily DiLeo
Stronger Together: Lessons Learned from UX Research Ops
2024 • DesignOps 2024
Gold

More Videos

Zariah Cameron

"Stop saying rest is a luxury or a privilege. It is not. It is a human right."

Zariah Cameron

ReDesigning Wellbeing for Equitable Care in the Workplace

September 23, 2024

John Cutler

"If you don’t have enough information to prioritize, put the items on a dartboard and throw a dart to start the conversation."

John Cutler Harry Max

Prioritization for designers and product managers (1st of 3 seminars) (Videoconference)

June 13, 2024

Nick Cochran

"Working in enterprise can feel like chaos with unclear directions and too much noise from new initiatives every six months."

Nick Cochran

Growing in Enterprise Design through Making Connections

June 3, 2019

Deanna Smith

"I often lock a process against changes for one to two months unless a major issue arises."

Deanna Smith

Leading Change with Confidence: Strategies for Optimizing Your Process

September 23, 2024

Magdalena Zadara

"Our fellowships bring in private sector people to public service challenges, focusing more on the journey than on delivering final products."

Magdalena Zadara

Zero Hour: How to Get Far Quickly When Starting Your Digital Service Unit Late

November 16, 2022

Nova Wehman-Brown

"Despite all the insecurities, most team members were willing to show up every week and challenge what they thought they knew."

Nova Wehman-Brown

We've Never Done This Before

June 4, 2019

Liwei Dai

"Machines may identify that higher ice cream sales is associated with higher band ice, but the former is not causing the latter."

Liwei Dai

The Heart and Brain of the AI Research

March 31, 2020

Gordon Ross

"My phone buzzed again. I have a job this weekend for you and your team to help on the COVID response if you’re available."

Gordon Ross

12 Months of COVID-19 Design and Digital Response with the British Columbia Government

December 8, 2021

Tutti Taygerly

"The biggest secret to building trust with other people is vulnerability."

Tutti Taygerly

Make Space to Lead

June 12, 2021