Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Survival Metrics – Making Change in a Fast, Data-Informed, and Politically Safe Way
Gold
Tuesday, December 6, 2022 • Design in Product 2022
Share the love for this talk
Survival Metrics – Making Change in a Fast, Data-Informed, and Politically Safe Way
Speakers: Adam Thomas
Link:

Summary

When teams don’t know how to pivot, the resulting waste can lead to a slow down in product delivery. Unfortunately, such confusion occurs commonly in UX/Product teams where roles can blur, and overlap between responsibilities can be rampant. In this session, product expert Adam Thomas introduces the concept of “Survival Metrics” — an approach to team collaboration that not only encourages healthy pivots, but puts in place the mechanisms to achieve them. Stick around to join the conversation and ask Adam your questions during our post-session Q+A, moderated by Christian Crumlish.

Key Insights

  • 60 to 90% of product ideas fail to improve their intended metrics, illustrating the need to stop defaulting to 'go'.

  • Good strategy involves clear diagnosis, guiding policy with identity, and coherent action to address challenges effectively.

  • Repeated incongruence—leveraging competing incentives—helps teams adjust strategies by surfacing disagreements and truth.

  • Building political safety through trust—recognizing excellence, inducing stress, sharing info, and showing vulnerability—is key for decisions.

  • Data-informed decision making balances qualitative insight and quantitative data, avoiding data-driven pitfalls like the Challenger disaster.

  • Survival metrics are time-bound, contextualized, and tied to decision points, enabling teams to stop, pivot, or invest as needed.

  • Avoid sunk cost fallacy by cultivating repetition and muscle for re-diagnosis, adjusting guiding policies, and coherent actions.

  • Feature roadmaps and strict delivery dates erode trust due to noise buildup; decision journals and retrospectives improve transparency.

  • Anti-fragile organizations benefit from stress and shocks by avoiding technical, UX, and political debt through early small stress tests.

  • Storytelling frameworks like ABT (And, But, Therefore) enhance communication by framing strategy around problems, actions, and villains.

Notable Quotes

"60 to 90% of our ideas do not improve the metrics they were intended to improve."

"A good strategy honestly acknowledges the challenges being faced and provides an approach to overcoming them."

"Everyone has a plan until they get punched in the mouth, but a plan is an anchor for pivoting and changing direction."

"Feature roadmaps are bad because coherent actions start to become noise over time in complex environments."

"Being data informed is not being data driven; the Challenger exploded because people wanted more data but ignored qualified gut."

"We want to trust the data that comes in but we do not necessarily care who gives it to us — privacy over secrecy."

"Stop means a bright line is crossed, so there is no wiggle room; pivot means iterating based on new information."

"Burn down theater is when a team shows ticket progress but has made no real decisions in months."

"Antifragility is creating an organization that benefits from shocks, randomness, disorder, and stressors."

"We live in organizations like organisms; find analogies that your company understands and build your communication around them."

Ask the Rosenbot
Sarah Williams
A Framework for CX Transformation
2021 • Design at Scale 2021
Gold
Nina Jurcic
The Design System Rollercoaster: From Enabler and Bottleneck to Catalyst for Change
2023 • DesignOps Summit 2023
Gold
Corey Nelson
Layoffs (Videoconference)
2022 • Advancing Research Community
Rebecca Buck
Mission: Keep Talent in Research Roles!
2021 • Advancing Research 2021
Gold
Noel Lamb
Cultivating Business Partnerships to Grow Research Ops (Videoconference)
2022 • Advancing Research Community
Deanna Washington
Connecting the Ops: Plenary Panel and Closing Circle
2022 • DesignOps Summit 2022
Gold
Christian Crumlish
Afternoon Insights Panel
2022 • Design in Product 2022
Gold
Kayla Farrell
What It's Like To Be a User Researcher at Compass
2021 • Advancing Research 2021
Gold
Prayag Narula
How to Empower Your Designers to Do Good Research – And Why You Want To
2022 • Design at Scale 2022
Gold
Lija Hogan
Practical Principles of Inclusive Research
2023 • Advancing Research 2023
Gold
Dane DeSutter
Keeping the Body in Mind: What Gestures and Embodied Actions Tell You That Users May Not
2024 • Advancing Research 2024
Gold
Bob Baxley
Leading with Design Operations Past and Present (Videoconference)
2019 • DesignOps Community
Ariel Kennan
Building a Design Culture
2017 • Enterprise Experience 2017
Gold
Making People the X-Factor in the Enterprise
2018 • Enterprise Experience 2018
Gold
Cheryl Platz
Merging Improv with Design (Videoconference)
2019 • Enterprise Community
Christian Crumlish
AMA with Christian Crumlish, author of Product Management for UX People (Videoconference)
2022 • Enterprise Community

More Videos

Verónica Urzúa

"Tools and practices are not neutral; they are cross-contextual and situational."

Verónica Urzúa Jorge Montiel

The B-side of the Research Impact

March 12, 2021

Michal Anne Rogondino

"Convincing defense contractors to adopt UX was slow because contracts were already signed years ago."

Michal Anne Rogondino

Saving Outer Space: The First UX Design System for Our Nation’s Satellites

January 8, 2024

Jemma Ahmed

"Better sharing the stories of those we seek to understand helps us lead with their truths."

Jemma Ahmed

Theme 2 Intro

March 10, 2022

Kara Kane

"We must consider what to transform but also what to preserve from history in Civic design."

Kara Kane

Theme One Intro

November 16, 2022

Laine Riley Prokay

"Competencies allow managers to celebrate individualism while ensuring consistency."

Laine Riley Prokay

How DesignOps can Drive Inclusive Career Ladders for All

September 30, 2021

Laura Gatewood

"Video messages can help bring back lost nonverbal cues like tone and body language."

Laura Gatewood Laine Prokay

Beyond Buzzwords: Adding Heart to Effective Slack Communication

September 23, 2024

Caitlyn Hampton

"Our agents are so honest and brutal with feedback, which I love because we don’t have to pull the truth out of them."

Caitlyn Hampton Monica Lee Jina Yoon

Compass 101: Growing Your Career In A Startup World

June 11, 2021

Hana Nagel

"Act local but think global: optimize solutions for specific contexts then scale in small chunks."

Hana Nagel

Turning Research Ripples into Waves

November 8, 2018

Alexandra Schmidt

"Designers are being entrusted with increasingly complex challenges that traditional design education doesn’t fully prepare them for."

Alexandra Schmidt

Enterprise UX Playbook (Videoconference)

December 1, 2022