Survival Metrics – Making Change in a Fast, Data-Informed, and Politically Safe Way
Summary
In this session, product expert Adam Thomas introduces the concept of “Survival Metrics” — an approach to team collaboration that not only encourages healthy pivots, but puts in place the mechanisms to achieve them.
Stick around to join the conversation and ask Adam your questions during our post-session Q+A, moderated by Christian Crumlish.
Key Insights
-
•
60-90% of product ideas do not improve intended metrics, causing waste and burnout.
-
•
Steve Jobs’ reality distortion field exemplifies pushing forward without feedback, which can lead to failure in today’s environment.
-
•
Good strategy consists of diagnosis of the problem, a clear guiding policy, and coherent actions aligned to it.
-
•
Repeated incongruence—continuously reassessing incentives and data—strengthens decision-making muscles vital for pivots.
-
•
Building trust through recognition, challenge stress, discretion, and vulnerability is key to politically safe change.
-
•
Moving fast requires limiting options through predefined language and focusing on reversible, coin-flip decisions.
-
•
Being data-informed means using data to inform decisions, not blindly driving them; ignoring gut and context can be fatal (e.g., Challenger disaster).
-
•
Sensing metrics are time-bound, contextual, tied to decisions, and linked back to strategy—unlike traditional feature-focused roadmaps.
-
•
Stopping, pivoting, and investing early are essential decisions teams must iterate on to avoid sunk cost fallacy.
-
•
A clear story anchored in company culture with a villain (problem) helps communicate strategy and build trust for decision-making.
Notable Quotes
"60 to 90% of our ideas do not improve the metrics they were intended to improve."
"Everyone has a plan until they get punched in the mouth, said Mike Tyson."
"Feature roadmaps are bad because over time coherent actions become noise."
"Being data informed is not data driven—blindly following data can kill you, like the Challenger explosion."
"Stop, pivot, or invest early—these are the survival metric decisions that save companies."
"Trust is built by recognizing excellence, inducing challenge stress, giving discretion, and showing vulnerability."
"Most decisions are coin flip decisions—easily reversible and should be treated as defaults."
"You have to ask, what are we deciding, and what are we quitting, on a regular basis."
"If you’re not investing or quitting something, what is the point of having a strategy?"
"Repetition, representation, and association are the keys to great theater and great product development."
Or choose a question:
More Videos
"We moved from Evernote to spreadsheets, to a giant affinity board in Mirror, then to UserVoice, and finally to idiomatic software with AI."
Shipra KayanHow we Built a VoC (Voice of the Customer) Practice at Upwork from the Ground Up
September 30, 2021
"When we understand organizations as ecosystems, we recognize the need for organic simplicity."
Peter MorvilleThe Architecture of Understanding
May 13, 2015
"Having those tough conversations with C-Suite execs, delivering findings with unwavering voice because you know the customer."
Renee ReidBecoming a ResearchH.E.R (Highly Enterprise Ready)
June 3, 2019
"Language can be vague, imprecise, and even contradictory, but the body can be a bridge to understanding."
Dane DeSutterKeeping the Body in Mind: What Gestures and Embodied Actions Tell You That Users May Not
March 26, 2024
"A good two-factor system offers multiple methods, like authenticator apps, calls, and texts, with generous timeouts."
Sam ProulxOnline Shopping: Designing an Accessible Experience
October 3, 2023
"It costs less to keep the customers you have than to acquire new ones."
Andrew Custage Michael MallettThe Digital Journey: Research on Consumer Frustration and Loyalty
March 29, 2023
"It’s okay to be goofy and have fun—creating space for awkwardness and playfulness helps engagement."
Shelby SwitzerMaking Space for Community Knowledge-sharing in a Distributed World
December 10, 2021
"Volume is a losing game because we cannot outcompete full AI automation for sheer speed and quantity of insights."
Llewyn PaineCoexisting with AI: A practical guide for researchers to navigate tools, ethics, and integration
March 11, 2025
"A metaphor is like a flashlight—it shines on some things and keeps others in the dark."
Robin BeersNavigating organizational systems: Rethinking researcher’s role in driving change
March 13, 2025
