Log in or create a free Rosenverse account to watch this video.
Log in Create free account100s of community videos are available to free members. Conference talks are generally available to Gold members.
Key Metrics: Comparing Three Letter Acronym Metrics That Include the Word “Key”
Summary
Why do so many metrics include the word “Key”? How do those metrics differ, and how do teams and organizations decide which key metric is best for them? Join this DesignOps community discussion to compare different types of three letter acronym metrics such as KPI, KEI, and KSP (Key Performance Indicator, Key Experience Indicator, and Key Strategic Priorities). And let's not forget OKR's (Objectives and Key Results)!
Key Insights
-
•
Nicole emphasizes linking accessibility initiatives to corporate Key Strategic Priorities to demonstrate business value beyond compliance.
-
•
Shashi's KPI Compass framework categorizes innovation metrics into quadrants balancing leading/lagging and thought leadership/impact.
-
•
Key Experience Indicators (KEIs) are distinct from KPIs and focus on user-centered measures that predict experience failure risks.
-
•
Measuring behavior change is crucial to predicting innovation success, not just tracking final business metrics.
-
•
Consistency in metrics terminology and templates across teams helps avoid sidetracking conversations with engineering partners.
-
•
Canary indicators identify critical experience fail points that can doom a product if not monitored carefully.
-
•
Strategic priorities, like Hilton’s KSPs, tend to remain stable over years to guide multi-year initiatives reliably.
-
•
Storytelling and communication training are vital for teams to convey the value of accessibility and design work aligned with business objectives.
-
•
In ambiguous or innovative contexts, metrics should remain a conversation starter rather than imposed fixed covenants.
-
•
Using user and market feedback can shift early metrics from vanity measures (like downloads) to meaningful adoption and usage data.
Notable Quotes
"If we are working on something that does not ladder up to our KSPs, then we should not be working on it."
"The canary in the coal mine—that’s how we identify the fail points in the user experience we absolutely can’t miss."
"Innovation is invention multiplied by adoption multiplied by inclusion."
"Metrics are always a conversation, they shouldn’t be a covenant."
"Adoption is the only thing that matters in innovation. If you’re not changing behavior, you haven’t innovated."
"Key is a reminder that these metrics reflect what is authoritative and important to the customer and the business."
"If you only measure vanity metrics like downloads, you risk tracking numbers that don’t translate to real usage or value."
"Our KSPs do not change year over year because changing them frequently is disruptive for the business direction."
"We use storytelling to turn accessibility from just compliance into a business differentiator that executives care about."
"When there’s dispute over what to measure, use that as an opportunity to discuss the behavior you want to change and the value capture."
Or choose a question:
More Videos
"I found the problem solver in the UI developer and identified the project’s sponsor who really felt the pain."
Carl TurnerYou Can Do This: Understand and Solve Organizational Problems to Jumpstart a Dead Project
March 28, 2023
"Performance management is really about the employee experience; avoid surprises by coaching continuously on both what and how folks are doing."
Karen PascoeDeveloping Experience Teams and Talent in the Enterprise
June 8, 2016
"When you remove nonverbal cues from communication, messages get easily misinterpreted."
Jilanna WilsonDistributed Design Operations Management
October 23, 2019
"The collaboration cycle requires following standards for accessibility, content, design system usage, and IA or you don’t launch your product."
Shawna Hein Kevin HoffmanCreate a Cohesive Civic Design Practice Across Agency, Vendors, and Contracts
November 17, 2022
"Working in healthcare means every tiny moment in a patient’s experience can either uphold or erode their dignity and sense of control."
Barb SpantonDoing Work That Matters: A Look Beyond The Idealistic Notion of 'Doing Meaningful Work'
June 10, 2022
"Silent leaders are people who prefer action over words and advocate in more intimate settings."
Briana ThomasThe Quiet Force: Uncovering Hidden Leadership in High-Impact Design Teams
September 24, 2024
"Taking ugly notes together without worrying about making things pretty lowers barriers and increases engagement."
Gina MendoliaTherapists, Coaches, and Grandmas: Techniques for Service Design in Complex Systems
December 3, 2024
"Now everyone’s an edge case, so research needs to focus on those edge cases, not just the average user."
Lija Hogan Milan Mijatovic Sam Proulx Louis RosenfeldThree Years Out: Perspectives on the Near-Term Future of User Research
March 15, 2024
"DPM loneliness and siloing happen because of wearing too many hats and inheriting mismatched responsibilities."
John Calhoun Rachel PosmanTwo Sides of the DesignOps Coin: Teams Ops and Product Ops
January 8, 2024
Latest Books All books
Dig deeper with the Rosenbot
How do you ensure a product vision is grounded in customer pain points and business opportunities?
What strategies motivate cross-functional teams to input their research findings into a centralized repository?
Where can UX researchers find reliable, up-to-date information and recommendations on research tool options?