Log in or create a free Rosenverse account to watch this video.
Log in Create free account100s of community videos are available to free members. Conference talks are generally available to Gold members.
Key Metrics: Comparing Three Letter Acronym Metrics That Include the Word “Key”
Summary
Key Insights
-
•
Nicole emphasizes linking accessibility initiatives to corporate Key Strategic Priorities to demonstrate business value beyond compliance.
-
•
Shashi's KPI Compass framework categorizes innovation metrics into quadrants balancing leading/lagging and thought leadership/impact.
-
•
Key Experience Indicators (KEIs) are distinct from KPIs and focus on user-centered measures that predict experience failure risks.
-
•
Measuring behavior change is crucial to predicting innovation success, not just tracking final business metrics.
-
•
Consistency in metrics terminology and templates across teams helps avoid sidetracking conversations with engineering partners.
-
•
Canary indicators identify critical experience fail points that can doom a product if not monitored carefully.
-
•
Strategic priorities, like Hilton’s KSPs, tend to remain stable over years to guide multi-year initiatives reliably.
-
•
Storytelling and communication training are vital for teams to convey the value of accessibility and design work aligned with business objectives.
-
•
In ambiguous or innovative contexts, metrics should remain a conversation starter rather than imposed fixed covenants.
-
•
Using user and market feedback can shift early metrics from vanity measures (like downloads) to meaningful adoption and usage data.
Notable Quotes
"If we are working on something that does not ladder up to our KSPs, then we should not be working on it."
"The canary in the coal mine—that’s how we identify the fail points in the user experience we absolutely can’t miss."
"Innovation is invention multiplied by adoption multiplied by inclusion."
"Metrics are always a conversation, they shouldn’t be a covenant."
"Adoption is the only thing that matters in innovation. If you’re not changing behavior, you haven’t innovated."
"Key is a reminder that these metrics reflect what is authoritative and important to the customer and the business."
"If you only measure vanity metrics like downloads, you risk tracking numbers that don’t translate to real usage or value."
"Our KSPs do not change year over year because changing them frequently is disruptive for the business direction."
"We use storytelling to turn accessibility from just compliance into a business differentiator that executives care about."
"When there’s dispute over what to measure, use that as an opportunity to discuss the behavior you want to change and the value capture."
Or choose a question:
More Videos
"The rebrand caused our NPS to plummet and freaked out our executives — that was the trigger to get serious."
Shipra KayanHow we Built a VoC (Voice of the Customer) Practice at Upwork from the Ground Up
September 30, 2021
"Every few years consultants come in and tidy up our mess, but as soon as they leave, we mess it all up again."
Peter MorvilleThe Architecture of Understanding
May 13, 2015
"I was going to use everything that I had experienced, all the skills, all the successes, and become my own superpower."
Renee ReidBecoming a ResearchH.E.R (Highly Enterprise Ready)
June 3, 2019
"Language can be vague, imprecise, and even contradictory, but the body can be a bridge to understanding."
Dane DeSutterKeeping the Body in Mind: What Gestures and Embodied Actions Tell You That Users May Not
March 26, 2024
"If you build accessible shopping with these four keys, compliance with legal standards like WCAG will naturally fall into place."
Sam ProulxOnline Shopping: Designing an Accessible Experience
October 3, 2023
"Balance UX and CX—making the site work technically is not enough if the content or experience isn’t meaningful."
Andrew Custage Michael MallettThe Digital Journey: Research on Consumer Frustration and Loyalty
March 29, 2023
"Zoom fatigue is real, people are not necessarily keen to go into another Zoom meeting even if they think it’s valuable."
Shelby SwitzerMaking Space for Community Knowledge-sharing in a Distributed World
December 10, 2021
"If we want our value to be defined as anything other than studies run, we must learn how to trace and articulate the actual business impact."
Llewyn PaineCoexisting with AI: A practical guide for researchers to navigate tools, ethics, and integration
March 11, 2025
"Simon Roberts calls this the UX ification of research, which leads to a more transactional focus on informing technology requirements."
Robin BeersNavigating organizational systems: Rethinking researcher’s role in driving change
March 13, 2025
Latest Books All books
Dig deeper with the Rosenbot
How do enterprises balance qualitative and quantitative tools while integrating AI into UX research workflows?
How does Rosenfeld Media ensure high quality and relevance across its Rosenverse offerings?
What strategies help UX teams translate usability findings into stakeholder-relevant outcomes like cost savings or risk reduction?