Log in or create a free Rosenverse account to watch this video.
Log in Create free account100s of community videos are available to free members. Conference talks are generally available to Gold members.
Summary
At our September Enterprise Experience Community call, we host a double-header of topics — “UX metrics that matter” and “The future of our conference”. First, we have Jack Moffett, well-known design leader currently at Boeing, in a conversation about identifying and advocating for measurable user experience for enterprise apps and services.
Key Insights
-
•
UX metrics teams serve as internal service organizations helping product teams define, collect, and act on user data.
-
•
Leadership often fixates on target scores like NPS, but focusing on improvement trends from current baselines is more productive.
-
•
Diagnostic metrics establish where you are; predictive metrics guide investment and feature development decisions.
-
•
Triangulating multiple data sources and metrics, quantitative and qualitative, provides deeper understanding than single measures.
-
•
User success metrics differ from usage or adoption metrics; success means users achieve their goals, not just increased usage.
-
•
UX research and analytics must be integrated early and continuously in agile workflows, working ahead of development sprints.
-
•
There is a socio-political dimension to data where cultural attitudes impact how metrics are received and acted upon.
-
•
UX influence requires persuasive storytelling and connecting design impact directly to business objectives like revenue or compliance.
-
•
Enterprise UX is evolving from focusing solely on designers to including cross-functional roles like marketing, sales, and QA.
-
•
Leadership often understands the value of UX but lacks concrete tools and processes to operationalize and scale it effectively.
Notable Quotes
"It’s less productive to set a fixed goal like 85 NPS than to focus on improving from where we are now and track the trend."
"Success is not delivering software, success is whether users can actually do what the product helps them do."
"You can’t just pick one metric; you have to triangulate multiple data points to learn what to do next."
"Collecting the data is great, but making it actionable and prioritizing changes based on it is the real challenge."
"The analytics team isn’t yet deeply involved in roadmap prioritization but aims to influence teams to do so."
"UX has become equated to UI by many, but UX is the whole product and the entire user experience ecosystem."
"We have to influence both up and across the organization—c-suite and cross-functional peers—to show UX value."
"There’s a cultural aspect to handling metrics; negative scores can lead to blame or learning depending on mindset."
"Embedding metrics and analytics in product development plans needs to be baked in at key points, not an afterthought."
"Distributing design into the organization is more effective for business outcomes than just increasing designer headcount."
Or choose a question:
More Videos
"If designers spend more time talking about titles than their work, we’re just gazing into our navels."
Adam Cutler Karen Pascoe Ian Swinson Susan WorthmanDiscussion
June 8, 2016
"We don’t get upset when users say one thing and do another, but we freak out when our leadership behaves that way."
Peter MerholzThe Trials and Tribulations of Directors of UX (Videoconference)
July 13, 2023
"Human biases are the real problem behind algorithmic bias, not the algorithms themselves."
Lisa WelchmanCleaning Up Our Mess: Digital Governance for Designers
June 14, 2018
"Sustainable practices are not just a luxury; they are a necessity for our survival."
Vincent BrathwaiteOpener: Past, Present, and Future—Closing the Racial Divide in Design Teams
October 22, 2020
"Psychological safety was far and away the key ingredient for teams being effective."
Brenna FallonLearning Over Outcomes
October 24, 2019
"Factory owners manipulated people’s time so much that workers were afraid to carry a watch."
Tricia WangSpatial Collapse: Designing for Emergent Culture
January 8, 2024
"Research should be done the same way products are built, with stakeholders as your users."
Edgar Anzaldua MorenoUsing Research to Determine Unique Value Proposition
March 11, 2021
"Leadership buy-in is really important—having an executive who understands the value of knowledge creation, distribution, application, and evaluation."
Designing Systems at Scale
November 7, 2018
"A lot of developers are way too confident they write perfect code; testing bug fixes often reveals hidden issues."
Erin WeigelGet Your Whole Team Testing to Design for Impact
July 24, 2024