Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

UX Metrics That Matter and The Future of our Design at Scale Conference: A Community Conversation

Thursday, September 22, 2022 • Enterprise Community
Share the love for this talk
UX Metrics That Matter and The Future of our Design at Scale Conference: A Community Conversation
Speakers: Jack Moffett
Link:

Summary

At our September Enterprise Experience Community call, we host a double-header of topics — “UX metrics that matter” and “The future of our conference”. First, we have Jack Moffett, well-known design leader currently at Boeing, in a conversation about identifying and advocating for measurable user experience for enterprise apps and services.

Key Insights

  • Effective UX metrics balance qualitative surveys and quantitative user behavior data.

  • Setting fixed outcome targets like NPS scores is less useful than tracking improvement trends.

  • Triangulating metrics (NPS, CSAT, CES) provides richer understanding than relying on a single measure.

  • UX success metrics differ from product usage metrics by focusing on user goal completion not just feature adoption.

  • Embedding metrics collection proactively in agile workflows improves product evaluation.

  • UX teams face the challenge of persuading stakeholders to prioritize improvements based on metrics insights.

  • There is often organizational resistance to collecting UX data due to fear of low scores and blame culture.

  • Enterprise UX conferences struggle to balance community identity with attracting interdisciplinary participants.

  • Design influence requires skills beyond craft, including strategy, culture shaping, and business alignment.

  • Expanding UX definition beyond UI to include marketing, documentation, and product architecture is critical for organizational impact.

Notable Quotes

"It's not about hitting a specific NPS target but about improving from where we are now and tracking the trend."

"You don't know if you're successful until your users are successful in accomplishing their goals using your product."

"Too many teams think delivering software means success, but actual success is user achievement with the product."

"Triangulation is key — compare multiple metrics to understand why scores move the way they do."

"Proactive measurement before release combined with post-release evaluation is the ideal approach."

"We often need to evangelize the importance of collecting UX metrics to teams and leadership."

"UX is more than UI; it's the entire product, including marketing, documentation, and architecture."

"Design influence is messy and requires clear articulation of how we serve business and customer success."

"Executives like NPS because it’s a simple, quick-to-understand number, even if they don’t fully grasp its nuances."

"Culture needs to accept failure as part of learning so we can improve rather than assign blame."

Ask the Rosenbot
Nalini P. Kotamraju
Two Jobs in One: Being a “Leader who is a Researcher” and a “Researcher who is a Leader"
2021 • Advancing Research 2021
Gold
Dorelle Rabinowitz
The Magic Word is Trust
2018 • Enterprise Experience 2018
Gold
James Wieselman Schulman
Research is a team sport: advancing the work when everyone does the research
2026 • Advancing Research 2026
Gold
Tutti Taygerly
Videconference: How to Work with Difficult People with Tutti Taygerly
2020 • Enterprise Community
Sarah Kinkade
Design Management Models in the Face of Transformation
2022 • Design at Scale 2022
Gold
Janaki Kumar
Innovate with Purpose
2018 • Enterprise Experience 2018
Gold
Allison Sanders
Operating with Purpose
2024 • DesignOps Summit 2020
Gold
Kevin M. Hoffman
Theme 2: Enterprise Team Journey
2019 • Enterprise Experience 2019
Gold
Marjorie Stainback
Transforming Strategic Research Capacity through Democratization
2019 • DesignOps Summit 2019
Gold
Rich Mironov
How Can Product Managers and UXers Help Each Other (and Why are Product Folks so Annoying Sometimes)?
2022 • Design in Product 2022
Gold
Onur Kocan
Understanding the Strategy for Civic Design in a Complex City: Istanbul
2022 • Civic Design 2022
Gold
Savannah Carlin
Don't botch the bot: Designing interactions for AI
2024 • Designing with AI 2024
Gold
Carol Smith
Operationalizing Responsible, Human-Centered AI
2023 • Enterprise UX 2023
Gold
Catt Small
Moving from Execution to Strategy as a Designer
2022 • Design in Product 2022
Gold
Xenia Adjoubei
Empowering Communities Through the Researcher in Residence Program
2023 • Advancing Research 2023
Gold
Jorge Arango
Design as an Antidote to VUCA
2019 • Enterprise Community

More Videos

Taylor Jennings

"Cutting down on the analysis time was huge for us, speeding up speed to insight significantly."

Taylor Jennings Joe Nelson Alex Knoll

Repository Retrospective: Learnings from Introducing a Central Place for UX Research

March 9, 2022

Nicole Aleong

"Destiny is the belief that a certain future outcome is predetermined regardless of the path."

Nicole Aleong

Future Orientations to Everyday Life: Futures Anthropology as a Methodology

March 26, 2024

Jeff Gothelf

"Hackathons are a fun activity to spend some creative time together and then go back to making the stuff that we normally make."

Jeff Gothelf

Innovation Studios: the Engines of Enterprise Experimentation

May 14, 2015

Saara Kamppari-Miller

"One superpower of ops humans is making problems and gaps visible to build awareness and drive change."

Saara Kamppari-Miller

DesignOps for Inclusive Design and Accessibility

May 26, 2022

Tess Dixon

"Our culture has diminished a lot of the other things in life that are supposed to give us meaning and put infinite pressure on work."

Tess Dixon

C'mon Get Happy

September 29, 2021

Liam Thurston

"Building a great culture means caring for individuals and creating rituals like recognition and shared learning."

Liam Thurston

Why Your Design Team Is Quitting, And How To Fix It

June 10, 2022

Ian Swinson

"A workshop helps people map their skills, identify gaps, and make specific goals for career jumps."

Ian Swinson

Designing and Driving UX Careers

June 8, 2016

Leisa Reichelt

"If you make rules, put numbers in them, and say them confidently, sometimes people actually do them."

Leisa Reichelt

Opening Keynote: Operating in Context

November 7, 2018

Rachael Greene

"A product designer said I can now see glaring inconsistencies before I got my head around design system patterns."

Rachael Greene Alison Davis

Building a Design Ops Practice that Really Works (Most of the Time)

October 2, 2025