Rosenverse
UX Metrics That Matter and The Future of our Design at Scale Conference: A Community Conversation

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

UX Metrics That Matter and The Future of our Design at Scale Conference: A Community Conversation

Thursday, September 22, 2022 • Enterprise Community
Share the love for this talk
UX Metrics That Matter and The Future of our Design at Scale Conference: A Community Conversation
Speakers: Jack Moffett
Link:

Summary

At our September Enterprise Experience Community call, we host a double-header of topics — “UX metrics that matter” and “The future of our conference”. First, we have Jack Moffett, well-known design leader currently at Boeing, in a conversation about identifying and advocating for measurable user experience for enterprise apps and services.

Key Insights

  • Effective UX metrics balance qualitative surveys and quantitative user behavior data.

  • Setting fixed outcome targets like NPS scores is less useful than tracking improvement trends.

  • Triangulating metrics (NPS, CSAT, CES) provides richer understanding than relying on a single measure.

  • UX success metrics differ from product usage metrics by focusing on user goal completion not just feature adoption.

  • Embedding metrics collection proactively in agile workflows improves product evaluation.

  • UX teams face the challenge of persuading stakeholders to prioritize improvements based on metrics insights.

  • There is often organizational resistance to collecting UX data due to fear of low scores and blame culture.

  • Enterprise UX conferences struggle to balance community identity with attracting interdisciplinary participants.

  • Design influence requires skills beyond craft, including strategy, culture shaping, and business alignment.

  • Expanding UX definition beyond UI to include marketing, documentation, and product architecture is critical for organizational impact.

Notable Quotes

"It's not about hitting a specific NPS target but about improving from where we are now and tracking the trend."

"You don't know if you're successful until your users are successful in accomplishing their goals using your product."

"Too many teams think delivering software means success, but actual success is user achievement with the product."

"Triangulation is key — compare multiple metrics to understand why scores move the way they do."

"Proactive measurement before release combined with post-release evaluation is the ideal approach."

"We often need to evangelize the importance of collecting UX metrics to teams and leadership."

"UX is more than UI; it's the entire product, including marketing, documentation, and architecture."

"Design influence is messy and requires clear articulation of how we serve business and customer success."

"Executives like NPS because it’s a simple, quick-to-understand number, even if they don’t fully grasp its nuances."

"Culture needs to accept failure as part of learning so we can improve rather than assign blame."

Ask the Rosenbot
John Calhoun
Two Sides of the DesignOps Coin: Teams Ops and Product Ops
2024 • DesignOps Summit 2020
Gold
Bria Alexander
Opening Remarks
2023 • DesignOps Summit 2023
Gold
Ana Maria Montero Barrantes
The Authentic UX Talent Show
2024 • Enterprise Experience 2020
Gold
Holly Cole
Understanding Experiences: When you have to do more than work
2018 • DesignOps Summit 2018
Gold
Jaskiran Kang
Why Community is Key to Professionalizing Design
2022 • Civic Design Community
Milan Guenther
The $212 billion ‘so what?’: unlocking impact in development cooperation
2025 • Advancing Service Design 2025
Gold
Bria Alexander
Opening Remarks
2021 • DesignOps Summit 2021
Gold
John Maeda
About Design Organizations
2019 • DesignOps Community
Sam Proulx
Designing For Screen Readers: Understanding the Mental Models and Techniques of Real Users
2021 • DesignOps Summit 2021
Gold
Tutti Taygerly
Videconference: How to Work with Difficult People with Tutti Taygerly
2020 • Enterprise Community
Mila Kuznetsova
How Lessons Learned from Our Youngest Users Can Help Us Evolve our Practices
2022 • Advancing Research 2022
Gold
Clara Kliman-Silver
UX Futures: The Role of Artificial Intelligence in Design
2023 • Enterprise UX 2023
Gold
Ariel Kennan
Civic Design in 2022
2022 • Civic Design Community
Nova Wehman-Brown
We've Never Done This Before
2019 • Enterprise Experience 2019
Gold
Bria Alexander
Theme 1 Intro
2024 • DesignOps Summit 2024
Gold
Mark Interrante
Collaboration Flows in Product Development
2017 • Enterprise Experience 2017
Gold

More Videos

Sofía Delsordo

"Working at a government institution isn’t linear. Some projects might work out. Some simply won’t."

Sofía Delsordo Kassim Vera

Public Policy for Jalisco's Designers to Make Design Matter

December 8, 2021

"We are like three legs of a chair: product, engineer, and UX all contribute to stability."

Product and Design at Bloomberg: A 15-year Evolution

December 6, 2022

Liza Pemstein

"We don’t have dedicated user researchers, but designers and PMs conduct most research here."

Liza Pemstein Jane Davis

Scaling Research Via an Ops First Model at Clever

March 27, 2023

Kara Kane

"Design ideas come back around again and again, waiting for leadership or new contexts to take root."

Kara Kane

Theme One Intro

November 16, 2022

Mark Interrante

"Nobody’s gonna listen to you people until you start speaking in the language of business."

Mark Interrante Harry Max

AI for Prioritization (3rd of 3 seminars)

July 11, 2024

Sam Proulx

"A good two-factor system offers multiple methods, like authenticator apps, calls, and texts, with generous timeouts."

Sam Proulx

Online Shopping: Designing an Accessible Experience

October 3, 2023

Rich Mironov

"Roadmap amnesia is real — every new thing wipes out weeks of priorities from stakeholders’ minds."

Rich Mironov

How Can Product Managers and UXers Help Each Other (and Why are Product Folks so Annoying Sometimes)?

December 6, 2022

Juhan Sonin

"For every dollar spent on cancer care, roughly four are spent on administration."

Juhan Sonin

Design Now! The Agenda for Action

September 4, 2025

Mansi Gupta

"In that moment, I looked down at my chest and failed to find a breast pocket of my own."

Mansi Gupta

Drawing from Feminist Practice to Make Inclusive Design Operational

September 9, 2022