Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

UX Metrics That Matter and The Future of our Design at Scale Conference: A Community Conversation (Videoconference)
Thursday, September 22, 2022 • Enterprise Community
Share the love for this talk
UX Metrics That Matter and The Future of our Design at Scale Conference: A Community Conversation (Videoconference)
Speakers: Jack Moffett
Link:

Summary

At our September Enterprise Experience Community call, we host a double-header of topics — “UX metrics that matter” and “The future of our conference”. First, we have Jack Moffett, well-known design leader currently at Boeing, in a conversation about identifying and advocating for measurable user experience for enterprise apps and services.

Key Insights

  • UX metrics teams serve as internal service organizations helping product teams define, collect, and act on user data.

  • Leadership often fixates on target scores like NPS, but focusing on improvement trends from current baselines is more productive.

  • Diagnostic metrics establish where you are; predictive metrics guide investment and feature development decisions.

  • Triangulating multiple data sources and metrics, quantitative and qualitative, provides deeper understanding than single measures.

  • User success metrics differ from usage or adoption metrics; success means users achieve their goals, not just increased usage.

  • UX research and analytics must be integrated early and continuously in agile workflows, working ahead of development sprints.

  • There is a socio-political dimension to data where cultural attitudes impact how metrics are received and acted upon.

  • UX influence requires persuasive storytelling and connecting design impact directly to business objectives like revenue or compliance.

  • Enterprise UX is evolving from focusing solely on designers to including cross-functional roles like marketing, sales, and QA.

  • Leadership often understands the value of UX but lacks concrete tools and processes to operationalize and scale it effectively.

Notable Quotes

"It’s less productive to set a fixed goal like 85 NPS than to focus on improving from where we are now and track the trend."

"Success is not delivering software, success is whether users can actually do what the product helps them do."

"You can’t just pick one metric; you have to triangulate multiple data points to learn what to do next."

"Collecting the data is great, but making it actionable and prioritizing changes based on it is the real challenge."

"The analytics team isn’t yet deeply involved in roadmap prioritization but aims to influence teams to do so."

"UX has become equated to UI by many, but UX is the whole product and the entire user experience ecosystem."

"We have to influence both up and across the organization—c-suite and cross-functional peers—to show UX value."

"There’s a cultural aspect to handling metrics; negative scores can lead to blame or learning depending on mindset."

"Embedding metrics and analytics in product development plans needs to be baked in at key points, not an afterthought."

"Distributing design into the organization is more effective for business outcomes than just increasing designer headcount."

Ask the Rosenbot
Farid Sabitov
Theme Four Intro
2022 • DesignOps Summit 2022
Gold
Sahibzada Mayed
Cultivating Design Ecologies of Care, Community, and Collaboration
2023 • DesignOps Summit 2023
Gold
Catt Small
Moving from Execution to Strategy as a Designer
2022 • Design in Product 2022
Gold
Deanna Smith
Leading Change with Confidence: Strategies for Optimizing Your Process
2024 • DesignOps 2024
Gold
Indi Young
Paying Better Attention to the Problem with Indi Young (Videoconference)
2019 • Advancing Research Community
Nalini P. Kotamraju
Two Jobs in One: Being a “Leader who is a Researcher” and a “Researcher who is a Leader"
2021 • Advancing Research 2021
Gold
Adam Cutler
People + Places + Practices = Outcomes
2016 • Enterprise UX 2016
Gold
Kathleen Asjes
Research Democratization: the Good, the Bad and the Ugly
2022 • Advancing Research 2022
Gold
Joi Freeman
A New Vantage Point: Building a Pipeline for Multifaceted Research(ers)
2020 • Advancing Research 2020
Gold
Sheryl Cababa
Thinking in systems to address climate with Sheryl Cababa (Videoconference)
2024 • Climate UX Interest Group (Rosenfeld Community)
Alla Weinberg
Design Teams Need Psychological Safety: Here’s How to Create It
2022 • DesignOps Summit 2022
Gold
Sarah Gallimore
Inspire Progress with Artifacts from the Future
2022 • Civic Design 2022
Gold
Kristin Skinner
Theme 2: Introduction and Provocation
2024 • DesignOps Summit 2020
Gold
David Cronin
The GE Design System and Thoughts about Craft at Scale
2015 • Enterprise UX 2015
Gold
Chris Geison
Theme Two Intro
2023 • Advancing Research 2023
Gold
Louis Rosenfeld
Discussion: What Operations can teach DesignOps
2017 • DesignOps Summit 2017
Gold

More Videos

"Doctors hate using EHRs because it turns them into clerks, interacting more with machines than patients."

Standardizing Product Merits for Leaders, Designers, and Everyone

June 15, 2018

Simon Wardley

"There’s no such thing as one-size-fits-all methods; what works in one part of the map doesn’t work in another."

Simon Wardley

Maps and Topographical Intelligence (Videoconference)

January 31, 2019

Sandra Camacho

"The Twitter algorithm favored lighter skin tones when cropping images, reflecting racial bias in tech."

Sandra Camacho

Creating More Bias-Proof Designs

January 22, 2025

Darian Davis

"Taking responsibility starts with an apology and seeking regular feedback."

Darian Davis

Lessons from a Toxic Work Relationship

January 8, 2024

Fisayo Osilaja

"We mitigated data privacy risks by subscribing to the corporate plan for ChatGPT, which offers enhanced security."

Fisayo Osilaja

[Demo] The AI edge: From researcher to strategist

June 4, 2024

Uday Gajendar

"Nobody wants to buy or use a sloppy product, especially when enterprise users engage daily for hours."

Uday Gajendar

The Wicked Craft of Enterprise UX

May 13, 2015

Davis Neable

"There is no design team responsible for the overarching experience across the entire company."

Davis Neable Guy Segal

How to Drive a Design Project When you Don’t Have a Design Team

June 10, 2021

Eniola Oluwole

"We did a great cleanup of patterns from every decade and deleted anything off brand or untested."

Eniola Oluwole

Lessons From the DesignOps Journey of the World's Largest Travel Site

October 24, 2019

Aurobinda Pradhan

"Most of us in design are very process-oriented, but traditional devops tools are task and issue-centric, making collaboration hard."

Aurobinda Pradhan Shashank Deshpande

Introduction to Collaborative DesignOps using Cubyts

September 9, 2022