Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

UX Metrics That Matter and The Future of our Design at Scale Conference: A Community Conversation (Videoconference)
Thursday, September 22, 2022 • Enterprise Community
Share the love for this talk
UX Metrics That Matter and The Future of our Design at Scale Conference: A Community Conversation (Videoconference)
Speakers: Jack Moffett
Link:

Summary

At our September Enterprise Experience Community call, we host a double-header of topics — “UX metrics that matter” and “The future of our conference”. First, we have Jack Moffett, well-known design leader currently at Boeing, in a conversation about identifying and advocating for measurable user experience for enterprise apps and services.

Key Insights

  • UX metrics teams serve as internal service organizations helping product teams define, collect, and act on user data.

  • Leadership often fixates on target scores like NPS, but focusing on improvement trends from current baselines is more productive.

  • Diagnostic metrics establish where you are; predictive metrics guide investment and feature development decisions.

  • Triangulating multiple data sources and metrics, quantitative and qualitative, provides deeper understanding than single measures.

  • User success metrics differ from usage or adoption metrics; success means users achieve their goals, not just increased usage.

  • UX research and analytics must be integrated early and continuously in agile workflows, working ahead of development sprints.

  • There is a socio-political dimension to data where cultural attitudes impact how metrics are received and acted upon.

  • UX influence requires persuasive storytelling and connecting design impact directly to business objectives like revenue or compliance.

  • Enterprise UX is evolving from focusing solely on designers to including cross-functional roles like marketing, sales, and QA.

  • Leadership often understands the value of UX but lacks concrete tools and processes to operationalize and scale it effectively.

Notable Quotes

"It’s less productive to set a fixed goal like 85 NPS than to focus on improving from where we are now and track the trend."

"Success is not delivering software, success is whether users can actually do what the product helps them do."

"You can’t just pick one metric; you have to triangulate multiple data points to learn what to do next."

"Collecting the data is great, but making it actionable and prioritizing changes based on it is the real challenge."

"The analytics team isn’t yet deeply involved in roadmap prioritization but aims to influence teams to do so."

"UX has become equated to UI by many, but UX is the whole product and the entire user experience ecosystem."

"We have to influence both up and across the organization—c-suite and cross-functional peers—to show UX value."

"There’s a cultural aspect to handling metrics; negative scores can lead to blame or learning depending on mindset."

"Embedding metrics and analytics in product development plans needs to be baked in at key points, not an afterthought."

"Distributing design into the organization is more effective for business outcomes than just increasing designer headcount."

Ask the Rosenbot
Jemma Ahmed
Theme 2 Intro
2024 • Enterprise Experience 2020
Gold
Sylvie Abookire
A Civic Designer's Guide to Mindful Conflict Navigation
2022 • Civic Design 2022
Gold
Dave Hora
A Research Skills Evolution
2021 • Advancing Research 2021
Gold
Sarah Rink
Remote User Research: Dos and Don'ts from the Virtual Field (Videoconference)
2020 • Advancing Research Community
Cassandra Piester
Developing and Deploying Your Design Operations Strategy
2024 • DesignOps 2024
Gold
Saara Kamppari-Miller
Key Metrics: Comparing Three Letter Acronym Metrics That Include the Word “Key”
2024 • DesignOps Community
Peter Boersma
How to Define and Maintain a DesignOps Roadmap
2023 • DesignOps Summit 2023
Gold
Peter Merholz
Design at Scale is People!
2021 • Design at Scale 2021
Gold
Ignacio Martinez
Fair and Effective Designer Evaluation
2024 • DesignOps 2024
Gold
Sarah Williams
A Framework for CX Transformation
2021 • Design at Scale 2021
Gold
Changying (Z) Zheng
Navigating Innovation with Integrity
2024 • DesignOps 2024
Gold
Sofia Quintero
Beyond Tools: The Messy Business of Implementing Research Repositories
2022 • Advancing Research 2022
Gold
Louis Rosenfeld
Welcome / Housekeeping
2023 • Enterprise UX 2023
Gold
Milan Guenther
A Shared Language for Co-Creating Ambitious Endeavours
2023 • Enterprise UX 2023
Gold
Lisa Spitz
Building Trust Through Equitable Research Practices
2022 • Civic Design 2022
Gold
Brad Peters
Short Take #1: UX/Product Lessons from Your Industry Peers
2022 • Design in Product 2022
Gold

More Videos

Verónica Urzúa

"If we create gaps, that means our space for change is what we want and need to do here in Latin America."

Verónica Urzúa Jorge Montiel

The B-side of the Research Impact

March 12, 2021

Michal Anne Rogondino

"The satellite systems are built in stovepipes, completely disconnected and siloed between different contractors."

Michal Anne Rogondino

Saving Outer Space: The First UX Design System for Our Nation’s Satellites

January 8, 2024

Jemma Ahmed

"The insight field is looking at itself as almost at a tipping point."

Jemma Ahmed

Theme 2 Intro

March 10, 2022

Kara Kane

"An ecosystem of organizations working towards similar aims has really grown, especially in the US."

Kara Kane

Theme One Intro

November 16, 2022

Laine Riley Prokay

"We updated gender-coded words to make the competencies gender-neutral using a tool called the Gender Decoder."

Laine Riley Prokay

How DesignOps can Drive Inclusive Career Ladders for All

September 30, 2021

Laura Gatewood

"Heart-based communication makes better trust, better communities, better connection."

Laura Gatewood Laine Prokay

Beyond Buzzwords: Adding Heart to Effective Slack Communication

September 23, 2024

Caitlyn Hampton

"Architecture is like the original UX because it teaches you about user experience through spatial design."

Caitlyn Hampton Monica Lee Jina Yoon

Compass 101: Growing Your Career In A Startup World

June 11, 2021

Hana Nagel

"It’s not incumbent upon you to finish making this world a better place, but neither are you free to desist from it."

Hana Nagel

Turning Research Ripples into Waves

November 8, 2018

Alexandra Schmidt

"Legacy interconnected systems mean solving one problem can create problems elsewhere."

Alexandra Schmidt

Enterprise UX Playbook (Videoconference)

December 1, 2022