Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

UX Metrics That Matter and The Future of our Design at Scale Conference: A Community Conversation (Videoconference)
Thursday, September 22, 2022 • Enterprise Community
Share the love for this talk
UX Metrics That Matter and The Future of our Design at Scale Conference: A Community Conversation (Videoconference)
Speakers: Jack Moffett
Link:

Summary

At our September Enterprise Experience Community call, we host a double-header of topics — “UX metrics that matter” and “The future of our conference”. First, we have Jack Moffett, well-known design leader currently at Boeing, in a conversation about identifying and advocating for measurable user experience for enterprise apps and services.

Key Insights

  • UX metrics teams serve as internal service organizations helping product teams define, collect, and act on user data.

  • Leadership often fixates on target scores like NPS, but focusing on improvement trends from current baselines is more productive.

  • Diagnostic metrics establish where you are; predictive metrics guide investment and feature development decisions.

  • Triangulating multiple data sources and metrics, quantitative and qualitative, provides deeper understanding than single measures.

  • User success metrics differ from usage or adoption metrics; success means users achieve their goals, not just increased usage.

  • UX research and analytics must be integrated early and continuously in agile workflows, working ahead of development sprints.

  • There is a socio-political dimension to data where cultural attitudes impact how metrics are received and acted upon.

  • UX influence requires persuasive storytelling and connecting design impact directly to business objectives like revenue or compliance.

  • Enterprise UX is evolving from focusing solely on designers to including cross-functional roles like marketing, sales, and QA.

  • Leadership often understands the value of UX but lacks concrete tools and processes to operationalize and scale it effectively.

Notable Quotes

"It’s less productive to set a fixed goal like 85 NPS than to focus on improving from where we are now and track the trend."

"Success is not delivering software, success is whether users can actually do what the product helps them do."

"You can’t just pick one metric; you have to triangulate multiple data points to learn what to do next."

"Collecting the data is great, but making it actionable and prioritizing changes based on it is the real challenge."

"The analytics team isn’t yet deeply involved in roadmap prioritization but aims to influence teams to do so."

"UX has become equated to UI by many, but UX is the whole product and the entire user experience ecosystem."

"We have to influence both up and across the organization—c-suite and cross-functional peers—to show UX value."

"There’s a cultural aspect to handling metrics; negative scores can lead to blame or learning depending on mindset."

"Embedding metrics and analytics in product development plans needs to be baked in at key points, not an afterthought."

"Distributing design into the organization is more effective for business outcomes than just increasing designer headcount."

Ask the Rosenbot
Michelle Bejian Lotia
Rolling Out a Repository: How Zapier Centralizes Insights from Across their Organization
2023 • Advancing Research 2023
Gold
Chris Geison
Theme 1 Intro
2022 • Advancing Research 2022
Gold
Jacqui Frey
Scale is Social Work (Videoconference)
2020 • DesignOps Community
Lori Muszynski
Keeping Design Weird
2023 • DesignOps Summit 2023
Gold
Kate Kalcevich
Integrating Accessibility in DesignOps
2024 • DesignOps 2024
Gold
Kat Vellos
Opener: The Other L Word
2024 • DesignOps Summit 2020
Gold
Sam Ladner
Methodologies: Beyond the interview [Advancing Research Community Workshop Series]
2024 • Advancing Research Community
Rob Mitzel
The Tale of Two Companies: Building a Successful UX Practice in a Century-Old Enterprise
2024 • Enterprise Experience 2020
Gold
Husani Oakley
Theme Two Intro
2023 • Enterprise UX 2023
Gold
Kevin Bethune
Reimagining Design: Unlocking Strategic Innovation
2022 • Design at Scale 2022
Gold
Saara Kamppari-Miller
"Prototype" vs "Prototype"--Breaking Down and Rebuilding Our Understanding of What We Do
2019 • DesignOps Summit 2019
Gold
Leah Buley
Ask Me Anything with Leah Buley and Joe Natoli, co-authors of The User Experience Team of One (2nd edition)
2024 • Rosenfeld Community
Greg Petroff
The Compass Mission
2021 • Advancing Research 2021
Gold
Bria Alexander
Opening Remarks
2021 • DesignOps Summit 2021
Gold
Kelly Dern
AI as a Design Partner: How to Get the Most Out of AI Tools to Scale Your Process
2023 • DesignOps Summit 2023
Gold
Civic Design in 2022 (Videoconference)
2022 • Civic Design Community

More Videos

Jennifer Kanyamibwa

"Resiliency for me is not really a professional thing. It’s a lot more personal."

Jennifer Kanyamibwa

Creating the Blueprint: Growing and Building Design Teams

November 8, 2018

Brigette Metzler

"Research repositories and libraries are social things."

Brigette Metzler Dana Chrisfield

Research Repositories: A global project by the ResearchOps Community (Videoconference)

August 27, 2020

Carl Turner

"I like to engage my stakeholders as co-creators and co-discoverers because that makes persuasion so much easier."

Carl Turner

You Can Do This: Understand and Solve Organizational Problems to Jumpstart a Dead Project

March 28, 2023

John Mortimer

"People appreciate when you acknowledge your limitations in blending into an organization."

John Mortimer Milan Guenther Lucy Ellis Patrick Quattlebaum

Panel Discussion

December 3, 2024

Dante Guintu

"My superpower is to connect the dots between people, places, ideas, and opportunities."

Dante Guintu

How to Crush the Talent Crunch

September 8, 2022

Richard Buchanan

"Creativity means a change in perception, from the familiar to the unfamiliar, even initially ridiculous."

Richard Buchanan

Creativity and Principles in the Flourishing Enterprise

June 15, 2018

Dan Willis

"The last of long time, we end up in bars late at night, exhausted but happy from all the conversations and learning."

Dan Willis

Theme 3: Intro

January 8, 2024

Dan Ward

"We don’t celebrate failure; we celebrate the attempt and risk-taking."

Dan Ward

Failure Friday #1 with Dan Ward

February 7, 2025

Chris Geison

"What got us here won’t get us where we want to go."

Chris Geison

Theme Two Intro

March 28, 2023