Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

UX Metrics That Matter and The Future of our Design at Scale Conference: A Community Conversation (Videoconference)
Thursday, September 22, 2022 • Enterprise Community
Share the love for this talk
UX Metrics That Matter and The Future of our Design at Scale Conference: A Community Conversation (Videoconference)
Speakers: Jack Moffett
Link:

Summary

At our September Enterprise Experience Community call, we host a double-header of topics — “UX metrics that matter” and “The future of our conference”. First, we have Jack Moffett, well-known design leader currently at Boeing, in a conversation about identifying and advocating for measurable user experience for enterprise apps and services.

Key Insights

  • UX metrics teams serve as internal service organizations helping product teams define, collect, and act on user data.

  • Leadership often fixates on target scores like NPS, but focusing on improvement trends from current baselines is more productive.

  • Diagnostic metrics establish where you are; predictive metrics guide investment and feature development decisions.

  • Triangulating multiple data sources and metrics, quantitative and qualitative, provides deeper understanding than single measures.

  • User success metrics differ from usage or adoption metrics; success means users achieve their goals, not just increased usage.

  • UX research and analytics must be integrated early and continuously in agile workflows, working ahead of development sprints.

  • There is a socio-political dimension to data where cultural attitudes impact how metrics are received and acted upon.

  • UX influence requires persuasive storytelling and connecting design impact directly to business objectives like revenue or compliance.

  • Enterprise UX is evolving from focusing solely on designers to including cross-functional roles like marketing, sales, and QA.

  • Leadership often understands the value of UX but lacks concrete tools and processes to operationalize and scale it effectively.

Notable Quotes

"It’s less productive to set a fixed goal like 85 NPS than to focus on improving from where we are now and track the trend."

"Success is not delivering software, success is whether users can actually do what the product helps them do."

"You can’t just pick one metric; you have to triangulate multiple data points to learn what to do next."

"Collecting the data is great, but making it actionable and prioritizing changes based on it is the real challenge."

"The analytics team isn’t yet deeply involved in roadmap prioritization but aims to influence teams to do so."

"UX has become equated to UI by many, but UX is the whole product and the entire user experience ecosystem."

"We have to influence both up and across the organization—c-suite and cross-functional peers—to show UX value."

"There’s a cultural aspect to handling metrics; negative scores can lead to blame or learning depending on mindset."

"Embedding metrics and analytics in product development plans needs to be baked in at key points, not an afterthought."

"Distributing design into the organization is more effective for business outcomes than just increasing designer headcount."

Ask the Rosenbot
Tracy McGoldrick
IBM User Experience Program—The What, Why and How (Videoconference)
2021 • Advancing Research Community
Feleesha Sterling
Building a Rapid Research Program (Videoconference)
2023 • Enterprise Community
Ariel Kennan
Building a Design Culture
2017 • Enterprise Experience 2017
Gold
Kelly Dern
AI as a Design Partner: How to Get the Most Out of AI Tools to Scale Your Process
2023 • DesignOps Summit 2023
Gold
Hana Nagel
Turning Research Ripples into Waves
2018 • DesignOps Summit 2018
Gold
Sam Ladner
Data Exhaust and Personal Data: Learning from Consumer Products to Enhance Enterprise UX
2016 • Enterprise UX 2016
Gold
Sheryl Cababa
Day 2 Panel
2024 • Designing with AI 2024
Gold
Nancy Douyon
We'll Figure That Out in the Next Launch: Enterprise Tech's Nobility Complex
2018 • Enterprise Experience 2018
Gold
Scaling Design through Relationship Maps
2017 • DesignOps Summit 2017
Gold
Josh Clark
Sentient Design: New Postures for AI-Mediated Experiences (2nd of 3 seminars)
2025 • Rosenfeld Community
Sarah Kinkade
Design Management Models in the Face of Transformation
2022 • Design at Scale 2022
Gold
Crystal Yan
Building a Customer-Centric Culture
2020 • Advancing Research 2020
Gold
Jeff Gothelf
The Intersection of Lean and Design (Videoconference)
2019 • Enterprise Community
Sahibzada Mayed
Cultivating Design Ecologies of Care, Community, and Collaboration
2023 • DesignOps Summit 2023
Gold
Yolanda Rankin
Black Feminist Epistemology as a Critical Framework for Equitable Design
2021 • Advancing Research 2021
Gold
Dr. Jamika D. Burge
The Future of Research: Bridging the Gaps (Videoconference)
2021 • Advancing Research Community

More Videos

"Many designers feel overwhelmed by hundreds of expected skills, which creates paralysis about where to focus."

Shaping design, designers and teams

November 8, 2018

Sabrina Mach

"Bringing design on an equal eye level with technology and business is the starting point."

Sabrina Mach Nina Wainwright

How to Design Your Design Operating Model

September 29, 2021

Samuel Proulx

"AI isn’t naturally testable like traditional code, so service design will become even more important."

Samuel Proulx

Invisible barriers: Why accessible service design can’t be an afterthought

December 3, 2024

Saara Kamppari-Miller

"Accessibility is not just a checklist item that needs to be checked before something ships, it’s a methodology embedded from the start."

Saara Kamppari-Miller

DesignOps for Inclusive Design and Accessibility (Videoconference)

May 26, 2022

Briana Thomas

"We decided to let it rip with clarity about who we were as a team and what we wanted to achieve."

Briana Thomas

The Quiet Force: Uncovering Hidden Leadership in High-Impact Design Teams

September 24, 2024

Adam Cutler

"You need strong regional players with negotiation skills to navigate the split loyalties in global teams."

Adam Cutler Karen Pascoe Ian Swinson Susan Worthman

Discussion

June 8, 2016

"I’m hoping that once we figure this out, I can kind of go back to my old goal and break those rules."

Operationalizing DesignOps

November 7, 2018

Leah Buley

"No VP cares about your research report; they want to know what this means for the business risks and decisions."

Leah Buley Joe Natoli

Ask Me Anything with Leah Buley and Joe Natoli, co-authors of The User Experience Team of One (2nd edition)

October 8, 2024

Nathan Shedroff

"Living personas refreshed constantly with new research allow others to connect with real customer behaviors."

Nathan Shedroff

Double Your Mileage: Use Your Research Strategically

March 31, 2020