Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

UX Metrics That Matter and The Future of our Design at Scale Conference: A Community Conversation (Videoconference)
Thursday, September 22, 2022 • Enterprise Community
Share the love for this talk
UX Metrics That Matter and The Future of our Design at Scale Conference: A Community Conversation (Videoconference)
Speakers: Jack Moffett
Link:

Summary

At our September Enterprise Experience Community call, we host a double-header of topics — “UX metrics that matter” and “The future of our conference”. First, we have Jack Moffett, well-known design leader currently at Boeing, in a conversation about identifying and advocating for measurable user experience for enterprise apps and services.

Key Insights

  • UX metrics teams serve as internal service organizations helping product teams define, collect, and act on user data.

  • Leadership often fixates on target scores like NPS, but focusing on improvement trends from current baselines is more productive.

  • Diagnostic metrics establish where you are; predictive metrics guide investment and feature development decisions.

  • Triangulating multiple data sources and metrics, quantitative and qualitative, provides deeper understanding than single measures.

  • User success metrics differ from usage or adoption metrics; success means users achieve their goals, not just increased usage.

  • UX research and analytics must be integrated early and continuously in agile workflows, working ahead of development sprints.

  • There is a socio-political dimension to data where cultural attitudes impact how metrics are received and acted upon.

  • UX influence requires persuasive storytelling and connecting design impact directly to business objectives like revenue or compliance.

  • Enterprise UX is evolving from focusing solely on designers to including cross-functional roles like marketing, sales, and QA.

  • Leadership often understands the value of UX but lacks concrete tools and processes to operationalize and scale it effectively.

Notable Quotes

"It’s less productive to set a fixed goal like 85 NPS than to focus on improving from where we are now and track the trend."

"Success is not delivering software, success is whether users can actually do what the product helps them do."

"You can’t just pick one metric; you have to triangulate multiple data points to learn what to do next."

"Collecting the data is great, but making it actionable and prioritizing changes based on it is the real challenge."

"The analytics team isn’t yet deeply involved in roadmap prioritization but aims to influence teams to do so."

"UX has become equated to UI by many, but UX is the whole product and the entire user experience ecosystem."

"We have to influence both up and across the organization—c-suite and cross-functional peers—to show UX value."

"There’s a cultural aspect to handling metrics; negative scores can lead to blame or learning depending on mindset."

"Embedding metrics and analytics in product development plans needs to be baked in at key points, not an afterthought."

"Distributing design into the organization is more effective for business outcomes than just increasing designer headcount."

Ask the Rosenbot
Saara Kamppari-Miller
Theme Three Intro
2022 • DesignOps Summit 2022
Gold
Paula Bach
Improving Legacy Software: How Much Better Does it Have to Be?
2022 • Advancing Research 2022
Gold
Jay Bustamante
Navigating the Ethical Frontier: DesignOps Strategies for Responsible AI Innovation
2023 • DesignOps Summit 2023
Gold
Michele Marut
Research Repositories Reconsidered (Videoconference)
2019 • DesignOps Community
Matt Bernius
Trauma-informed Research: A Panel Discussion (Videoconference)
2021 • Advancing Research Community
Kayla Farrell
What It's Like To Be a User Researcher at Compass
2021 • Advancing Research 2021
Gold
Andrew Michael
Building a Product Insights Team
2022 • Advancing Research 2022
Gold
Greg Petroff
Design is the Differentiator: Bringing New Design Innovations to a Very Antiquated and Very Large Industry
2021 • Design at Scale 2021
Gold
Kate Kalcevich
Designing inclusively with AI
2024 • Designing with AI 2024
Gold
Sam Ladner
Data Exhaust and Personal Data: Learning from Consumer Products to Enhance Enterprise UX
2016 • Enterprise UX 2016
Gold
Mohammad Hossein Jarrahi
Contextuality problem: Exploring the Benefits of Qualitative and Quantitative Research
2023 • QuantQual Interest Group (Rosenfeld Community)
Katy Mogal
But Do Your Insights Scale?
2021 • Advancing Research 2021
Gold
Anat Fintzi
Delivering at Scale: Making Traction with Resistant Partners
2022 • Design at Scale 2022
Gold
Devon Powers
Imagining Better Futures
2022 • Advancing Research 2022
Gold
Robert Reimann
Taming Design Complexity with UX Models
2017 • Enterprise Experience 2017
Gold
Yoel Sumitro
Actions and Reflections: Bridging the Skills Gap among Researchers
2022 • Advancing Research 2022
Gold

More Videos

Alex Hurworth

"Restoration is not just about replanting trees; it’s about rebuilding entire ecosystems."

Alex Hurworth Bonnie John Fahd Arshad Antoine Marin

Designing a Contact Tracing App for Universal Access

October 23, 2020

Laine Riley Prokay

"It’s really okay if this new position on your team is short-term only; we can provide the initial opportunity to get started on their career paths."

Laine Riley Prokay Lisa Gordon

Carving a Path for Early Career DesignOps Practitioners

September 9, 2022

Eniola Oluwole

"Everyone wanted to know what was the official pattern and who was accountable for it."

Eniola Oluwole

Lessons From the DesignOps Journey of the World's Largest Travel Site

October 24, 2019

Nathan Shedroff

"You need to learn the vocabulary, tools, and processes your peers know and understand where they are inadequate."

Nathan Shedroff

Double Your Mileage: Use Your Research Strategically

March 31, 2020

Sam Proulx

"Mobile browsers are typically updated with the OS, reducing variability compared to desktop browser versions."

Sam Proulx

Mobile Accessibility: Why Moving Accessibility Beyond the Desktop is Critical in a Mobile-first World

November 17, 2022

Feleesha Sterling

"Product and design teams are usually the best initial stakeholders to engage for rapid research programs."

Feleesha Sterling

Building a Rapid Research Program (Videoconference)

May 18, 2023

Neil Barrie

"Brand and product become two sides of the same coin when user insights have a seat at the top table."

Neil Barrie

Widening the Aperture: The Case for Taking a Broader Lens to the Dialogue between Products and Culture

March 25, 2024

John Devanney

"Most organizations know they need to evaluate impact, but very few have effective ways to do it."

John Devanney

The Design Management Office

November 6, 2017

Katy Mogal

"Surveys and logs tell us what users do, but qualitative tells us why."

Katy Mogal

But Do Your Insights Scale?

March 12, 2021