Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Meters, Miles, and Madness: New Frameworks to Measure the (Elusive) Value of DesignOps
Gold
Tuesday, September 24, 2024 • DesignOps 2024
Share the love for this talk
Meters, Miles, and Madness: New Frameworks to Measure the (Elusive) Value of DesignOps
Speakers: John Calhoun and Rachel Posman
Link:

Summary

Measuring DesignOps value is surprisingly complicated. Many practitioners would agree with the sentiment that measuring their impact feels aspirational at best, and theoretical at worst. Anecdotal evidence and praise from partners (“I don't know what we’d do without you!”) is nice, but doesn’t add up to proof that DesignOps is a worthy return on investment. In this talk, we’ll share two novel approaches to measuring DesignOps success from our upcoming book, The Design Conductors: Your Essential Guide to Design Operations. These methods–the “Jobs to Be Done” and “HEROES” frameworks–can be used to uncover and define measures of value that more accurately capture the impact DesignOps (and design) has on a business and its stakeholders. We will also share some tested rubrics that DesignOps can use to prioritize and implement these new measures.

Key Insights

  • Measuring design ops value is inherently difficult due to fluid goals, small teams, and reliance on outdated business metrics.

  • Traditional business measurement frameworks often fail to capture the human-centered impact of design ops.

  • Jobs to Be Done framework helps design ops understand and measure the real 'jobs' their stakeholders need accomplished, focusing on outcomes rather than tools or processes.

  • The Hero’s Framework divides design ops impact into six categories—Health, Effectiveness, Readiness, Outcomes, Ecosystem, and Sentiment—covering broad organizational and societal value.

  • Prioritizing what to measure is critical; not all metrics indicate meaningful impact, so teams must focus on what aligns with their organization’s mission and context.

  • Design ops metrics can overlap with those used by design management and other functions, and this overlap is acceptable and can show broader organizational value.

  • Organizational context, such as expansion versus contraction phases, affects which design ops metrics should be prioritized for maximum impact.

  • Outcome-driven factors encourage teams to focus on improving metrics over time rather than static measurements, driving progress and tangible improvements.

  • Making design ops work visible at every organizational level is more effective for securing investment than endless justification.

  • Practical application of these frameworks, like the Gen AI Summer Camp case, shows how design ops can boost team readiness and use measurable data to demonstrate impact to leadership.

Notable Quotes

"Measuring wrong can cost you a half billion dollars, but also what you measure and how you measure matters a lot."

"Design ops isn’t rocket science, but between us it might actually be harder."

"Design ops is a flexible and adaptable practice, meaning our goals and our outcomes are usually more fluid than stable."

"Applying traditional business frameworks to design ops is like trying to fit a star in a box."

"Design teams don’t want to buy a design ops drill. They need a quarter inch hole that requires a little bit of program management."

"Healthy teams are the foundation of a healthy organization."

"Visibility is the most vital thing for UX leaders to be focused on."

"Endlessly justifying yourself rarely changes others’ opinions. It just positions design ops as something that’s up for debate."

"We choose to measure design ops value not because it is easy, but because it is hard."

"Narrowing your measures through the lens of organizational factors will help focus on what matters and refining them makes them durable and lasting."

Ask the Rosenbot
Rachael Dietkus, LCSW
Leading through the long tail of trauma (Videoconference)
2022 • Enterprise Community
Anna Poznyakov
Get The Most Out Of Stakeholder Collaboration—and Maximize Your Research Impact
2021 • Advancing Research 2021
Gold
Greg Petroff
Software as Material—A Redux
2023 • Enterprise UX 2023
Gold
Bria Alexander
Opening Remarks
2021 • DesignOps Summit 2021
Gold
Bria Alexander
Opening Remarks
2021 • Design at Scale 2021
Gold
Adrian Howard
Sturgeon’s Biases
2024 • DesignOps 2024
Gold
Bria Alexander
Opening Remarks
2022 • DesignOps Summit 2022
Gold
Stephen Pollard
Closing Keynote: Getting giants to dance - what can we learn from designing large and complex public infrastructure?
2017 • DesignOps Summit 2017
Gold
Adam Cutler
Discussion
2016 • Enterprise UX 2016
Gold
Terry Buckman
Wargaming (An Introduction) (Videoconference)
2023 • Enterprise Community
Christian Madsbjerg
Influencing Strategy
2020 • Advancing Research 2020
Gold
Nick Cochran
Growing in Enterprise Design through Making Connections (Videoconference)
2019 • Enterprise Community
JD Buckley
COMMUNICATE: Discussion
2018 • Enterprise Experience 2018
Gold
Changying (Z) Zheng
Navigating Innovation with Integrity
2024 • DesignOps 2024
Gold
Dr. Jamika D. Burge
How UX researchers can partner with (and not be replaced by) AI [Advancing Research Community Workshop Series](Videoconference)
2023 • Advancing Research Community
Melinda Belcher
Insider preview of Enterprise Experience 2020 (Videoconference)
2020 • Enterprise Community

More Videos

Angelos Arnis

"It is imperative that we maintain hope, even when the harshness of reality may suggest the opposite. — Paola Freire"

Angelos Arnis

Navigating the Rapid Shifts in Tech's Turbulent Terrain

October 2, 2023

John Calhoun

"The eight competencies in design ops include trusted relationships, program management, leadership, communication, and business acumen."

John Calhoun Rachel Posman

Bring your DesignOps Story to Life! The Definitive DesignOps Book Jam

October 3, 2023

Alfred Kahn

"If you don’t measure, it’s like a tree falling in the forest with no one around to hear it."

Alfred Kahn

A Seat at the Table: Making Your Team a Strategic Partner

November 29, 2023

Dan Willis

"I should have brought you along on this journey instead of scheduling a big meeting — I was wrong."

Dan Willis

Enterprise Storytelling Sessions

June 3, 2019

John Maeda

"The pain you feel in driving change is the pain of growth—you have to sign up for it and keep going."

John Maeda Alison Rand

About Design Organizations (Videoconference)

May 13, 2019

Anat Fintzi

"Two-thirds of my Enterprise UX slack channel reported late or lost deliveries—an embarrassing result for such a large company."

Anat Fintzi Rachel Minnicks

Delivering at Scale: Making Traction with Resistant Partners

June 9, 2022

Uday Gajendar

"Nobody wants to buy or use a sloppy product, especially when enterprise users engage daily for hours."

Uday Gajendar

The Wicked Craft of Enterprise UX

May 13, 2015

Kristin Skinner

"We recognized recurring challenges: lack of visibility, proving value, and coordinating across teams."

Kristin Skinner

Theme 1 Intro

September 29, 2021

Maish Nichani

"Singapore is a nation by design. Nothing we have today is natural or happened by itself—somebody thought about it and made it happen."

Maish Nichani

Sparking a Service Excellence Mindset at a Government Agency

December 9, 2021