Summary
Measuring DesignOps value is surprisingly complicated. Many practitioners would agree with the sentiment that measuring their impact feels aspirational at best, and theoretical at worst. Anecdotal evidence and praise from partners (“I don't know what we’d do without you!”) is nice, but doesn’t add up to proof that DesignOps is a worthy return on investment. In this talk, we’ll share two novel approaches to measuring DesignOps success from our upcoming book, The Design Conductors: Your Essential Guide to Design Operations. These methods–the “Jobs to Be Done” and “HEROES” frameworks–can be used to uncover and define measures of value that more accurately capture the impact DesignOps (and design) has on a business and its stakeholders. We will also share some tested rubrics that DesignOps can use to prioritize and implement these new measures.
Key Insights
-
•
Measuring design ops value is inherently difficult due to fluid goals, small teams, and reliance on outdated business metrics.
-
•
Traditional business measurement frameworks often fail to capture the human-centered impact of design ops.
-
•
Jobs to Be Done framework helps design ops understand and measure the real 'jobs' their stakeholders need accomplished, focusing on outcomes rather than tools or processes.
-
•
The Hero’s Framework divides design ops impact into six categories—Health, Effectiveness, Readiness, Outcomes, Ecosystem, and Sentiment—covering broad organizational and societal value.
-
•
Prioritizing what to measure is critical; not all metrics indicate meaningful impact, so teams must focus on what aligns with their organization’s mission and context.
-
•
Design ops metrics can overlap with those used by design management and other functions, and this overlap is acceptable and can show broader organizational value.
-
•
Organizational context, such as expansion versus contraction phases, affects which design ops metrics should be prioritized for maximum impact.
-
•
Outcome-driven factors encourage teams to focus on improving metrics over time rather than static measurements, driving progress and tangible improvements.
-
•
Making design ops work visible at every organizational level is more effective for securing investment than endless justification.
-
•
Practical application of these frameworks, like the Gen AI Summer Camp case, shows how design ops can boost team readiness and use measurable data to demonstrate impact to leadership.
Notable Quotes
"Measuring wrong can cost you a half billion dollars, but also what you measure and how you measure matters a lot."
"Design ops isn’t rocket science, but between us it might actually be harder."
"Design ops is a flexible and adaptable practice, meaning our goals and our outcomes are usually more fluid than stable."
"Applying traditional business frameworks to design ops is like trying to fit a star in a box."
"Design teams don’t want to buy a design ops drill. They need a quarter inch hole that requires a little bit of program management."
"Healthy teams are the foundation of a healthy organization."
"Visibility is the most vital thing for UX leaders to be focused on."
"Endlessly justifying yourself rarely changes others’ opinions. It just positions design ops as something that’s up for debate."
"We choose to measure design ops value not because it is easy, but because it is hard."
"Narrowing your measures through the lens of organizational factors will help focus on what matters and refining them makes them durable and lasting."
Or choose a question:
More Videos
"We speak in storytelling and myths because that language is universal and can tie teams together across cultures."
This Game is Never Done: Design Leadership Techniques from the Video Game World
November 6, 2017
"Diagramming is this kindness that we give to ourselves to get our bearing on something that we're stuck on."
Abby CovertStuck? Diagrams Help (Videoconference)
October 27, 2022
"Some minorities have had to develop flexibility and adaptability, which can be both a burden and a source of power."
Steve Portigal Susan Simon-Daniels Tamara Hale Randolph Duke IIWar Stories LIVE! Q&A-Discussion
March 30, 2020
"Design culture is about creating ways for people to collaborate, sharing tools, language, and practice."
Kara KaneCommunities of Practice for Civic Design (Videoconference)
April 7, 2022
"Demand for user research is really increasing – we hear about 70% growth, fueled by digital disruption and the pandemic."
Caroline VizeThe State of UX: Five Lessons from 2021 to Accelerate Digital Experience in 2022
March 9, 2022
"Staying true to yourself and what you really like doing is essential as your career grows."
Lada GorlenkoTheme 3: Introduction
June 10, 2021
"We’re the solution — people like you and me can ensure harmful AI mistakes don’t keep happening."
Jay BustamanteNavigating the Ethical Frontier: DesignOps Strategies for Responsible AI Innovation
October 2, 2023
"Designers often said, I didn’t realize research was this hard, or more humorously, what you go through is traumatic."
Marjorie Stainback Kelsey KingmanTransforming Strategic Research Capacity through Democratization
October 24, 2019
"We need to handle our own stuff first to give others permission to show up as human at work."
Rachael Dietkus, LCSW Uday Gajendar Dr. Dawn Emerick Dawn E. Shedrick, LCSWLeading through the long tail of trauma (Videoconference)
July 13, 2022