Group Activity: A Deep Dive Into Value and Outcomes
Summary
In this group exercise, we’ll identify techniques, tactics, and tools for proving (and even measuring) value, and describing the outcomes that matter most.
Key Insights
-
•
62% of surveyed design ops professionals admit they haven’t figured out how to measure value effectively yet.
-
•
Common barriers to measuring design ops value include limited time/resources, difficulty involving the right stakeholders, and a lack of proven metrics.
-
•
Measuring value in design ops is complicated by each organization’s unique constraints and its stage on the design ops maturity journey.
-
•
Behavioral resistance can undermine measurement efforts, such as inconsistent or inaccurate time tracking despite its importance.
-
•
Non-financial and sentiment-based measurements are crucial as data alone often misses behavioral context.
-
•
Established frameworks like Google’s HEART and Facebook’s mixed methods provide adaptable foundations for design measurement.
-
•
An eight-type taxonomy of design ops measurement emerged from research and community input, organized around people, practice, and platform domains.
-
•
Effective measurement frameworks link activities to predictable outcomes (like happier designers, better designers, and more effective teams) enabling targeted metrics.
-
•
Retention and staffing remain central concerns tied to measuring design ops impact; qualitative tactics like stay interviews yield actionable insights.
-
•
Community collaboration and shared standards for design ops measurement are essential to evolving beyond the 'we don’t know yet' phase.
Notable Quotes
"When I was asked how I measure success, I said the day I no longer have to convince you."
"62% of people said literally we don't know how to measure the value of design ops yet."
"Limited time and money is not unique to design ops; it’s every single function I’ve ever seen."
"People really hated using Harvest to log billable hours, some just put the same hours week after week."
"Non-financial, non-data measurements can reveal much more about behaviors than traditional metrics."
"Google’s HEART framework is great because different teams—engineering, product, and design—can all use it."
"We have an eight-type framework for measuring design ops, but it’s a starting point, design ops is never done."
"You can’t have effective teams without happy designers and better designers; they’re interdependent."
"Stay interviews ask why people choose to stay, which provides more actionable retention data than exit interviews."
"Our call to action is to co-create these measurement standards together and share back to the community."
Or choose a question:
More Videos
"The rebrand caused our NPS to plummet and freaked out our executives — that was the trigger to get serious."
Shipra KayanHow we Built a VoC (Voice of the Customer) Practice at Upwork from the Ground Up
September 30, 2021
"When you’re in a culture that celebrates complexity, making things simple is still a very hard thing to do."
Peter MorvilleThe Architecture of Understanding
May 13, 2015
"I was able to connect the dots a lot for the UX team because I had those relationships from customer success."
Renee ReidBecoming a ResearchH.E.R (Highly Enterprise Ready)
June 3, 2019
"Physical therapists see their hands as a golden resource and tend to resist technology that might replace that."
Dane DeSutterKeeping the Body in Mind: What Gestures and Embodied Actions Tell You That Users May Not
March 26, 2024
"A good two-factor system offers multiple methods, like authenticator apps, calls, and texts, with generous timeouts."
Sam ProulxOnline Shopping: Designing an Accessible Experience
October 3, 2023
"While technical errors matter, broader issues like content relevance and navigation create more mission failures."
Andrew Custage Michael MallettThe Digital Journey: Research on Consumer Frustration and Loyalty
March 29, 2023
"Persisting conversations in Slack instead of Zoom chat means folks can revisit and join conversations asynchronously."
Shelby SwitzerMaking Space for Community Knowledge-sharing in a Distributed World
December 10, 2021
"More than a third of content on social media sites is AI generated, creating a training problem for new AI models."
Llewyn PaineCoexisting with AI: A practical guide for researchers to navigate tools, ethics, and integration
March 11, 2025
"Simon Roberts calls this the UX ification of research, which leads to a more transactional focus on informing technology requirements."
Robin BeersNavigating organizational systems: Rethinking researcher’s role in driving change
March 13, 2025
