Rosenverse
Group Activity: A Deep Dive Into Value and Outcomes

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Group Activity: A Deep Dive Into Value and Outcomes

Gold
Wednesday, October 23, 2019 • DesignOps Summit 2019
Share the love for this talk
Group Activity: A Deep Dive Into Value and Outcomes
Speakers: Kristin Skinner and Kamdyn Moore
Link:

Summary

DesignOps as a practice is still relatively new—but the activities have been around long enough that we’re increasingly challenged to justify and quantify what we do. Accordingly, we need to address not just what is DesignOps, but how do we prove its value? What outcomes can we genuinely promise? And how do we know we are successful? In this group exercise, we’ll identify techniques, tactics, and tools for proving (and even measuring) value, and describing the outcomes that matter most.

Key Insights

  • 62% of surveyed design ops professionals admit they haven’t figured out how to measure value effectively yet.

  • Common barriers to measuring design ops value include limited time/resources, difficulty involving the right stakeholders, and a lack of proven metrics.

  • Measuring value in design ops is complicated by each organization’s unique constraints and its stage on the design ops maturity journey.

  • Behavioral resistance can undermine measurement efforts, such as inconsistent or inaccurate time tracking despite its importance.

  • Non-financial and sentiment-based measurements are crucial as data alone often misses behavioral context.

  • Established frameworks like Google’s HEART and Facebook’s mixed methods provide adaptable foundations for design measurement.

  • An eight-type taxonomy of design ops measurement emerged from research and community input, organized around people, practice, and platform domains.

  • Effective measurement frameworks link activities to predictable outcomes (like happier designers, better designers, and more effective teams) enabling targeted metrics.

  • Retention and staffing remain central concerns tied to measuring design ops impact; qualitative tactics like stay interviews yield actionable insights.

  • Community collaboration and shared standards for design ops measurement are essential to evolving beyond the 'we don’t know yet' phase.

Notable Quotes

"When I was asked how I measure success, I said the day I no longer have to convince you."

"62% of people said literally we don't know how to measure the value of design ops yet."

"Limited time and money is not unique to design ops; it’s every single function I’ve ever seen."

"People really hated using Harvest to log billable hours, some just put the same hours week after week."

"Non-financial, non-data measurements can reveal much more about behaviors than traditional metrics."

"Google’s HEART framework is great because different teams—engineering, product, and design—can all use it."

"We have an eight-type framework for measuring design ops, but it’s a starting point, design ops is never done."

"You can’t have effective teams without happy designers and better designers; they’re interdependent."

"Stay interviews ask why people choose to stay, which provides more actionable retention data than exit interviews."

"Our call to action is to co-create these measurement standards together and share back to the community."

Ask the Rosenbot
Sam Ladner
Methodologies: Beyond the interview [Advancing Research Community Workshop Series]
2024 • Advancing Research Community
Liz Ebengo
The Burden on Children: The Cost of Insufficient Post-Conflict Services and Pathways Forward
2024 • Advancing Service Design 2024
Gold
Mohammad Hossein Jarrahi
Contextuality problem: Exploring the Benefits of Qualitative and Quantitative Research
2023 • QuantQual Interest Group
Louis Rosenfeld
About the Rosenverse
2026 • Rosenfeld Community
Greg Petroff
Design is the Differentiator: Bringing New Design Innovations to a Very Antiquated and Very Large Industry
2021 • Design at Scale 2021
Gold
Dan Willis
Enterprise Storytelling Sessions
2015 • Enterprise UX 2015
Gold
Mujtaba Hameed
Frameworks for Excellence: Using Visual Thinking and Communication to Elevate Your Research
2024 • Advancing Research 2024
Gold
Heidi Trost
When AI Becomes the User’s Point Person—and Point of Failure
2025 • Rosenfeld Community
Saskia Liebenberg
Start Small for Big Impact
2019 • DesignOps Community
Changying (Z) Zheng
Navigating Innovation with Integrity
2024 • DesignOps Summit 2024
Gold
Ned Dwyer
Right horses for the right courses – how and when to democratize research
2025 • Advancing Service Design 2025
Gold
Sara Conklin
Exit Interview: 20 Years of Tech, One Very Big Bet, and a Lot of Heat Pumps
2026 • Rosenfeld Community
Jemma Ahmed
Democratization: Working with it, not against it [Advancing Research Community Workshop Series]
2024 • Advancing Research Community
Daniela Magaña Flores
Ahead of Competition: Learn What UX Benchmarking Can Do for Your Business Today
2022 • Advancing Research 2022
Gold
Louis Rosenfeld
Opening Remarks
2022 • Civic Design 2022
Gold
Joerg Beringer
Scaling User Research with AI: Continuous Discovery of User Needs in Minutes
2025 • Designing with AI 2025
Gold

More Videos

Lavy Kumar

"Bringing tasks directly into meetings lets you work where collaboration is happening without jumping between tools."

Lavy Kumar Kat Temple Shan Sebastian Tara Jensen Jenn Chou

Future of Work

June 9, 2021

Andreas Huebner

"Our user base is really fun and complex, with different preferences that require nuanced automation approaches."

Andreas Huebner Amy Takata Craig Brookes

What Is It Like To Be Part of The UX Team at Compass?

March 11, 2021

Ricardo Martins

"Conjoint analysis reveals how consumers make choices by examining trade-offs they are willing to make."

Ricardo Martins

Unlocking the power of advanced quantitative methods

March 12, 2025

Monty Hammontree

"The fastest way to gain influence is to get somebody else promoted."

Monty Hammontree

The Future of UX Research

December 3, 2020

Benjamin Real

"For me, ideally one design ops manager per 14 designers is the ratio that works best."

Benjamin Real

Showing the Value of DesignOps by Not Having a DesignOps Team

October 21, 2020

Kate Towsey

"It is impossible for one research ops person to do all the things expected in job descriptions."

Kate Towsey

Ask Me Anything (AMA) with Kate Towsey

April 2, 2025

Steve Portigal

"Visualizing data in a way executives can interpret is key to shifting from I think to I know."

Steve Portigal Chris Chapo Kelly Goto Christian Rohrer

Discussion

May 13, 2015

Sam Proulx

"Accessible experiences are better experiences for everyone whether you are a person with a disability or not."

Sam Proulx

Online Shopping: Designing an Accessible Experience

March 28, 2023

Sam Proulx

"Including people with disabilities in prototype reviews can be different based on the assistive technology they use and their needs."

Sam Proulx

Prototype Reviews, People With Disabilities, and You

October 1, 2021