Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

8 Types of Measures in Design Operations (Videoconference)
Thursday, April 16, 2020 • DesignOps Community
Share the love for this talk
8 Types of Measures in Design Operations (Videoconference)
Speakers: Kristin Skinner and Kamdyn Moore
Link:

Summary

DesignOps as a practice is still relatively new—but the activities have been around long enough that we’re increasingly challenged to justify and quantify what we do. Accordingly, we need to address not just what is DesignOps, but how do we prove its value? What outcomes can we genuinely promise? And how do we know we are successful? In this webinar, we identify techniques, tactics, and tools for proving (and even measuring) value, and describing the outcomes that matter most.

Key Insights

  • Most design operations teams struggle to measure their impact, with 62% unsure how to do so effectively.

  • Spotify focuses on measuring designer productivity by identifying workflow bottlenecks rather than simply speeding up outputs.

  • Resistance to process in design teams often stems from unfamiliarity and concerns about creativity and delivery constraints.

  • Measurement frameworks must be flexible and adaptable depending on the organization's stage in its design ops maturity.

  • Successful design ops measurement requires cross-team collaboration and shared outcomes from the project's start.

  • Quantitative data should be complemented by qualitative metrics like designer happiness and community belonging.

  • Centralized, decentralized, and matrix design ops models each have unique measurement challenges and need strong partnerships to succeed.

  • Design ops teams frequently operate in a reactive mode but must strategically choose what to react to for long-term impact.

  • Empathy is critical when addressing productivity and happiness measurement, especially during remote work and pandemic-related disruptions.

  • Involving analytics and research professionals in design ops measurement efforts improves data collection, analysis, and insights.

Notable Quotes

"People spend about 60% of their time on the work about the work."

"Only one in 10 companies have quantifiable measurement for their design leaders."

"We haven't figured it out, but this community can help define measurement frameworks."

"Designers often resist processes that are meant to help streamline their work."

"Attribution of design impact is tricky because work cycles and releases happen at different cadences."

"Having shared outcomes and leadership support is critical for effective measurement."

"Measurement is never done; it's always an ongoing investigation and refinement process."

"Surveys and feature usage data currently provide the most traction in measuring design systems adoption."

"Reactive mode is natural in design ops, but the goal is to become strategic about what we react to."

"Applying empathy deeply is more important than ever for engagement and process success in current remote work conditions."

Ask the Rosenbot
Jane Reid
Self-care in User Research (Videoconference)
2020 • Advancing Research Community
Luz Bratcher
This Is a Talk for Tired People
2022 • Design at Scale 2022
Gold
Ignacio Martinez
Fair and Effective Designer Evaluation
2024 • DesignOps 2024
Gold
Rachael Dietkus, LCSW
AI: Passionate defenses and reasoned critique [Advancing Research Community Workshop Series]
2024 • Advancing Research Community
Denise Jacobs
Interactive Keynote: Social Change by Design
2024 • Enterprise Experience 2020
Gold
Dan Willis
Theme 3: Intro
2024 • Enterprise Experience 2020
Gold
Jeff Ephraim Bander
Eye Tracking Gamechanger: Why Smartphone Eye Tracking will Revolutionize Your UX Research
2022 • Advancing Research 2022
Gold
Tim Parmee
Changing Our Design Pressure Points
2023 • DesignOps Summit 2023
Gold
Dantley Davis
Leadership & Diversity—A Fireside Chat with Dantley Davis (Videoconference)
2020 • Enterprise Community
Kristin Skinner
Opening Keynote: Org Design for Design Orgs
2017 • DesignOps Summit 2017
Gold
Amy Thibodeau
Opening Keynote: Process and Ambiguity
2019 • DesignOps Summit 2019
Gold
Phil Gilbert
A Consistent Culture of Design
2015 • Enterprise UX 2015
Gold
Katy Mogal
But Do Your Insights Scale?
2021 • Advancing Research 2021
Gold
Jacqui Frey
Setting the Table for Dynamic Change
2019 • DesignOps Summit 2019
Gold
Aaron Stienstra
Leveraging Civic Design to Advance Equity and Rebuild Trust in the US Federal Government
2021 • Civic Design 2021
Gold
Bob Baxley
Theme 4: Discussion
2024 • Enterprise Experience 2020
Gold

More Videos

Jack Moffett

"SAFe risks becoming codified bureaucracy that sidelines the customer, but it holds potential if adapted to foster real business agility."

Jack Moffett

SAFe or Sorry? (Videoconference)

May 29, 2019

Tricia Wang

"We have a thing at Athena about positive mutual regard — sitting down with people to understand root causes for strange behaviors builds powerful bonds."

Tricia Wang

SCALE: Discussion

June 15, 2018

Fredrik Matheson

"Simplifying systems takes patience and happens slowly, often involving years of work and negotiation."

Fredrik Matheson

First-time users, longtime strategies: Why Parkinson’s Law is making you less effective at work – and how to design a fix.

June 8, 2016

Laine Riley Prokay

"Competencies allow managers to celebrate individualism while ensuring consistency."

Laine Riley Prokay

How DesignOps can Drive Inclusive Career Ladders for All

September 30, 2021

Shipra Kayan

"UserVoice let us merge similar requests internally, which was crucial before automation."

Shipra Kayan

How we Built a VoC (Voice of the Customer) Practice at Upwork from the Ground Up

September 30, 2021

Kristen Guth, Ph.D.

"The fog method helps separate facts from assumptions to break unproductive decision loops."

Kristen Guth, Ph.D.

Out of the FOG: A Non-traditional Research Approach to Alignment

March 28, 2023

Joi Freeman

"The reason why diverse companies typically outperform is because they remove blind spots and bias."

Joi Freeman

A New Vantage Point: Building a Pipeline for Multifaceted Research(ers)

March 30, 2020

Victor Udoewa

"Empathy is the secret ingredient to making products that truly resonate."

Victor Udoewa

Theme One Intro

March 27, 2023

Peter Merholz

"It’s not enough to have great people; you need to create the space that brings out their best."

Peter Merholz

Customer-Centered Design Organizations

June 8, 2017