Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

8 Types of Measures in Design Operations (Videoconference)
Thursday, April 16, 2020 • DesignOps Community
Share the love for this talk
8 Types of Measures in Design Operations (Videoconference)
Speakers: Kristin Skinner and Kamdyn Moore
Link:

Summary

DesignOps as a practice is still relatively new—but the activities have been around long enough that we’re increasingly challenged to justify and quantify what we do. Accordingly, we need to address not just what is DesignOps, but how do we prove its value? What outcomes can we genuinely promise? And how do we know we are successful? In this webinar, we identify techniques, tactics, and tools for proving (and even measuring) value, and describing the outcomes that matter most.

Key Insights

  • Most design operations teams struggle to measure their impact, with 62% unsure how to do so effectively.

  • Spotify focuses on measuring designer productivity by identifying workflow bottlenecks rather than simply speeding up outputs.

  • Resistance to process in design teams often stems from unfamiliarity and concerns about creativity and delivery constraints.

  • Measurement frameworks must be flexible and adaptable depending on the organization's stage in its design ops maturity.

  • Successful design ops measurement requires cross-team collaboration and shared outcomes from the project's start.

  • Quantitative data should be complemented by qualitative metrics like designer happiness and community belonging.

  • Centralized, decentralized, and matrix design ops models each have unique measurement challenges and need strong partnerships to succeed.

  • Design ops teams frequently operate in a reactive mode but must strategically choose what to react to for long-term impact.

  • Empathy is critical when addressing productivity and happiness measurement, especially during remote work and pandemic-related disruptions.

  • Involving analytics and research professionals in design ops measurement efforts improves data collection, analysis, and insights.

Notable Quotes

"People spend about 60% of their time on the work about the work."

"Only one in 10 companies have quantifiable measurement for their design leaders."

"We haven't figured it out, but this community can help define measurement frameworks."

"Designers often resist processes that are meant to help streamline their work."

"Attribution of design impact is tricky because work cycles and releases happen at different cadences."

"Having shared outcomes and leadership support is critical for effective measurement."

"Measurement is never done; it's always an ongoing investigation and refinement process."

"Surveys and feature usage data currently provide the most traction in measuring design systems adoption."

"Reactive mode is natural in design ops, but the goal is to become strategic about what we react to."

"Applying empathy deeply is more important than ever for engagement and process success in current remote work conditions."

Ask the Rosenbot
Kit Unger
Theme 3 Intro
2022 • Design at Scale 2022
Gold
Bryce Benton
[Demo] AI-powered UX enhancement: Aligning GitHub documentation with USWDS at Austin Public Library
2024 • Designing with AI 2024
Gold
Charlotte Lee
Theme 1 Intro
2021 • Civic Design 2021
Gold
Kristin Taylor
Building Bridges Across Organizational Silos
2022 • Civic Design 2022
Gold
Louis Rosenfeld
How AI will Change DesignOps Tooling
2023 • DesignOps Summit 2023
Gold
Alissa Briggs
How to Coach Enterprise Experimentation
2015 • Enterprise UX 2015
Gold
Louis Rosenfeld
Opening Remarks
2023 • Advancing Research 2023
Gold
Candace Myers
Standardizing Design at Scale
2022 • DesignOps Summit 2022
Gold
John Cutler
Oxbows, Rivers, and Estuaries: How to navigate the currents of change (without burning out)
2024 • Advancing Service Design 2024
Gold
Sam Proulx
Understanding Screen Readers on Mobile: How And Why to Learn from Native Users
2023 • Advancing Research 2023
Gold
Lada Gorlenko
Theme 2 Intro
2022 • Design at Scale 2022
Gold
Panel Discussion: Communicating the Value of DesignOps
2018 • DesignOps Summit 2018
Gold
Sam Ladner
How Research Can Drive Strategic Foresight
2022 • Advancing Research 2022
Gold
James Rampton
The Basics of Automotive UX & Why Phones Are a Part of That Future
2024 • Rosenfeld Community
Kim Holt
A Salesforce Panel Discussion on Values-Driven DesignOps
2022 • DesignOps Summit 2022
Gold
Mike Davidson
Fireside Chat
2022 • Advancing Research 2022
Gold

More Videos

Jemma Ahmed

"It is part of your role to say no, enforce guardrails, and stop people pleasing when democratizing research."

Jemma Ahmed Steve Carrod Chris Geison Dr. Shadi Janansefat Christopher Nash

Democratization: Working with it, not against it [Advancing Research Community Workshop Series]

July 24, 2024

Nina Jurcic

"Great design doesn’t happen in isolation; it’s subject to power dynamics within organizations."

Nina Jurcic

The Design System Rollercoaster: From Enabler and Bottleneck to Catalyst for Change

October 3, 2023

Nathan Curtis

"I try to position the system as an enabling force for designers to do their work better and succeed better."

Nathan Curtis Nalini P. Kotamraju Jack Moffett Dawn Ressel

Discussion

June 9, 2016

Saara Kamppari-Miller

"We had to be creative measuring accessibility success because we cannot detect screen reader use or certain disabilities directly."

Saara Kamppari-Miller Nicole Bergstrom Shashi Jain

Key Metrics: Comparing Three Letter Acronym Metrics That Include the Word “Key”

November 13, 2024

Malini Rao

"We added an in-product feedback framework and used the UMUX scale to get feedback at scale and distinguish true pain points."

Malini Rao

Lessons Learned from a 4-year Product Re-platforming Journey

June 9, 2021

Mackenzie Cockram

"Bringing stakeholders to observe user sessions helps them see that user-centered design isn’t just a cult."

Mackenzie Cockram Sara Branco Cunha Ian Franklin

Integrating Qualitative and Quantitative Research from Discovery to Live

December 16, 2022

Bria Alexander

"Recordings and video decks will be shared on the conference site within hours of each presentation."

Bria Alexander

Opening Remarks

June 9, 2021

Jackie Ho

"There are no physical boards involved, no whiteboard, no mood boards. The board part refers to people like a board of directors."

Jackie Ho

Lead Effectively While Preserving Team Autonomy with Growth Boards

January 8, 2024

Dan Hill

"Electric car targets for the UK alone would demand more than the world's annual cobalt production."

Dan Hill

Designing for the infrastructures of everyday life

June 4, 2024