Summary
DesignOps as a practice is still relatively new—but the activities have been around long enough that we’re increasingly challenged to justify and quantify what we do. Accordingly, we need to address not just what is DesignOps, but how do we prove its value? What outcomes can we genuinely promise? And how do we know we are successful? In this group exercise, we’ll identify techniques, tactics, and tools for proving (and even measuring) value, and describing the outcomes that matter most.
Key Insights
-
•
62% of surveyed design organizations still don’t know how to measure design ops value effectively.
-
•
Common barriers include limited time, resource constraints, difficulty involving the right stakeholders, and lack of proven value.
-
•
Measuring the value of design is uniquely challenging due to varying organizational constraints and differing maturity stages in design ops.
-
•
Behavioral resistance, such as inconsistent data logging, undermines efforts to capture accurate operational metrics.
-
•
There is no industry standard for measuring design or design ops impact, creating confusion and inconsistency.
-
•
Established frameworks, like Google HEART and Facebook’s mixed methods, provide useful starting points for measurement.
-
•
A proposed eight-type measurement taxonomy was developed collaboratively with community input and analysis by Abby Covert.
-
•
Design ops measurement can be categorized into three focus areas: people, practice, and platform, each contributing to predictable outcomes.
-
•
Sentiment and engagement metrics, along with attrition and retention data, are key indicators for happier, better, and more effective design teams.
-
•
Interactive collaboration and community feedback are essential to creating realistic, adaptable tools for measuring design ops value.
Notable Quotes
"The day I no longer have to convince you felt good, but it’s not good enough."
"We keep trying different things but still don’t quite know how to measure our value."
"Limited time or resources is something every single team struggles with, not just design ops."
"Operationalizing design means creating the space for the team to do their best work within any constraint."
"Every organization has unique constraints, so success must be defined within your context."
"People really hated logging their billable hours, which shows how behavior affects measurement."
"Most companies persist in measuring the wrong thing because they focus only on data, not behavior or sentiment."
"Google HEART framework is useful because it sets goals and maps relevant metrics across teams."
"There are three key themes in design ops: people, practice, and platform — all necessary for predictable outcomes."
"You can’t have effective teams without happy designers and better designers — these outcomes are all interdependent."
Or choose a question:
More Videos
"The hardest part about remote is making design reviews feel collaborative and team-based."
Adam Cutler Karen Pascoe Ian Swinson Susan WorthmanDiscussion
June 8, 2016
"UX directors often feel like this poor person in the middle here getting pulled in all these directions."
Peter MerholzThe Trials and Tribulations of Directors of UX (Videoconference)
July 13, 2023
"In the automotive industry, most safety standards only became mandatory after governments intervened."
Lisa WelchmanCleaning Up Our Mess: Digital Governance for Designers
June 14, 2018
"Sustainable practices are not just a luxury; they are a necessity for our survival."
Vincent BrathwaiteOpener: Past, Present, and Future—Closing the Racial Divide in Design Teams
October 22, 2020
"Design your processes around learning, have blameless post mortems and celebrate failures especially."
Brenna FallonLearning Over Outcomes
October 24, 2019
"Never be afraid to get into good trouble; start by asking why."
Tricia WangSpatial Collapse: Designing for Emergent Culture
January 8, 2024
"Clusters describing demographics and behaviors alone were not enough; we needed emotional personas to find value propositions."
Edgar Anzaldua MorenoUsing Research to Determine Unique Value Proposition
March 11, 2021
"The toy shouldn’t be the goal of play, but a tool or a process that unlocks the unlimited possibilities set forth before a child."
Designing Systems at Scale
November 7, 2018
"Randomization is magic — it evenly distributes confounds so the only difference affecting results is your change."
Erin WeigelGet Your Whole Team Testing to Design for Impact
July 24, 2024
