Log in or create a free Rosenverse account to watch this video.
Log in Create free account100s of community videos are available to free members. Conference talks are generally available to Gold members.
Design and Analytics with Sarah Coyle
Summary
In this month's videoconference, Sarah Coyle chats with community curator Alison Rand and the DesignOps Community on: How to apply human centered design to analytics Types of measurement for design operations What to do if you don't have an analytics team
Key Insights
-
•
Measuring design value is impossible without clear context and defined questions.
-
•
Sarah transitioned from reactive data support to strategic design metrics development.
-
•
USAA’s design practice has nearly 300 people, centrally organized under one Chief Design Office.
-
•
Design operations at USAA includes analytics, recruiting, program management, and quality and risk.
-
•
Starting measurement with the question or goal leads to more meaningful data insights than starting with raw data.
-
•
Human-centered design principles improve the way analytics is approached and applied in design.
-
•
Education for both data creators and consumers is critical to mature design data practices.
-
•
Design research measurement focuses on whether research is happening and how it influences decisions.
-
•
Small teams without analysts can leverage passionate designers interested in analytics and cross-team collaboration.
-
•
Information (meaningful context-rich data) is more valuable than raw data points alone.
Notable Quotes
"I realized that measuring the value of design is an impossible question without context."
"Value of design is never going to get a single answer because you need the who, what, and why."
"I help teams start with questions about what they want to learn before looking at data."
"Data is just single points; information is making that data meaningful through context."
"Most requests started reactive but evolved into more strategic metric definitions."
"I train people on the difference between data and information and on asking the right questions."
"We are just starting to do regular and frequent reporting across the entire design organization."
"If you don’t have an analyst, find designers passionate about analytics and educate them."
"Human-centered design can bring curiosity and empathy into traditional analytics work."
"Information experience needs wayfinding so people can find and use data easily."
Or choose a question:
More Videos
"Short-term learnings kind of roll into long-term ones as you iterate and build on historical findings."
Taylor Jennings Joe Nelson Alex KnollRepository Retrospective: Learnings from Introducing a Central Place for UX Research
March 9, 2022
"Speculation fills in the gaps where past experience fails us, often seen in hesitation or pauses."
Nicole AleongFuture Orientations to Everyday Life: Futures Anthropology as a Methodology
March 26, 2024
"These are all attempts by large companies to figure out new ways to deliver their products or services or to create new businesses outside of what they’re currently working on."
Jeff GothelfInnovation Studios: the Engines of Enterprise Experimentation
May 14, 2015
"Nothing about us without us is the mantra we embrace when doing inclusive design operations."
Saara Kamppari-MillerDesignOps for Inclusive Design and Accessibility
May 26, 2022
"There’s a lot of pressure on ops people and managers to make everything perfect all the time for staff."
Tess DixonC'mon Get Happy
September 29, 2021
"Being intentional about how we spend our time is the purest manifestation of our values and our value."
Liam ThurstonWhy Your Design Team Is Quitting, And How To Fix It
June 10, 2022
"People care about titles way too much. I had a guy whose business card said star-bellied sneak—love that."
Ian SwinsonDesigning and Driving UX Careers
June 8, 2016
"If you make rules, put numbers in them, and say them confidently, sometimes people actually do them."
Leisa ReicheltOpening Keynote: Operating in Context
November 7, 2018
"It depends was the most common answer to how do you know what you’re doing is working."
Rachael Greene Alison DavisBuilding a Design Ops Practice that Really Works (Most of the Time)
October 2, 2025
