Log in or create a free Rosenverse account to watch this video.
Log in Create free account100s of community videos are available to free members. Conference talks are generally available to Gold members.
Design and Analytics with Sarah Coyle
Summary
In this month's videoconference, Sarah Coyle chats with community curator Alison Rand and the DesignOps Community on: How to apply human centered design to analytics Types of measurement for design operations What to do if you don't have an analytics team
Key Insights
-
•
Measuring design value is impossible without clear context and defined questions.
-
•
Sarah transitioned from reactive data support to strategic design metrics development.
-
•
USAA’s design practice has nearly 300 people, centrally organized under one Chief Design Office.
-
•
Design operations at USAA includes analytics, recruiting, program management, and quality and risk.
-
•
Starting measurement with the question or goal leads to more meaningful data insights than starting with raw data.
-
•
Human-centered design principles improve the way analytics is approached and applied in design.
-
•
Education for both data creators and consumers is critical to mature design data practices.
-
•
Design research measurement focuses on whether research is happening and how it influences decisions.
-
•
Small teams without analysts can leverage passionate designers interested in analytics and cross-team collaboration.
-
•
Information (meaningful context-rich data) is more valuable than raw data points alone.
Notable Quotes
"I realized that measuring the value of design is an impossible question without context."
"Value of design is never going to get a single answer because you need the who, what, and why."
"I help teams start with questions about what they want to learn before looking at data."
"Data is just single points; information is making that data meaningful through context."
"Most requests started reactive but evolved into more strategic metric definitions."
"I train people on the difference between data and information and on asking the right questions."
"We are just starting to do regular and frequent reporting across the entire design organization."
"If you don’t have an analyst, find designers passionate about analytics and educate them."
"Human-centered design can bring curiosity and empathy into traditional analytics work."
"Information experience needs wayfinding so people can find and use data easily."
Or choose a question:
More Videos
"Embedding process knowledge directly into work surfaces helps teams unpack and collaborate effectively."
Surya VankaUnleashing Swarm Creativity to Solve Enterprise Challenges
June 10, 2021
"Journalists experiencing the same trauma as samurai during the Meiji Restoration – once warriors, now unsure of their role."
Patrick Boehler Madison KarasThe service shift: transforming media organizations to create real value through design
November 19, 2025
"The pandemic pushed us to be creative, and it’s been fun for users to participate remotely in the design process."
Andreas Huebner Amy Takata Craig BrookesWhat Is It Like To Be Part of The UX Team at Compass?
March 11, 2021
"Leaders spend a lot of time on operational work, which does not allow design strategy to mature."
Patrizia Bertini Alexandra Mengoni LeónPushing DesignOps’ Influence into New Global Markets
September 9, 2022
"People plus practices plus places equals artifacts."
Phil GilbertA Consistent Culture of Design
May 14, 2015
"You need a lot of annoying handholding with the AI: reminding it of how many people you have or simple things."
Yulya Besplemennova[Demo] Stress-testing GenAI in user research synthesis
June 4, 2024
"Remote research is not a silver bullet."
Sarah RinkRemote User Research: Dos and Don'ts from the Virtual Field
June 11, 2020
"We experimented with AI-powered sprints, but had lots of dead ends and false starts before finding what really works for us."
Mujtaba HameedThe new horizon of ethnography: using AI to unlock the full potential of in-person research
March 11, 2026
"There is no singular solution in systems thinking; there are multiple types of interventions."
Sheryl CababaLiving in the Clouds: Adopting a Systems Thinking Mindset
June 6, 2023