Rosenverse
Design and Analytics with Sarah Coyle

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Design and Analytics with Sarah Coyle

Thursday, July 30, 2020 • DesignOps Community
Share the love for this talk
Design and Analytics with Sarah Coyle
Speakers: Sarah Coyle
Link:

Summary

In this month's videoconference, Sarah Coyle chats with community curator Alison Rand and the DesignOps Community on: How to apply human centered design to analytics Types of measurement for design operations What to do if you don't have an analytics team

Key Insights

  • Measuring design value is impossible without clear context and defined questions.

  • Sarah transitioned from reactive data support to strategic design metrics development.

  • USAA’s design practice has nearly 300 people, centrally organized under one Chief Design Office.

  • Design operations at USAA includes analytics, recruiting, program management, and quality and risk.

  • Starting measurement with the question or goal leads to more meaningful data insights than starting with raw data.

  • Human-centered design principles improve the way analytics is approached and applied in design.

  • Education for both data creators and consumers is critical to mature design data practices.

  • Design research measurement focuses on whether research is happening and how it influences decisions.

  • Small teams without analysts can leverage passionate designers interested in analytics and cross-team collaboration.

  • Information (meaningful context-rich data) is more valuable than raw data points alone.

Notable Quotes

"I realized that measuring the value of design is an impossible question without context."

"Value of design is never going to get a single answer because you need the who, what, and why."

"I help teams start with questions about what they want to learn before looking at data."

"Data is just single points; information is making that data meaningful through context."

"Most requests started reactive but evolved into more strategic metric definitions."

"I train people on the difference between data and information and on asking the right questions."

"We are just starting to do regular and frequent reporting across the entire design organization."

"If you don’t have an analyst, find designers passionate about analytics and educate them."

"Human-centered design can bring curiosity and empathy into traditional analytics work."

"Information experience needs wayfinding so people can find and use data easily."

Ask the Rosenbot
Steve Turbek
Designing Interactive Graphics with AI Code Help
2026 • Rosenfeld Community
Dan Willis
Enterprise Storytelling Sessions
2015 • Enterprise UX 2015
Gold
Jemma Ahmed
Theme 2 Intro
2024 • Advancing Research 2024
Gold
Mitchell Bernstein
Organizing Chaos: How IBM is Defining Design Systems with Sketch for an Ever-Changing AI Landscape
2021 • DesignOps Summit 2021
Gold
Emily Danielson
“I mean, I can lift a shovel”: Design Skills in Disaster Response
2022 • Design at Scale 2022
Gold
Sydney Lawson
Anatomy of a Strong User Panel
2026 • Advancing Research 2026
Gold
John Calhoun
Meters, Miles, and Madness: New Frameworks to Measure the (Elusive) Value of DesignOps
2024 • DesignOps Summit 2024
Gold
Abby Covert
Panel: Collaboration Tools
2017 • DesignOps Summit 2017
Gold
Amy Evans
How to Create Change
2024 • DesignOps Summit 2024
Gold
Tricia Wang
The most popular design thinking strategy is BS
2022 • Enterprise Community
JP Allen
Navigating the UX Tools Landscape
2021 • DesignOps Summit 2021
Gold
Kyle Godbey
Non-linear service design for complex adaptive systems
2025 • Rosenfeld Community
Prayag Narula
Empowering Designers to do Good Research
2022 • Advancing Research 2022
Gold
Mila Kuznetsova
How Lessons Learned from Our Youngest Users Can Help Us Evolve our Practices
2022 • Advancing Research 2022
Gold
Silke Bochat
5 Antifragile Strategies for a DesignOps 2.0
2024 • DesignOps Summit 2024
Gold
Kate Towsey
Participant Recruitment and Management Tools
2026 • Advancing Research 2026
Gold

More Videos

Carl Turner

"Managers were asking for user stories but hadn’t done any analysis or design — they didn’t understand the scope."

Carl Turner

You Can Do This: Understand and Solve Organizational Problems to Jumpstart a Dead Project

March 28, 2023

Karen Pascoe

"With selfie pay, you take a picture, blink to prove it’s you alive, and authenticate in-app seamlessly and securely."

Karen Pascoe

Developing Experience Teams and Talent in the Enterprise

June 8, 2016

Jilanna Wilson

"We couldn’t find just one word to describe our third value so we made one up: humbladent—humble and confident together."

Jilanna Wilson

Distributed Design Operations Management

October 23, 2019

Shawna Hein

"Slack channels and weekly meetings encourage cross-contract collaboration, avoiding duplication and sharing learnings across teams."

Shawna Hein Kevin Hoffman

Create a Cohesive Civic Design Practice Across Agency, Vendors, and Contracts

November 17, 2022

Barb Spanton

"Quick fixes rarely exist in these domains because beneath every problem are layers of complexity."

Barb Spanton

Doing Work That Matters: A Look Beyond The Idealistic Notion of 'Doing Meaningful Work'

June 10, 2022

Briana Thomas

"If a feature didn’t align with our core UX principles, it probably didn’t belong in our application."

Briana Thomas

The Quiet Force: Uncovering Hidden Leadership in High-Impact Design Teams

September 24, 2024

Gina Mendolia

"Mirroring content by repeating back what people say helps them understand their own ideas better."

Gina Mendolia

Therapists, Coaches, and Grandmas: Techniques for Service Design in Complex Systems

December 3, 2024

Lija Hogan

"Future UX includes designing for user discovery in conversational and augmented interfaces, not just clicks."

Lija Hogan Milan Mijatovic Sam Proulx Louis Rosenfeld

Three Years Out: Perspectives on the Near-Term Future of User Research

March 15, 2024

John Calhoun

"DPM loneliness and siloing happen because of wearing too many hats and inheriting mismatched responsibilities."

John Calhoun Rachel Posman

Two Sides of the DesignOps Coin: Teams Ops and Product Ops

January 8, 2024