Rosenverse
Design and Analytics with Sarah Coyle

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Design and Analytics with Sarah Coyle

Thursday, July 30, 2020 • DesignOps Community
Share the love for this talk
Design and Analytics with Sarah Coyle
Speakers: Sarah Coyle
Link:

Summary

In this month's videoconference, Sarah Coyle chats with community curator Alison Rand and the DesignOps Community on:
  • How to apply human centered design to analytics
  • Types of measurement for design operations
  • What to do if you don't have an analytics team

Key Insights

  • •

    Measuring design value is impossible without clear context and defined questions.

  • •

    Sarah transitioned from reactive data support to strategic design metrics development.

  • •

    USAA’s design practice has nearly 300 people, centrally organized under one Chief Design Office.

  • •

    Design operations at USAA includes analytics, recruiting, program management, and quality and risk.

  • •

    Starting measurement with the question or goal leads to more meaningful data insights than starting with raw data.

  • •

    Human-centered design principles improve the way analytics is approached and applied in design.

  • •

    Education for both data creators and consumers is critical to mature design data practices.

  • •

    Design research measurement focuses on whether research is happening and how it influences decisions.

  • •

    Small teams without analysts can leverage passionate designers interested in analytics and cross-team collaboration.

  • •

    Information (meaningful context-rich data) is more valuable than raw data points alone.

Notable Quotes

"I realized that measuring the value of design is an impossible question without context."

"Value of design is never going to get a single answer because you need the who, what, and why."

"I help teams start with questions about what they want to learn before looking at data."

"Data is just single points; information is making that data meaningful through context."

"Most requests started reactive but evolved into more strategic metric definitions."

"I train people on the difference between data and information and on asking the right questions."

"We are just starting to do regular and frequent reporting across the entire design organization."

"If you don’t have an analyst, find designers passionate about analytics and educate them."

"Human-centered design can bring curiosity and empathy into traditional analytics work."

"Information experience needs wayfinding so people can find and use data easily."

Ask the Rosenbot
Jemma Ahmed
Theme Panel
2025 • Advancing Research 2025
Gold
Dane DeSutter
What co-speech gestures reveal about users’ thinking during interviews
2023 • Rosenfeld Community
Boon Yew Chew
Making Sense of Systems—and Using Systems to Make Sense of the Enterprise
2023 • Enterprise UX 2023
Gold
Adel Du Toit
Get Your CFO To Say: 'Our Strategic Goal is User Obsession'
2022 • Design at Scale 2022
Gold
Alla Weinberg
Design Teams Need Psychological Safety: Here’s How to Create It
2022 • DesignOps Summit 2022
Gold
Kristin Taylor
Building Bridges Across Organizational Silos
2022 • Civic Design 2022
Gold
Nidhi Singh Rathore
Embracing participation to unlock deeper truths in commercial research
2025 • Advancing Research 2025
Gold
Amy Parness
Scaling Sustainability: Complementary strategies that drive long-term success
2025 • Climate UX Interest Group
Deanna Mitchell
Designing with culture: Unlocking impactful insights for Product and UX
2025 • Advancing Research 2025
Gold
Joel Branch
Humanizing AI: Filling the Gaps with Multi-faceted Research
2021 • Advancing Research 2021
Gold
Lily Aduana
5 Reasons to Bring Your Recruiting in-House (and How To Do It)
2021 • Advancing Research 2021
Gold
Sharon Bautista
Time to Make the Donuts: How User Research Helped Bridge Disparate Teams
2024 • Enterprise Experience 2020
Gold
Amy Bucher
Harnessing behavioral science to uncover deeper truths
2025 • Advancing Research 2025
Gold
William Newton
How to Lead With Data, and Without Data
2023 • Enterprise UX 2023
Gold
Chris Geison
Theme Two Intro
2023 • Advancing Research 2023
Gold
Meghan Bausone
Systems Thinking and Design Innovation: Working with Leverage Points in Rural Maternal Health Systems
2026 • Rosenfeld Community

More Videos

Erin Hauber

"Change is a constant in design, but at USAA it often felt like change within change — inception-like change."

Erin Hauber

Design is Not the Frosting on the Scaled Agile Layer Cake

October 24, 2019

Megan Kierstead

"The only person who gets to decide what it means to be badass is you."

Megan Kierstead

You Are a Badass at UX: Overcoming Imposter Syndrome

March 10, 2021

Maggie Dieringer

"Do not judge me by my success, judge me by how many times I fell down and got back up again."

Maggie Dieringer

Creating Consistency Through Constant Change

January 8, 2024

Meaghan Waters

"Lift and shift equals timidity—it’s sticking to what you know rather than delivering real value."

Meaghan Waters Fotina Koutropoulous

Lack of Product Thinking will Doom Your Legacy Modernization

June 9, 2021

Jemma Ahmed

"The gap between market research and user research is narrowing; their methods and questions are converging."

Jemma Ahmed

Bringing together market and user research

October 17, 2019

Maria Taylor

"Organizations often forget to assign gardener roles to communities, which causes tacit knowledge sharing efforts to fizzle out quickly."

Maria Taylor

Knowledge is Power: Managing the Lifeblood of the Design Org

October 3, 2023

Sam Proulx

"Auto-complete absolutely is an accessibility feature because it helps reduce typing effort for screen reader users."

Sam Proulx

Understanding Screen Readers on Mobile: How And Why to Learn from Native Users

June 6, 2023

Catherine Blizzard

"Project leadership can be at any level; the right discipline leads, not necessarily the most senior person."

Catherine Blizzard

Using Integrated Insight to Drive Growth

March 10, 2022

Randolph Duke II

"We all walked away better for it."

Randolph Duke II

War Stories LIVE! Randy Duke II

March 30, 2020