Rosenverse
But Do Your Insights Scale?

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

But Do Your Insights Scale?

Gold
Friday, March 12, 2021 • Advancing Research 2021
Share the love for this talk
But Do Your Insights Scale?
Speakers: Katy Mogal
Link:

Summary

Overcoming stakeholder objections and positioning qualitative data as an input to business and product strategy. When stakeholders have access to real-time data about millions of user interactions, how can qualitative researchers articulate the value of small-sample studies for product and business strategy? In this case study, we’ll show how we used our insights chops to understand stakeholder motivations and concerns, and get qualitative research a seat at the table shaping Google Assistant’s 2020 strategy. We’ll share learnings about how human-centered researchers can effectively collaborate with functions like data science and business strategy, and how to persuade analytically-minded stakeholders to embrace rich qualitative data about people’s needs and motivations as an input to business strategy.

Key Insights

  • Taking calculated risks is essential for qualitative researchers to secure influence in organization-wide strategy discussions.

  • Small qualitative sample sizes can still deliver powerful impactful insights when paired with quantitative data and trust building.

  • Inviting stakeholders to interact directly with unfiltered qualitative data (e.g., video diaries) fosters genuine curiosity and advocacy.

  • Physicalizing data, such as printing quotes and charts in a shared workspace, promotes team engagement and collaborative sensemaking.

  • Converting one respected analyst into a research evangelist can change the conversations and perceptions of entire peer groups.

  • Low-stakes, incremental experiments to share insights reduce resistance and create momentum for organizational change.

  • Qualitative research offers deep understanding of user motivations and needs that quantitative data alone cannot provide.

  • Researchers’ empathy skills are strategic tools to understand and influence stakeholders’ fears, incentives, and motivations.

  • Successful qualitative efforts depend not just on methodology rigor but on bravery, leadership, and cultural positioning.

  • Embedding qualitative insights into yearly planning cycles can shift research from an add-on activity to a core strategy input.

Notable Quotes

"If they don’t give you a seat at the table, bring a folding chair."

"We decided to jump off the wall—that scary leap to prove qualitative insights can change strategy."

"The surveys and logs data tell us the what, but qualitative research tells us the why."

"One converted analyst became our research associate, and his enthusiasm was contagious."

"Getting the data out of laptops and onto the walls made the research physical and accessible."

"It’s not about the methodology, it’s about bravery and leadership."

"Find those curious partners who will evangelize the value of your insights to their peers."

"Researchers are experts at empathy and understanding motivations, which are superpowers beyond just interviewing users."

"Small experiments, planting seeds over time, can shift hearts and minds more effectively than big radical changes."

"Our insights became pillars of the 2020 product strategy and qualitative research earned a reserved seat at the table."

Ask the Rosenbot
April Reagan
Look, Think, Act: The Futures-Smart Design Organization
2021 • DesignOps Summit 2021
Gold
Doug Powell
DesignOps and the Next Frontier: Leading Through Unpredictable Change
2025 • DesignOps Summit 2025
Gold
Miles Orkin
Creativity and Culture
2018 • DesignOps Summit 2018
Gold
John Calhoun
Have we Reached Our Peak? Spotting the Next Mountain For DesignOps to Climb
2021 • DesignOps Summit 2021
Gold
Liam Thurston
Why Your Design Team Is Quitting, And How To Fix It
2022 • Design at Scale 2022
Gold
Ilana Lipsett
Anticipating Risk, Regulating Tech: A Playbook for Ethical Technology Governance
2021 • Civic Design 2021
Gold
Dharani Perera
The mandala of service design: unlocking alignment and action through service design
2025 • Advancing Service Design 2025
Gold
Robert Reimann
Taming Design Complexity with UX Models
2017 • Enterprise Experience 2017
Gold
Tiffany Cheng
Designing in a Pandemic: Integrating Speed and Rigor
2022 • Design at Scale 2022
Gold
Brad Peters
Short Take #1: UX/Product Lessons from Your Industry Peers
2022 • Design in Product 2022
Gold
Bianca Jefferson
From Sprints to Systems: Operationalizing Continuous Discovery Through DesignOps
2025 • DesignOps Summit 2025
Gold
Brian T. O’Neill
Does Designing and Researching Data Products Powered by ML/AI and Analytics Call for New UX Methods?
2022 • QuantQual Interest Group
Chris Chapo
Data Science and Design: A Tale of Two Tribes
2015 • Enterprise UX 2015
Gold
Dave Hoffer
UX Job Search AMA #3 with Joanne Weaver and Dave Hoffer
2025 • Rosenfeld Community
Bill Scott
Lean Engineering: Engineering for Learning and Experimentation in the Enterprise
2015 • Enterprise UX 2015
Gold
Gina Mendolia
Therapists, Coaches, and Grandmas: Techniques for Service Design in Complex Systems
2024 • Advancing Service Design 2024
Gold

More Videos

Jerome “Axle” Brown

"Change is the only constant, so designing insight sharing with self-directed learning is critical."

Jerome “Axle” Brown

How to Use Self-Directed Learning to Ensure Your Research Insights are Heard and Acted Upon

March 11, 2021

Phil Gilbert

"We had an engineering culture that confused uniformity with design, and consistency with design."

Phil Gilbert

A Consistent Culture of Design

May 14, 2015

Kate Towsey

"As more software is being built for specific personas, precise participant targeting becomes more important over time."

Kate Towsey Basel Fakhoury Oren Friedman Graham Gardner

Participant Recruitment and Management Tools

March 12, 2026

Sohit Karol

"Music is personal but also cultural and communal, which creates complexity for personalization."

Sohit Karol

Designing Delightful Listening Experiences: Mixed Methods Research in the Age of Machine Learning

March 31, 2020

Christopher Taylor Edwards

"Designing as a team means centering all the humans involved, not just the users."

Christopher Taylor Edwards Valerie Roske

Design as a Team Practice, A Practical Guide to Cross-functional Collaboration

September 30, 2021

Sheryl Cababa

"Community engagement is a powerful lever often left out of systems thinking processes."

Sheryl Cababa

Expanding Your Design Lens with Systems Thinking

February 23, 2023

Francesca Barrientos, PhD

"We realized there was no way to make sense of the conglomeration of sticky notes."

Francesca Barrientos, PhD

You Need Your Own Definition of Design Maturity

June 8, 2022

Allison Sanders

"Onboarding isn’t a one-time activity, it’s an ongoing event that helps people connect and find their place."

Allison Sanders

Operating with Purpose

January 8, 2024

Saara Kamppari-Miller

"We had to make everybody feel safe to participate in this exercise."

Saara Kamppari-Miller

"Prototype" vs "Prototype"--Breaking Down and Rebuilding Our Understanding of What We Do

October 24, 2019