Rosenverse
But Do Your Insights Scale?

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

But Do Your Insights Scale?

Gold
Friday, March 12, 2021 • Advancing Research 2021
Share the love for this talk
But Do Your Insights Scale?
Speakers: Katy Mogal
Link:

Summary

Overcoming stakeholder objections and positioning qualitative data as an input to business and product strategy. When stakeholders have access to real-time data about millions of user interactions, how can qualitative researchers articulate the value of small-sample studies for product and business strategy? In this case study, we’ll show how we used our insights chops to understand stakeholder motivations and concerns, and get qualitative research a seat at the table shaping Google Assistant’s 2020 strategy. We’ll share learnings about how human-centered researchers can effectively collaborate with functions like data science and business strategy, and how to persuade analytically-minded stakeholders to embrace rich qualitative data about people’s needs and motivations as an input to business strategy.

Key Insights

  • •

    Taking calculated risks is essential for qualitative researchers to secure influence in organization-wide strategy discussions.

  • •

    Small qualitative sample sizes can still deliver powerful impactful insights when paired with quantitative data and trust building.

  • •

    Inviting stakeholders to interact directly with unfiltered qualitative data (e.g., video diaries) fosters genuine curiosity and advocacy.

  • •

    Physicalizing data, such as printing quotes and charts in a shared workspace, promotes team engagement and collaborative sensemaking.

  • •

    Converting one respected analyst into a research evangelist can change the conversations and perceptions of entire peer groups.

  • •

    Low-stakes, incremental experiments to share insights reduce resistance and create momentum for organizational change.

  • •

    Qualitative research offers deep understanding of user motivations and needs that quantitative data alone cannot provide.

  • •

    Researchers’ empathy skills are strategic tools to understand and influence stakeholders’ fears, incentives, and motivations.

  • •

    Successful qualitative efforts depend not just on methodology rigor but on bravery, leadership, and cultural positioning.

  • •

    Embedding qualitative insights into yearly planning cycles can shift research from an add-on activity to a core strategy input.

Notable Quotes

"If they don’t give you a seat at the table, bring a folding chair."

"We decided to jump off the wall—that scary leap to prove qualitative insights can change strategy."

"The surveys and logs data tell us the what, but qualitative research tells us the why."

"One converted analyst became our research associate, and his enthusiasm was contagious."

"Getting the data out of laptops and onto the walls made the research physical and accessible."

"It’s not about the methodology, it’s about bravery and leadership."

"Find those curious partners who will evangelize the value of your insights to their peers."

"Researchers are experts at empathy and understanding motivations, which are superpowers beyond just interviewing users."

"Small experiments, planting seeds over time, can shift hearts and minds more effectively than big radical changes."

"Our insights became pillars of the 2020 product strategy and qualitative research earned a reserved seat at the table."

Ask the Rosenbot
Sam Proulx
Online Shopping: Designing an Accessible Experience
2023 • Advancing Research 2023
Gold
Jorge Arango
[Demo] How to re-categorize content at scale using LLMs
2024 • Designing with AI 2024
Gold
Panel Discussion: Communicating the Value of DesignOps
2018 • DesignOps Summit 2018
Gold
Uday Gajendar
Theme Four Intro
2023 • Enterprise UX 2023
Gold
Alnie Figueroa
Teamwork: Strategies for Effective Collaboration with Other Program Management Teams
2022 • DesignOps Summit 2022
Gold
Jim Kalbach
Jazz Improvisation as a Model for Team Collaboration
2019 • Enterprise Experience 2019
Gold
Matt Duignan
Atomizing Research: Trend or Trap
2020 • Advancing Research 2020
Gold
Yunyan Li
UX Best Practices
2021 • Design at Scale 2021
Gold
Sohit Karol
Designing Delightful Listening Experiences: Mixed Methods Research in the Age of Machine Learning
2020 • Advancing Research 2020
Gold
Jorge Arango
AI as Thought Partner: How to Use LLMs to Transform Your Notes (3rd of 3 seminars)
2024 • Rosenfeld Community
Heidi Trost
When AI Becomes the User’s Point Person—and Point of Failure
2025 • Rosenfeld Community
Hana Nagel
Turning Research Ripples into Waves
2018 • DesignOps Summit 2018
Gold
Steve Portigal
Discussion
2015 • Enterprise UX 2015
Gold
Max Gadney
Assessing UX jobs for impact in climate
2024 • Climate UX Interest Group
Vanessa Varin
Feedback: The Other F-Word
2025 • DesignOps Summit 2025
Gold
Cennydd Bowles
Exit Interview #2: Rediscovering the ethical heart of design
2025 • Rosenfeld Community

More Videos

Erin Hauber

"Change is a constant in design, but at USAA it often felt like change within change — inception-like change."

Erin Hauber

Design is Not the Frosting on the Scaled Agile Layer Cake

October 24, 2019

Megan Kierstead

"The more senior you become, the more focus shifts from methodology to interpersonal qualities like empathy and bravery."

Megan Kierstead

You Are a Badass at UX: Overcoming Imposter Syndrome

March 10, 2021

Maggie Dieringer

"Getting designers into a cadence of reviewing work with senior stakeholders was not a muscle the team had built."

Maggie Dieringer

Creating Consistency Through Constant Change

January 8, 2024

Meaghan Waters

"All negative outcomes in legacy modernization can be traced back to not bringing product thinking to the table."

Meaghan Waters Fotina Koutropoulous

Lack of Product Thinking will Doom Your Legacy Modernization

June 9, 2021

Jemma Ahmed

"Segmentation isn’t owned by market or user research anymore; it’s becoming data-driven and integrated across disciplines."

Jemma Ahmed

Bringing together market and user research

October 17, 2019

Maria Taylor

"Trust is a major enabler for tacit knowledge sharing because people must feel safe to be vulnerable and share their knowledge."

Maria Taylor

Knowledge is Power: Managing the Lifeblood of the Design Org

October 3, 2023

Sam Proulx

"No one uses the screen reader with out-of-the-box settings; users customize it to fit their needs."

Sam Proulx

Understanding Screen Readers on Mobile: How And Why to Learn from Native Users

June 6, 2023

Catherine Blizzard

"We introduced 'go-to' people, like account managers, responsible for particular business areas to maintain relationships."

Catherine Blizzard

Using Integrated Insight to Drive Growth

March 10, 2022

Randolph Duke II

"Flat Carol was a nearly life-size cardboard cutout of Carol."

Randolph Duke II

War Stories LIVE! Randy Duke II

March 30, 2020