Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Measuring Up: Using Product Research for Organizational Impact

Gold
Friday, March 12, 2021 • Advancing Research 2021
Share the love for this talk
Measuring Up: Using Product Research for Organizational Impact
Speakers: Mac Smith
Link:

Summary

Research for product work is well established; but how do you lead your research team to shape organizational goals? We’ll use a case study from Google to demonstrate how many of the same techniques, methods, and skills you and your team have today can be used to guide an organization’s goals. We’ll also discuss key changes to make for organizational success - from integrating with other insight functions to shifting how your team defines themselves and their work. The results are research organizations that produce insights to impact how your organization defines their goals.

Key Insights

  • Early UX research focused on evaluating decisions after they were made, but now researchers can influence product strategy and organizational alignment.

  • Assessing how the organization and research teams perceive themselves is crucial to identify gaps and opportunities for influence.

  • Researchers often excel in craft and domain expertise but may lack critical business acumen and advising skills, which limits their impact.

  • Setting an audacious, long-term goal energizes teams and elevates their mindset towards influencing leadership-level decisions.

  • All customer contact can be strategic if research questions are intentionally mapped to organizational goals; the tactical vs strategic distinction is often false.

  • Finding a high-level champion before defining problems is essential to accessing key information and aligning research efforts with business priorities.

  • Collaboration across user research, data science, and market research enables producing trusted, generalizable data for executives.

  • Mapping research findings to business metrics, like queries in search, makes the impact clear and drives organizational buy-in.

  • Delivering strategic insights becomes easier after careful preparation and alignment phases focused on relationships and timing.

  • Individual researchers can advance influence by leveraging established relationships and growing business and advising skills alongside their research craft.

Notable Quotes

"Leadership growth among UX research is still fairly organic, so we need to learn how to establish ourselves to take leadership roles."

"If you can follow the simple steps of preparing, aligning, and delivering, you can shift the focus and impact of your team."

"We had a great depth of customer understanding, but our view of partners was two-dimensional; we didn't know their needs or goals well."

"Success was often about personal relationships; having the right data wasn’t enough without the right connections."

"Many leaders didn’t know how to engage with research beyond usability and experimentation."

"We set a two-year goal to advise leadership on top issues for annual planning, even though we hadn’t figured out all the steps."

"Any customer contact is touching on strategic foundations — the tactical versus strategic mindset is a false dichotomy."

"Find your champion before you identify the problems to solve; this person helps navigate complex organizational alignment."

"User research excels at explaining why things happen; data science explains what and how; together they build trusted insight."

"By connecting complex user journeys to queries, we made the impact on business bottom lines explicit and compelling."

Ask the Rosenbot
Nicole Umphress
Delivering Design Education During a Global Pandemic: Lessons Learned
2022 • Design at Scale 2022
Gold
Meredith Black
Scaling Design Culture
2017 • DesignOps Summit 2017
Gold
Matt LeMay
You Don’t “Get” Anyone to Do Anything
2022 • Design in Product 2022
Gold
Brendan Jarvis
Framing Tomorrow by Questioning Today
2022 • Design at Scale 2022
Gold
Stephanie Wade
Building and Sustaining Design in Government
2021 • Civic Design 2021
Gold
Kristen Honey
"Let’s Talk About Data and Crisis”: Public Digital Service Delivery = Open Data + Human Centered Design
2021 • Civic Design Community
Helen Armstrong
Augment the Human. Interrogate the System.
2023 • Enterprise UX 2023
Gold
Theresa Neil
Just Build Me a Dashboard!
2019 • Enterprise Community
Erika Flowers
The Handoff is Dead: Design-Led Engineering with AI Agents
2026 • Rosenfeld Community
Nicole Aleong
What UX research can learn from other research practices [Advancing Research Community Workshop Series]
2023 • Advancing Research Community
Patrick Commarford
Design Staffing for Impact
2024 • DesignOps Summit 2020
Gold
Indi Young
Paying Better Attention to the Problem with Indi Young
2019 • Advancing Research Community
Meghan Hellstern
The Next 100 Years of Civic Design: How Might We Better Rise to Meet the Challenges of Today and Tomorrow?
2021 • Civic Design 2021
Gold
Mackenzie Cockram
Integrating Qualitative and Quantitative Research from Discovery to Live
2022 • QuantQual Interest Group
Joshua Noble
Casual Inference
2023 • QuantQual Interest Group
Alla Weinberg
Design Teams Need Psychological Safety: Here’s How to Create It
2022 • DesignOps Summit 2022
Gold

More Videos

Joanna Vodopivec

"Building strong relationships with marketing requires mutual respect and regularly following up on their insights."

Joanna Vodopivec Prabhas Pokharel

One Research Team for All - Influence Without Authority

March 9, 2022

Louis Rosenfeld

"My husband told me to Pace and Brace—I was pushing too hard and burnt out within a year and a half."

Louis Rosenfeld Lashanda Hodge Senongo Akpem Chris Hodowanec

Becoming a Civic Designer: Making the Move from Private to Public Sector

November 17, 2022

Bria Alexander

"We are closing out design ops 2024 with innovation curated by the incomparable John Kuda."

Bria Alexander

Day 3 Welcome

September 25, 2024

Uday Gajendar

"We have a code of conduct. It’s not just window dressing, it’s the front door to a process with people behind it."

Uday Gajendar Louis Rosenfeld

Day 2 Welcome

June 5, 2024

Sam Proulx

"I’ve nearly bought products in my sleep because I memorized the key presses from consistent checkout flows."

Sam Proulx

Online Shopping: Designing an Accessible Experience

June 7, 2023

Russ Unger

"Waiting and vague communication during hiring is a painful guessing game for candidates."

Russ Unger

Onboarding: The Ecosystem, not the Afterthought

November 7, 2017

Catherine Dubut

"The store mobile device is the indispensable silent partner enabling store employees to balance task productivity and customer engagement."

Catherine Dubut

Bridging Physical and Digital Spaces: Approaches to Retail Service Design

March 18, 2021

Josh Clark

"Agents set goals, plan steps, execute them, and decide when they’re done, often without user attention."

Josh Clark Veronika Kindred

Sentient Design: New Postures for AI-Mediated Experiences (2nd of 3 seminars)

January 29, 2025

Dantley Davis

"I made an explicit choice: we’re not making any offers until we’re interviewing women."

Dantley Davis

Leadership & Diversity—A Fireside Chat with Dantley Davis

September 17, 2020