Rosenverse
UX Research Excellence Framework

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

UX Research Excellence Framework

Gold
Thursday, March 11, 2021 • Advancing Research 2021
Share the love for this talk
UX Research Excellence Framework
Speakers: George Zhang and Molly Stevens
Link:

Summary

A multidisciplinary research team needs a well-crafted framework to guide their behavior, nurture their growth, and cultivate their culture. Otherwise, they feel stuck in growth and unmotivated to collaborate. Through a participatory design, the authors established a three-pillar excellence framework at Uber. First, it focuses on the research impact on product experimentation, products, roadmaps, and the company/organization. Second, it promotes creative research methods that successfully prioritize work, produce and scale rigorous insights, and empower other researchers. Third, it recognizes true partnership cross functional teams and beyond their own product area. This framework worked well at Uber for years, and recently was applied by the authors in Booking.com and Course Hero with some modifications. As this starter framework, they hope all researchers and research leaders can build their own ones based on their situations.

Key Insights

  • A three-part research framework focused on impact, methods, and partnership can guide teams in fast-paced, changing environments.

  • Prioritizing research projects using a rubric including customer impact, business impact, and collaboration quality helps clarify trade-offs and resource allocation.

  • An impact matrix balancing one-time, roadmap, experiment, and ongoing research types ensures a balanced and sustainable research portfolio.

  • Simple, scalable research methods like mobile intercept surveys can provide reliable, valid data across languages and contexts.

  • Moving research involvement earlier in the product development process accelerates decision-making and avoids costly mistakes.

  • Cross-functional partnerships with data science, engineering, and product teams are crucial for integrating research effectively and efficiently.

  • Recognition programs like monthly research excellence awards help sustain team motivation and highlight success.

  • Ethics should be embedded as a core value both in research operations and project prioritization.

  • Entering net new research domains requires focusing first on impact definition, then methods suited for subjective and complex human factors.

  • Balancing business and customer impact often reveals aligned interests rather than conflicts, as in the example of early trip cancellations improving user control.

Notable Quotes

"We developed this research framework during our time at Uber together with an extended leadership team as the team grew from 30 to 100."

"To have a strategy you need to think about how to prioritize, because you can’t do all the research requests that come in."

"Being simple is extremely complex. Adding complexity is easy, but simplicity requires discipline and focus."

"Our intercept survey is more reliable than NPS and works well even for illiterate drivers because it uses emojis as response options."

"Moving research upstream in the product process helps solve problems faster and save millions of dollars."

"We always recommend starting with one method and adding another only when absolutely needed."

"Ethics is a very important part of any user research team and should be a foundational part of how you evaluate work."

"If you’re the first researcher in a big org or new domain, focus on defining impact before deciding methodology and partnerships."

"Sometimes business and user interests seem opposed, but thoughtful research reveals ways to align them, like early trip cancellations."

"Recognition programs help create a happy, inclusive, and high-performing global team focused on impact."

Ask the Rosenbot
Ovetta Sampson
Research in the Automated Future
2022 • Advancing Research 2022
Gold
Benjamin Wiedmaier
Redefining Toolkits: Unbundling to Create a Perfect Match
2025 • Advancing Research 2025
Gold
Janaki Kumar
Innovate with Purpose
2018 • Enterprise Experience 2018
Gold
Ivana Ng
Level Up Your Program with ProductOps
2024 • Enterprise Experience 2020
Gold
Victor M. Gonzalez
Practicing Learners and Learning Practitioners
2021 • Advancing Research 2021
Gold
Harry Brignull
Beyond Clicks and Tricks: Why deceptive design has grown into a regulatory faultline
2026 • Rosenfeld Community
Roy Opata Olende
How Zapier Uses ‘All Hands Research’ to Increase Exposure to Users
2020 • Advancing Research Community
Shivanjali M.
From Fragmented to Fluent: The Linguistic Approach to Research Knowledge
2026 • Rosenfeld Community
Carol Massa
Designing Health: Integrating Service Design, Technology, and Strategy to Transform Patient and Clinician Experiences
2024 • Advancing Service Design 2024
Gold
Ed Mullen
Designing the Unseen: Enabling Institutions to Build Public Trust
2022 • Civic Design 2022
Gold
Smitha Papolu
Theme 3 Discussion
2024 • Enterprise Experience 2020
Gold
John Cutler
Oxbows, Rivers, and Estuaries: How to navigate the currents of change (without burning out)
2024 • Advancing Service Design 2024
Gold
Megan Blocker
A Selectively Scrappy Approach to ResearchOps
2018 • DesignOps Summit 2018
Gold
Iram Shah
Closing Keynote: The View from the Top
2019 • Enterprise Experience 2019
Gold
Dr. Jamika D. Burge
Theme 3 Intro
2022 • Advancing Research 2022
Gold
Nora Tejeda
Scaling Design Capabilities at BBVA Through a Self-service Design Model
2021 • Design at Scale 2021
Gold

More Videos

Lavy Kumar

"The future of work is about making the user the hero—humans and machines working together."

Lavy Kumar Kat Temple Shan Sebastian Tara Jensen Jenn Chou

Future of Work

June 9, 2021

Andreas Huebner

"Leadership buy-in now means we get to focus on bigger, generative research questions instead of just tactical usability studies."

Andreas Huebner Amy Takata Craig Brookes

What Is It Like To Be Part of The UX Team at Compass?

March 11, 2021

Ricardo Martins

"Conjoint analysis was used by Apple and Samsung to determine the financial value of specific product features."

Ricardo Martins

Unlocking the power of advanced quantitative methods

March 12, 2025

Monty Hammontree

"The fastest way to gain influence is to get somebody else promoted."

Monty Hammontree

The Future of UX Research

December 3, 2020

Benjamin Real

"The C-suite often sees big change as resistance to change rather than needs for careful transition and impact understanding."

Benjamin Real

Showing the Value of DesignOps by Not Having a DesignOps Team

October 21, 2020

Kate Towsey

"Culture often makes the biggest difference in how research ops works across industries."

Kate Towsey

Ask Me Anything (AMA) with Kate Towsey

April 2, 2025

Steve Portigal

"The weakest insight method might win simply because of the relationship to the power structure."

Steve Portigal Chris Chapo Kelly Goto Christian Rohrer

Discussion

May 13, 2015

Sam Proulx

"Accessible foundations are built by involving voices of people with disabilities from ideation to prototyping to launch."

Sam Proulx

Online Shopping: Designing an Accessible Experience

March 28, 2023

Sam Proulx

"For screen reader users, you often need to build entirely new prototypes using systems like Microsoft Word or Google Docs to convey semantic information."

Sam Proulx

Prototype Reviews, People With Disabilities, and You

October 1, 2021