Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

UX Research Excellence Framework
Gold
Thursday, March 11, 2021 • Advancing Research 2021
Share the love for this talk
UX Research Excellence Framework
Speakers: George Zhang and Molly Stevens
Link:

Summary

A multidisciplinary research team needs a well-crafted framework to guide their behavior, nurture their growth, and cultivate their culture. Otherwise, they feel stuck in growth and unmotivated to collaborate. Through a participatory design, the authors established a three-pillar excellence framework at Uber. First, it focuses on the research impact on product experimentation, products, roadmaps, and the company/organization. Second, it promotes creative research methods that successfully prioritize work, produce and scale rigorous insights, and empower other researchers. Third, it recognizes true partnership cross functional teams and beyond their own product area. This framework worked well at Uber for years, and recently was applied by the authors in Booking.com and Course Hero with some modifications. As this starter framework, they hope all researchers and research leaders can build their own ones based on their situations.

Key Insights

  • A structured framework helps research managers balance project prioritization, methodology, and partnership to scale research teams effectively.

  • Prioritizing projects requires explicit scoring on customer impact, business impact, and collaboration quality to make decisions transparent.

  • Building an impact matrix to plan a year’s worth of research work ensures teams balance one-time feature tests with recurring and strategic studies.

  • Simplicity in research methods enables scalability, reliability, and global applicability, as exemplified by Uber’s intercept survey for drivers.

  • Moving research upstream — engaging early with product development — prevents costly late-stage changes and leads to faster, better decisions.

  • Cross-functional partnerships, especially with product, data science, and engineering, are crucial to successful research integration.

  • Ethical considerations are foundational to research excellence and must be embedded in project selection, operations, and leadership support.

  • In new or uncharted research spaces, starting with impact definition guides methodology and collaboration to build foundational knowledge.

  • Prioritizing between customer impact and business impact is often a balancing act that benefits from transparent scoring and team conversations.

  • Recognition programs like monthly research excellence awards foster team motivation and continuous improvement in impact, method choice, and partnership.

Notable Quotes

"To have a strategy you need to think about how to prioritize."

"Being simple is extremely complex. Therefore very difficult to do."

"Simple methods are most global, either to do or scale."

"Research work is always called in later at execution stage; we needed to move it upstream."

"After the privacy study, safety and privacy teams combined because users saw them as the same."

"We had to commit to changes, try, execute, and adjust — it’s rarely a clean linear path."

"You can’t do every project that comes in; you need a meaningful way to compare and prioritize."

"The intercept driver survey is more reliable than NPS and worked well even with illiterate drivers using emojis."

"If you’re asked to do something unethical or uncomfortable, don’t do it; leadership must back you up."

"Many times, business and user interests appear to clash, but deeper research can reveal aligned solutions."

Ask the Rosenbot
Wendy Johansson
An Education on Design Education for Orgs
2021 • Design at Scale 2021
Gold
Laura Weiss
There is No Playbook: Leader as Coach During Challenging Times (Videoconference)
2024 • Rosenfeld Community
Sarah Brooks
Theme Three Intro
2022 • Civic Design 2022
Gold
Bob Baxley
Theme 4: Discussion
2024 • Enterprise Experience 2020
Gold
Bria Alexander
Day 2 Welcome
2024 • DesignOps 2024
Gold
Joe Meersman
Use AI to Drive Outcomes that Go Beyond the Design Sprint
2024 • DesignOps 2024
Gold
Shipra Kayan
How Tess Dixon Facilitates Team Engagement and Collaboration at Condé Nast Using Miro 
2021 • DesignOps Summit 2021
Gold
Sheri Byrne-Haber
Accessibility at Scale
2021 • Design at Scale 2021
Gold
Husani Oakley
Theme Three Intro
2023 • Enterprise UX 2023
Gold
Marjorie Stainback
Transforming Strategic Research Capacity through Democratization
2019 • DesignOps Summit 2019
Gold
Zariah Cameron
Streamlining an Inclusive Design Practice
2023 • DesignOps Summit 2023
Gold
Lisa Spitz
Building Trust Through Equitable Research Practices
2022 • Civic Design 2022
Gold
Maria Giudice
Remaking the Making Company: Moving from Product to Experience
2016 • Enterprise UX 2016
Gold
Josh Clark
Sentient Design: New Design Patterns for New Experiences (3rd of 3 seminars)
2025 • Rosenfeld Community
Jack Behar
How to Build Prototypes that Behave like an End-Product
2022 • Design in Product 2022
Gold
Mujtaba Hameed
Frameworks for Excellence: Using Visual Thinking and Communication to Elevate Your Research
2024 • Advancing Research 2024
Gold

More Videos

Alex Hurworth

"The health of our planet directly influences our health and survival."

Alex Hurworth Bonnie John Fahd Arshad Antoine Marin

Designing a Contact Tracing App for Universal Access

October 23, 2020

Laine Riley Prokay

"We started to ask ourselves, does every new Design Ops practitioner need 10 years of experience like Lisa and I? What opportunities are we missing by not having more junior roles?"

Laine Riley Prokay Lisa Gordon

Carving a Path for Early Career DesignOps Practitioners

September 9, 2022

Eniola Oluwole

"People felt designs were self-evident and too much explanation was a barrier to using the patterns."

Eniola Oluwole

Lessons From the DesignOps Journey of the World's Largest Travel Site

October 24, 2019

Nathan Shedroff

"Design researchers know customers better than almost anyone else in the organization, yet they are rarely invited into strategy processes."

Nathan Shedroff

Double Your Mileage: Use Your Research Strategically

March 31, 2020

Sam Proulx

"Apple premiered mobile accessibility in a very exciting way with the iPhone 3GS and VoiceOver announcement at WWDC."

Sam Proulx

Mobile Accessibility: Why Moving Accessibility Beyond the Desktop is Critical in a Mobile-first World

November 17, 2022

Feleesha Sterling

"It’s important to socialize the research program internally so teams get excited and take initiative."

Feleesha Sterling

Building a Rapid Research Program (Videoconference)

May 18, 2023

Neil Barrie

"Brand and product become two sides of the same coin when user insights have a seat at the top table."

Neil Barrie

Widening the Aperture: The Case for Taking a Broader Lens to the Dialogue between Products and Culture

March 25, 2024

John Devanney

"Incremental improvements and disruptive innovation require very different methods and measures."

John Devanney

The Design Management Office

November 6, 2017

Katy Mogal

"The most important thing is producing something that gives a perspective nobody else in the organization can bring."

Katy Mogal

But Do Your Insights Scale?

March 12, 2021