Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

UX Research Excellence Framework
Gold
Thursday, March 11, 2021 • Advancing Research 2021
Share the love for this talk
UX Research Excellence Framework
Speakers: George Zhang and Molly Stevens
Link:

Summary

A multidisciplinary research team needs a well-crafted framework to guide their behavior, nurture their growth, and cultivate their culture. Otherwise, they feel stuck in growth and unmotivated to collaborate. Through a participatory design, the authors established a three-pillar excellence framework at Uber. First, it focuses on the research impact on product experimentation, products, roadmaps, and the company/organization. Second, it promotes creative research methods that successfully prioritize work, produce and scale rigorous insights, and empower other researchers. Third, it recognizes true partnership cross functional teams and beyond their own product area. This framework worked well at Uber for years, and recently was applied by the authors in Booking.com and Course Hero with some modifications. As this starter framework, they hope all researchers and research leaders can build their own ones based on their situations.

Key Insights

  • A structured framework helps research managers balance project prioritization, methodology, and partnership to scale research teams effectively.

  • Prioritizing projects requires explicit scoring on customer impact, business impact, and collaboration quality to make decisions transparent.

  • Building an impact matrix to plan a year’s worth of research work ensures teams balance one-time feature tests with recurring and strategic studies.

  • Simplicity in research methods enables scalability, reliability, and global applicability, as exemplified by Uber’s intercept survey for drivers.

  • Moving research upstream — engaging early with product development — prevents costly late-stage changes and leads to faster, better decisions.

  • Cross-functional partnerships, especially with product, data science, and engineering, are crucial to successful research integration.

  • Ethical considerations are foundational to research excellence and must be embedded in project selection, operations, and leadership support.

  • In new or uncharted research spaces, starting with impact definition guides methodology and collaboration to build foundational knowledge.

  • Prioritizing between customer impact and business impact is often a balancing act that benefits from transparent scoring and team conversations.

  • Recognition programs like monthly research excellence awards foster team motivation and continuous improvement in impact, method choice, and partnership.

Notable Quotes

"To have a strategy you need to think about how to prioritize."

"Being simple is extremely complex. Therefore very difficult to do."

"Simple methods are most global, either to do or scale."

"Research work is always called in later at execution stage; we needed to move it upstream."

"After the privacy study, safety and privacy teams combined because users saw them as the same."

"We had to commit to changes, try, execute, and adjust — it’s rarely a clean linear path."

"You can’t do every project that comes in; you need a meaningful way to compare and prioritize."

"The intercept driver survey is more reliable than NPS and worked well even with illiterate drivers using emojis."

"If you’re asked to do something unethical or uncomfortable, don’t do it; leadership must back you up."

"Many times, business and user interests appear to clash, but deeper research can reveal aligned solutions."

Laura Klein
Unique challenges of innovation in enterprises (Videoconference)
2020 • Enterprise Community
Rittika Basu
Age and Interfaces: Equipping Older Adults with Technological Tools (Videoconference)
2023 • Advancing Research Community
Sara Asche Anderson
Not Your Ordinary Re-Brand: Design's Path to Driving Customer Obsession at Best Buy
2024 • Enterprise Experience 2020
Gold
Tristin Oldani
Turning awareness into action with Climate UX
2025 • Climate UX Interest Group (Rosenfeld Community)
Ted Neward
Theme 4: Enterprise Organizational Journey
2019 • Enterprise Experience 2019
Gold
Sarah Brooks
Fireside chat with Sarah Brooks and Jen Pahlka (Videoconference)
2021 • Civic Design Community
Mansi Gupta
Women-Centric Research: What, Why, How
2023 • Advancing Research 2023
Gold
Mandy Drew
What Role(s) Can Research Play in Responsible Design?
2021 • Advancing Research 2021
Gold
Carol Smith
Operationalizing Responsible, Human-Centered AI
2023 • Enterprise UX 2023
Gold
Jose Coronado
People First - Design at JP Morgan
2021 • Design at Scale 2021
Gold
Kate Koch
Flex Your Super Powers: When a Design Ops Team Scales to Power CX
2021 • DesignOps Summit 2021
Gold
Louis Rosenfeld
Opening Remarks
2023 • Design in Product 2023
Gold
Lada Gorlenko
Theme 1: Discussion
2024 • Enterprise Experience 2020
Gold
Catt Small
What's Next for ICs: Exploring Staff and Principal Designer Roles (Videoconference)
2024 • Rosenfeld Community
Erin May
Distributed, Democratized, Decentralized: Finding a Research Model to Support Your Org
2022 • Advancing Research 2022
Gold
Kristin Wisnewski
Measuring What Matters
2019 • DesignOps Summit 2019
Gold

More Videos

Bria Alexander

"We’re using Slack as the heart and soul of this conference — it's where the party is."

Bria Alexander Louis Rosenfeld

Welcome

September 8, 2022

Mike Oren

"Business leaders identified elimination of redundant processes as the number one value of design."

Mike Oren

Why Pharmaceutical's Research Model Should Replace Design Thinking

March 28, 2023

Jodi Forlizzi

"Sophisticated AI isn’t always needed; sometimes what’s really needed is a better website, not a fancy chatbot."

Jodi Forlizzi

Design and AI innovation

June 5, 2024

Bria Alexander

"Design ops is changing was our first theme, and today it’s all about practical design ops."

Bria Alexander

Opening Remarks

October 3, 2023

Michael Weir

"People remember how you made them feel more than what you said."

Michael Weir

Mixed Methods and Behavioural Science (Videoconference)

May 26, 2023

Molly Fargotstein

"We give out stickers for research participation, which people love and it sparks company-wide conversations about UX research."

Molly Fargotstein

Multipurpose Communication & UX Research Marketing (Videoconference)

September 12, 2019

Verónica Urzúa

"Applying techniques without question does not liberate good research outcomes."

Verónica Urzúa Jorge Montiel

The B-side of the Research Impact

March 12, 2021

Husani Oakley

"You can’t collaborate without or communicate upfront shared context."

Husani Oakley

Theme Two Intro

June 6, 2023

George Abraham

"We’re aiming for an 80% gain in efficiency to get your value out sooner from design to development."

George Abraham Stefan Ivanov

Design Systems To-Go: Reimagining Developer Handoff, and Introducing App Builder (Part 2)

October 1, 2021