Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

UX Research Excellence Framework
Gold
Thursday, March 11, 2021 • Advancing Research 2021
Share the love for this talk
UX Research Excellence Framework
Speakers: George Zhang and Molly Stevens
Link:

Summary

A multidisciplinary research team needs a well-crafted framework to guide their behavior, nurture their growth, and cultivate their culture. Otherwise, they feel stuck in growth and unmotivated to collaborate. Through a participatory design, the authors established a three-pillar excellence framework at Uber. First, it focuses on the research impact on product experimentation, products, roadmaps, and the company/organization. Second, it promotes creative research methods that successfully prioritize work, produce and scale rigorous insights, and empower other researchers. Third, it recognizes true partnership cross functional teams and beyond their own product area. This framework worked well at Uber for years, and recently was applied by the authors in Booking.com and Course Hero with some modifications. As this starter framework, they hope all researchers and research leaders can build their own ones based on their situations.

Key Insights

  • A structured framework helps research managers balance project prioritization, methodology, and partnership to scale research teams effectively.

  • Prioritizing projects requires explicit scoring on customer impact, business impact, and collaboration quality to make decisions transparent.

  • Building an impact matrix to plan a year’s worth of research work ensures teams balance one-time feature tests with recurring and strategic studies.

  • Simplicity in research methods enables scalability, reliability, and global applicability, as exemplified by Uber’s intercept survey for drivers.

  • Moving research upstream — engaging early with product development — prevents costly late-stage changes and leads to faster, better decisions.

  • Cross-functional partnerships, especially with product, data science, and engineering, are crucial to successful research integration.

  • Ethical considerations are foundational to research excellence and must be embedded in project selection, operations, and leadership support.

  • In new or uncharted research spaces, starting with impact definition guides methodology and collaboration to build foundational knowledge.

  • Prioritizing between customer impact and business impact is often a balancing act that benefits from transparent scoring and team conversations.

  • Recognition programs like monthly research excellence awards foster team motivation and continuous improvement in impact, method choice, and partnership.

Notable Quotes

"To have a strategy you need to think about how to prioritize."

"Being simple is extremely complex. Therefore very difficult to do."

"Simple methods are most global, either to do or scale."

"Research work is always called in later at execution stage; we needed to move it upstream."

"After the privacy study, safety and privacy teams combined because users saw them as the same."

"We had to commit to changes, try, execute, and adjust — it’s rarely a clean linear path."

"You can’t do every project that comes in; you need a meaningful way to compare and prioritize."

"The intercept driver survey is more reliable than NPS and worked well even with illiterate drivers using emojis."

"If you’re asked to do something unethical or uncomfortable, don’t do it; leadership must back you up."

"Many times, business and user interests appear to clash, but deeper research can reveal aligned solutions."

Ask the Rosenbot
Mohammad Hossein Jarrahi
Contextuality problem: Exploring the Benefits of Qualitative and Quantitative Research
2023 • QuantQual Interest Group (Rosenfeld Community)
Teresa Swingler
Look, Up in the Sky! UX/UI for Aerospace (Videoconference)
2022 • Enterprise Community
Sam Proulx
Accessibility: An Opportunity to Innovate
2022 • DesignOps Summit 2022
Gold
Jemma Ahmed
Theme 2 Intro
2024 • Advancing Research 2024
Gold
Sarah Williams
A Framework for CX Transformation
2021 • Design at Scale 2021
Gold
Sam Yen
Driving Organizational Change Through Design? Do more of this and less of that
2017 • Enterprise Experience 2017
Gold
Etienne Fang
The Power of Care: From Human-Centered Research to Humanity-Centered Leadership
2021 • Advancing Research 2021
Gold
Patrizia Bertini
DesignOps + KPIs = Measure your Impact!
2024 • DesignOps Summit 2020
Gold
Uday Gajendar
Theme One Intro
2023 • Enterprise UX 2023
Gold
Francesca Barrientos, PhD
You Need Your Own Definition of Design Maturity
2022 • Design at Scale 2022
Gold
Kevin Bethune
Reimagining Design: Unlocking Strategic Innovation
2022 • Design at Scale 2022
Gold
George Zhang
UX Research Excellence Framework
2021 • Advancing Research 2021
Gold
Dr. Jamika D. Burge
A Genuine Conversation about the Future of UX Research (Videoconference)
2024 • Advancing Research Community
Meaghan Waters
Lack of Product Thinking will Doom Your Legacy Modernization
2021 • Design at Scale 2021
Gold
Samuel Proulx
Invisible barriers: Why accessible service design can’t be an afterthought
2024 • Advancing Service Design 2024
Gold
Alissa Briggs
How to Coach Enterprise Experimentation
2015 • Enterprise UX 2015
Gold

More Videos

Angelos Arnis

"It is imperative that we maintain hope, even when the harshness of reality may suggest the opposite. — Paola Freire"

Angelos Arnis

Navigating the Rapid Shifts in Tech's Turbulent Terrain

October 2, 2023

John Calhoun

"Prioritizing design ops work is tough amid competing priorities and limited time and budget."

John Calhoun Rachel Posman

Bring your DesignOps Story to Life! The Definitive DesignOps Book Jam

October 3, 2023

Alfred Kahn

"Instead of saying no, try asking why and focus on the problems to be solved rather than specific stakeholder solutions."

Alfred Kahn

A Seat at the Table: Making Your Team a Strategic Partner

November 29, 2023

Dan Willis

"No matter how good I think I am at my job, it doesn’t make me a good parent."

Dan Willis

Enterprise Storytelling Sessions

June 3, 2019

John Maeda

"Leading with the customer inside and out, rather than any one discipline, is key for true teamwork."

John Maeda Alison Rand

About Design Organizations (Videoconference)

May 13, 2019

Anat Fintzi

"Involving partners directly is powerful: tell me and I forget, show me and I may remember, involve me and I understand."

Anat Fintzi Rachel Minnicks

Delivering at Scale: Making Traction with Resistant Partners

June 9, 2022

Uday Gajendar

"Nobody wants to buy or use a sloppy product, especially when enterprise users engage daily for hours."

Uday Gajendar

The Wicked Craft of Enterprise UX

May 13, 2015

Kristin Skinner

"We were really forming a community of people who I like to call maybe design ops curious."

Kristin Skinner

Theme 1 Intro

September 29, 2021

Maish Nichani

"Closing the learning-doing gap means moving from making content just to publish, to making content that ensures the customer’s job is done."

Maish Nichani

Sparking a Service Excellence Mindset at a Government Agency

December 9, 2021