Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

UX Research Excellence Framework
Gold
Thursday, March 11, 2021 • Advancing Research 2021
Share the love for this talk
UX Research Excellence Framework
Speakers: George Zhang and Molly Stevens
Link:

Summary

A multidisciplinary research team needs a well-crafted framework to guide their behavior, nurture their growth, and cultivate their culture. Otherwise, they feel stuck in growth and unmotivated to collaborate. Through a participatory design, the authors established a three-pillar excellence framework at Uber. First, it focuses on the research impact on product experimentation, products, roadmaps, and the company/organization. Second, it promotes creative research methods that successfully prioritize work, produce and scale rigorous insights, and empower other researchers. Third, it recognizes true partnership cross functional teams and beyond their own product area. This framework worked well at Uber for years, and recently was applied by the authors in Booking.com and Course Hero with some modifications. As this starter framework, they hope all researchers and research leaders can build their own ones based on their situations.

Key Insights

  • A structured framework helps research managers balance project prioritization, methodology, and partnership to scale research teams effectively.

  • Prioritizing projects requires explicit scoring on customer impact, business impact, and collaboration quality to make decisions transparent.

  • Building an impact matrix to plan a year’s worth of research work ensures teams balance one-time feature tests with recurring and strategic studies.

  • Simplicity in research methods enables scalability, reliability, and global applicability, as exemplified by Uber’s intercept survey for drivers.

  • Moving research upstream — engaging early with product development — prevents costly late-stage changes and leads to faster, better decisions.

  • Cross-functional partnerships, especially with product, data science, and engineering, are crucial to successful research integration.

  • Ethical considerations are foundational to research excellence and must be embedded in project selection, operations, and leadership support.

  • In new or uncharted research spaces, starting with impact definition guides methodology and collaboration to build foundational knowledge.

  • Prioritizing between customer impact and business impact is often a balancing act that benefits from transparent scoring and team conversations.

  • Recognition programs like monthly research excellence awards foster team motivation and continuous improvement in impact, method choice, and partnership.

Notable Quotes

"To have a strategy you need to think about how to prioritize."

"Being simple is extremely complex. Therefore very difficult to do."

"Simple methods are most global, either to do or scale."

"Research work is always called in later at execution stage; we needed to move it upstream."

"After the privacy study, safety and privacy teams combined because users saw them as the same."

"We had to commit to changes, try, execute, and adjust — it’s rarely a clean linear path."

"You can’t do every project that comes in; you need a meaningful way to compare and prioritize."

"The intercept driver survey is more reliable than NPS and worked well even with illiterate drivers using emojis."

"If you’re asked to do something unethical or uncomfortable, don’t do it; leadership must back you up."

"Many times, business and user interests appear to clash, but deeper research can reveal aligned solutions."

Ask the Rosenbot
Bria Alexander
Opening Remarks
2021 • DesignOps Summit 2021
Gold
Charles Lee
Building a New Home for the Atlassian Design System (Videoconference)
2020 • Enterprise Community
Natalie M. Dunbar
DesignOps and Content Strategy: Envisioning the Future Together
2021 • DesignOps Summit 2021
Gold
Peace is waged with sticky notes: Mapping Real-World Experiences
2018 • Enterprise Experience 2018
Gold
Pippa Lomas
Paving the Path for Neurodiversity in Design
2023 • DesignOps Summit 2023
Gold
Erin Weigel
UX Lessons from running more than 1,200 A/B Tests (Videoconference)
2024 • Rosenfeld Community
Tiffany Cheng
Designing in a Pandemic: Integrating Speed and Rigor
2022 • Design at Scale 2022
Gold
Jemma Ahmed
Democratization: Working with it, not against it [Advancing Research Community Workshop Series]
2024 • Advancing Research Community
Carla Casariego
DesignOps in Wonderland
2019 • DesignOps Summit 2019
Gold
Jemma Ahmed
Collaboration: learning from other fields beyond our own [Advancing Research Community Workshop Series]
2024 • Advancing Research Community
Kristin Skinner
Five Years of DesignOps
2021 • DesignOps Summit 2021
Gold
Joseph Williams
Unlocking impact and influence through inclusive hiring in research (Videoconference)
2021 • Advancing Research Community
Saara Kamppari-Miller
Key Metrics: Comparing Three Letter Acronym Metrics That Include the Word “Key”
2024 • DesignOps Community
Kristin Taylor
Building Bridges Across Organizational Silos
2022 • Civic Design 2022
Gold
Megan Nipe
Human-Centered Design for Engagement: Maturing from Newsletterville to Personalized, One-to-One Messaging
2021 • Civic Design 2021
Gold
Jackie Ho
Lead Effectively While Preserving Team Autonomy with Growth Boards
2024 • Enterprise Experience 2020
Gold

More Videos

"You’re born on third base but think you hit a triple — that’s the enterprise software delusion."

Standardizing Product Merits for Leaders, Designers, and Everyone

June 15, 2018

Simon Wardley

"Space has meaning in a map—if you move components around without reason, it’s no longer a map."

Simon Wardley

Maps and Topographical Intelligence (Videoconference)

January 31, 2019

Sandra Camacho

"If you’re in tech, you are in social change, whether you realize it or not."

Sandra Camacho

Creating More Bias-Proof Designs

January 22, 2025

Darian Davis

"By observing, appealing to interests, and promoting accountability, we can build empathy and respect to combat toxicity."

Darian Davis

Lessons from a Toxic Work Relationship

January 8, 2024

Fisayo Osilaja

"After each interview, I input the transcript into ChatGPT and ask for three key takeaways that I can quickly share with stakeholders."

Fisayo Osilaja

[Demo] The AI edge: From researcher to strategist

June 4, 2024

Uday Gajendar

"Nobody wants to buy or use a sloppy product, especially when enterprise users engage daily for hours."

Uday Gajendar

The Wicked Craft of Enterprise UX

May 13, 2015

Davis Neable

"Relying on a single content strategist was a strategic mistake that created a single point of failure."

Davis Neable Guy Segal

How to Drive a Design Project When you Don’t Have a Design Team

June 10, 2021

Eniola Oluwole

"People felt designs were self-evident and too much explanation was a barrier to using the patterns."

Eniola Oluwole

Lessons From the DesignOps Journey of the World's Largest Travel Site

October 24, 2019

Aurobinda Pradhan

"Finding a single source of truth for design documents and artifacts is extremely hard because most tools operate in silos."

Aurobinda Pradhan Shashank Deshpande

Introduction to Collaborative DesignOps using Cubyts

September 9, 2022