Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

User Science: Product Analytics & User Research
Gold
Thursday, March 11, 2021 • Advancing Research 2021
Share the love for this talk
User Science: Product Analytics & User Research
Speakers: Marieke McCloskey
Link:

Summary

Want to help make better product decisions? You've got to combine qualitative human insights from user research with data analytics and experimentation. Too often research questions are "sent to the team that can answer them best." Questions about how many users do something goes to analytics, questions about which design might work better goes to user research. But what if you partnered with those other teams to answer the questions together? In this session Marieke will share how, as a qualitative UX researcher she's partnered with analysts to identify high-growth opportunities and gain a deeper understanding of users.

Key Insights

  • Combining qualitative research and data science leads to richer, more actionable user insights.

  • Early collaboration between UX researchers and data teams helps reconcile conflicting insights.

  • Identifying highly engaged users (‘activators’) through data-derived engagement scores focuses research efforts.

  • Organizational buy-in and leadership support are critical to integrated user science approaches.

  • Curious and thoughtful data partners who understand and care about people are optimal collaborators.

  • Using shared language around metrics improves understanding and communication across teams.

  • Opportunity solution trees help align research questions and experiments with strategic outcomes.

  • Ethical considerations are important when interpreting engagement metrics; more usage isn't always better.

  • UX researchers are well-positioned to bridge gaps due to their cross-functional skills and storytelling ability.

  • Data literacy among UX researchers doesn't require full expertise but benefits from honesty and collaboration with experts.

Notable Quotes

"If you're a person who studies people, then you're a person who understands data."

"We get stuck answering questions we know we can find answers to, and lose the chance to see the big picture."

"The data teams want the company to be successful just like UX researchers do."

"I shared Brent Turetsky's article to spark curiosity and start collaboration with my data partner."

"Many meetings and doc edits later, he realized interviewing wasn’t for him but deeply respected it."

"We’ve affectionately called our most engaged users activators – those intrigued and motivated by learning."

"It’s not about calling you a UX researcher or product analyst but about understanding how users interact."

"Leadership said discovering more about these most active users is a key priority this year."

"The earliest collaboration helps present a unified case rather than conflicting insights to product managers."

"I have way more power in the insights I gather from interviews than any of the data analysis."

Bria Alexander
Opening Remarks
2021 • Design at Scale 2021
Gold
Roy Opata Olende
How Zapier Uses ‘All Hands Research’ to Increase Exposure to Users (Videoconference)
2020 • Advancing Research Community
Alnie Figueroa
Teamwork: Strategies for Effective Collaboration with Other Program Management Teams
2022 • DesignOps Summit 2022
Gold
Theresa Marwah
How Atlassian is Operationalizing Respect in Research (Videoconference)
2020 • Advancing Research Community
Jodi Forlizzi
Design and AI innovation
2024 • Designing with AI 2024
Gold
James Chudley
Decarbonising User Journeys: How minimising enables us to do more with less
2025 • Climate UX Interest Group (Rosenfeld Community)
Ana Ferreira
Designing Distributed: Leading Doist’s Fully Remote Design Team in Six Countries
2024 • DesignOps Summit 2020
Gold
Lisanne Norman
Why I Left Research
2023 • Advancing Research 2023
Gold
Julie Baher
Culture Change—My Journey
2015 • Enterprise UX 2015
Gold
Lisa Spitz
Building Trust Through Equitable Research Practices
2022 • Civic Design 2022
Gold
Bria Alexander
Day 2 Welcome
2024 • DesignOps 2024
Gold
Nalini P. Kotamraju
An Organizational Story: Salesforce Lightning Design System
2016 • Enterprise UX 2016
Gold
Magdalena Zadara
Zero Hour: How to Get Far Quickly When Starting Your Digital Service Unit Late
2022 • Civic Design 2022
Gold
Renee Bouwens
Landing Product Impact: Aligning Research as a Foundational Driver for Delivering the World’s Best Products (Videoconference)
2023 • QuantQual Interest Group (Rosenfeld Community)
Ovetta Sampson
Turning UX Passion into Real Product Influence
2023 • Enterprise UX 2023
Gold
Mac Smith
Measuring Up: Using Product Research for Organizational Impact
2021 • Advancing Research 2021
Gold

More Videos

Daniela Magaña Flores

"The Product React uses reaction time to capture the user’s gut feeling that otherwise remains hidden."

Daniela Magaña Flores Ariane Rahn Jeff Ephraim Bander

Ahead of Competition: Learn What UX Benchmarking Can Do for Your Business Today

March 10, 2022

Savina Hawkins

"I’m willing to bet that every researcher in this room by the end of 2025 will add prompt engineering to their research skillset."

Savina Hawkins

Harnessing AI in UXR: Practical Strategies for Positive Impact

March 26, 2024

Alex Hurworth

"Restoration is not just about replanting trees; it’s about rebuilding entire ecosystems."

Alex Hurworth Bonnie John Fahd Arshad Antoine Marin

Designing a Contact Tracing App for Universal Access

October 23, 2020

Matt Duignan

"The goal is to transform raw data into wisdom — knowing what to do with the knowledge gathered."

Matt Duignan

HITS, Microsoft's internal human insight system: From research library to living body of knowledge (Videoconference)

July 16, 2019

Craig Villamor

"Dark patterns trick or manipulate users into doing something they wouldn’t normally do or against their own or society’s best interests - Craig Vor."

Craig Villamor

Design Systems for Ethical Design (Videoconference)

January 26, 2023

Ovetta Sampson

"Move from thoughts to things — the faster you get something tangible, the faster people stop debating opinions."

Ovetta Sampson

Turning UX Passion into Real Product Influence

June 7, 2023

Rima Campbell

"To advance design maturity, you need a tight business partnership between product management and design ops leaders."

Rima Campbell Amrit S Bhachu

Increase Productivity and Drive Business Impact

September 24, 2024

Amy Gawronski Zuccaro

"Not being a people manager means I’m kind of an objective third party who can help with career conversations."

Amy Gawronski Zuccaro

Advice for DesignOps Employee #1

September 29, 2021

Victor Udoewa

"Whiteness isn’t just the color or race; people of all colors can reinforce white supremacy."

Victor Udoewa

Beyond Methods and Diversity: The Roots of Inclusion

March 26, 2024