Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

User Science: Product Analytics & User Research
Gold
Thursday, March 11, 2021 • Advancing Research 2021
Share the love for this talk
User Science: Product Analytics & User Research
Speakers: Marieke McCloskey
Link:

Summary

Want to help make better product decisions? You've got to combine qualitative human insights from user research with data analytics and experimentation. Too often research questions are "sent to the team that can answer them best." Questions about how many users do something goes to analytics, questions about which design might work better goes to user research. But what if you partnered with those other teams to answer the questions together? In this session Marieke will share how, as a qualitative UX researcher she's partnered with analysts to identify high-growth opportunities and gain a deeper understanding of users.

Key Insights

  • Combining qualitative research and data science leads to richer, more actionable user insights.

  • Early collaboration between UX researchers and data teams helps reconcile conflicting insights.

  • Identifying highly engaged users (‘activators’) through data-derived engagement scores focuses research efforts.

  • Organizational buy-in and leadership support are critical to integrated user science approaches.

  • Curious and thoughtful data partners who understand and care about people are optimal collaborators.

  • Using shared language around metrics improves understanding and communication across teams.

  • Opportunity solution trees help align research questions and experiments with strategic outcomes.

  • Ethical considerations are important when interpreting engagement metrics; more usage isn't always better.

  • UX researchers are well-positioned to bridge gaps due to their cross-functional skills and storytelling ability.

  • Data literacy among UX researchers doesn't require full expertise but benefits from honesty and collaboration with experts.

Notable Quotes

"If you're a person who studies people, then you're a person who understands data."

"We get stuck answering questions we know we can find answers to, and lose the chance to see the big picture."

"The data teams want the company to be successful just like UX researchers do."

"I shared Brent Turetsky's article to spark curiosity and start collaboration with my data partner."

"Many meetings and doc edits later, he realized interviewing wasn’t for him but deeply respected it."

"We’ve affectionately called our most engaged users activators – those intrigued and motivated by learning."

"It’s not about calling you a UX researcher or product analyst but about understanding how users interact."

"Leadership said discovering more about these most active users is a key priority this year."

"The earliest collaboration helps present a unified case rather than conflicting insights to product managers."

"I have way more power in the insights I gather from interviews than any of the data analysis."

Ask the Rosenbot
Operationalizing DesignOps
2018 • DesignOps Summit 2018
Gold
Teresa Swingler
Look, Up in the Sky! UX/UI for Aerospace (Videoconference)
2022 • Enterprise Community
Marieke McCloskey
User Science: Product Analytics & User Research
2021 • Advancing Research 2021
Gold
Dem Gerolemou
Climate technology fundamentals (Videoconference)
2024 • Climate UX Interest Group (Rosenfeld Community)
David Cronin
The GE Design System and Thoughts about Craft at Scale
2015 • Enterprise UX 2015
Gold
Tatyana Mamut
Opening Keynote: Breaking Conway's Law--or How to Work Differently and Not Ship Your Org Chart
2019 • Enterprise Experience 2019
Gold
Kristin Skinner
Opening Keynote: Org Design for Design Orgs
2017 • DesignOps Summit 2017
Gold
Chris Chapo
Data Science and Design: A Tale of Two Tribes
2015 • Enterprise UX 2015
Gold
Satyam Kantamneni
Do You Have an Experience Vision? (Videoconference)
2023 • Enterprise Community
Bria Alexander
Opening Remarks
2023 • DesignOps Summit 2023
Gold
Michael Weir
Mixed Methods and Behavioural Science (Videoconference)
2023 • Rosenfeld Community
Iulia Cornigeanu
QuantQual Book Club: Small Data (Videoconference)
2024 • QuantQual Interest Group (Rosenfeld Community)
Crystal Yan
Building a Customer-Centric Culture
2020 • Advancing Research 2020
Gold
Mohammad Hossein Jarrahi
Contextuality problem: Exploring the Benefits of Qualitative and Quantitative Research
2023 • QuantQual Interest Group (Rosenfeld Community)
Lisa Welchman
Cleaning Up Our Mess: Digital Governance for Designers
2018 • Enterprise Experience 2018
Gold
Chris Hodowanec
Agile + User Experience: How to navigate the Agile landscape as an UX Practitioner
2022 • Civic Design 2022
Gold

More Videos

"Doctors hate using EHRs because it turns them into clerks, interacting more with machines than patients."

Standardizing Product Merits for Leaders, Designers, and Everyone

June 15, 2018

Simon Wardley

"Building a map is like learning to play chess—you have to see the board to decide your move."

Simon Wardley

Maps and Topographical Intelligence (Videoconference)

January 31, 2019

Sandra Camacho

"The Twitter algorithm favored lighter skin tones when cropping images, reflecting racial bias in tech."

Sandra Camacho

Creating More Bias-Proof Designs

January 22, 2025

Darian Davis

"When fellow co-workers label an individual as difficult, it’s hard not to treat that person as a problem."

Darian Davis

Lessons from a Toxic Work Relationship

January 8, 2024

Fisayo Osilaja

"ChatGPT didn’t have the full context of what was most important to stakeholders, so I had to edit its output before sharing."

Fisayo Osilaja

[Demo] The AI edge: From researcher to strategist

June 4, 2024

Uday Gajendar

"There is a common thread in craft: dignity, purpose, utility, and beauty."

Uday Gajendar

The Wicked Craft of Enterprise UX

May 13, 2015

Davis Neable

"Relying on a single content strategist was a strategic mistake that created a single point of failure."

Davis Neable Guy Segal

How to Drive a Design Project When you Don’t Have a Design Team

June 10, 2021

Eniola Oluwole

"People were very adverse to changes because a small 0.5% conversion increase meant millions in revenue."

Eniola Oluwole

Lessons From the DesignOps Journey of the World's Largest Travel Site

October 24, 2019

Aurobinda Pradhan

"Design producers love their creative tools and want to keep using them without multiple manual reporting steps."

Aurobinda Pradhan Shashank Deshpande

Introduction to Collaborative DesignOps using Cubyts

September 9, 2022