Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

User Science: Product Analytics & User Research
Gold
Thursday, March 11, 2021 • Advancing Research 2021
Share the love for this talk
User Science: Product Analytics & User Research
Speakers: Marieke McCloskey
Link:

Summary

Want to help make better product decisions? You've got to combine qualitative human insights from user research with data analytics and experimentation. Too often research questions are "sent to the team that can answer them best." Questions about how many users do something goes to analytics, questions about which design might work better goes to user research. But what if you partnered with those other teams to answer the questions together? In this session Marieke will share how, as a qualitative UX researcher she's partnered with analysts to identify high-growth opportunities and gain a deeper understanding of users.

Key Insights

  • Combining qualitative research and data science leads to richer, more actionable user insights.

  • Early collaboration between UX researchers and data teams helps reconcile conflicting insights.

  • Identifying highly engaged users (‘activators’) through data-derived engagement scores focuses research efforts.

  • Organizational buy-in and leadership support are critical to integrated user science approaches.

  • Curious and thoughtful data partners who understand and care about people are optimal collaborators.

  • Using shared language around metrics improves understanding and communication across teams.

  • Opportunity solution trees help align research questions and experiments with strategic outcomes.

  • Ethical considerations are important when interpreting engagement metrics; more usage isn't always better.

  • UX researchers are well-positioned to bridge gaps due to their cross-functional skills and storytelling ability.

  • Data literacy among UX researchers doesn't require full expertise but benefits from honesty and collaboration with experts.

Notable Quotes

"If you're a person who studies people, then you're a person who understands data."

"We get stuck answering questions we know we can find answers to, and lose the chance to see the big picture."

"The data teams want the company to be successful just like UX researchers do."

"I shared Brent Turetsky's article to spark curiosity and start collaboration with my data partner."

"Many meetings and doc edits later, he realized interviewing wasn’t for him but deeply respected it."

"We’ve affectionately called our most engaged users activators – those intrigued and motivated by learning."

"It’s not about calling you a UX researcher or product analyst but about understanding how users interact."

"Leadership said discovering more about these most active users is a key priority this year."

"The earliest collaboration helps present a unified case rather than conflicting insights to product managers."

"I have way more power in the insights I gather from interviews than any of the data analysis."

Chris Geison
What's Next for Research? (Videoconference)
2021 • Advancing Research Community
Greg Petroff
Software as Material—A Redux
2023 • Enterprise UX 2023
Gold
Alana Washington
Theme 3 Intro
2021 • DesignOps Summit 2021
Gold
Tristin Oldani
Turning awareness into action with Climate UX
2025 • Climate UX Interest Group (Rosenfeld Community)
Marieke McCloskey
User Science: Product Analytics & User Research
2021 • Advancing Research 2021
Gold
Bria Alexander
Opening Remarks Day 1
2024 • Advancing Research 2024
Gold
Stephen Anderson
Puzzled? How to Coordinate Humans for Complex Challenges
2021 • Enterprise Community
Matt LeMay
You Don’t “Get” Anyone to Do Anything
2022 • Design in Product 2022
Gold
Sofia Quintero
The Product Philosophy Behind EnjoyHQ
2021 • Advancing Research 2021
Gold
Jon Fukuda
Storytelling for DesignOps (Videoconference)
2023 • DesignOps Community
Jemma Ahmed
Democratization: Working with it, not against it [Advancing Research Community Workshop Series]
2024 • Advancing Research Community
Tiffany Cheng
Designing in a Pandemic: Integrating Speed and Rigor
2022 • Design at Scale 2022
Gold
George Abraham
Design Systems To-Go: Indigo.Design Overview and Exploring the Developer Workflow (Part 3)
2021 • DesignOps Summit 2021
Gold
Sarah Gallimore
Inspire Progress with Artifacts from the Future
2022 • Civic Design 2022
Gold
Corey Long
Hiring in DesignOps: A Critical Study on How to Hire and Get Hired
2024 • DesignOps 2024
Gold
Sarah Coyle
Design and Analytics with Sarah Coyle (Videoconference)
2020 • DesignOps Community

More Videos

Monty Hammontree

"Our mission is to empower everybody to learn, not just have a few people learning on behalf of the rest."

Monty Hammontree

The Future of UX Research (Videoconference)

December 3, 2020

Liz Ebengo

"Knowing your positionality as a researcher is critical because refugees often fear losing their status and have precarious rights."

Liz Ebengo

The Burden on Children: The Cost of Insufficient Post-Conflict Services and Pathways Forward

December 4, 2024

Billy Carlson

"Staying in low fidelity throughout early concept development lets you focus strictly on the problem and solution space."

Billy Carlson

Tips to Utilize Wireframes to Tell an Effective Product Story

June 6, 2023

Saara Kamppari-Miller

"Inclusive design and research is a process, how we work as designers to make products and services more inclusive and innovative."

Saara Kamppari-Miller

Inclusive Design is DesignOps

September 29, 2021

Ian Swinson

"People care so much about titles, but honestly, I’d prefer the star-bellied sneak on the business card."

Ian Swinson

Designing and Driving UX Careers

June 8, 2016

Jonathon Colman

"If content designers have deep focus, context, and trust, they can work on problems deeply from the beginning, having far more impact."

Jonathon Colman

How to Maximize the Impact of Content Design

January 8, 2024

Maria Skaaden

"Opening the feedback board to the whole team made developers feel responsible and inspired to solve user needs."

Maria Skaaden

Continuous Design: One eye on the horizon and the other on the next wave

November 8, 2018

Bryce Benton

"I'm not a Python developer. I've used Python, but I'm getting a lot of assistance from ChatGPT to help me write that."

Bryce Benton

[Demo] AI-powered UX enhancement: Aligning GitHub documentation with USWDS at Austin Public Library

June 4, 2024

Marc Fonteijn

"We do not take cost of living, inflation, or taxes into account, so it’s your homework to contextualize the salary data."

Marc Fonteijn

First Insights from the 2025 Service Design Salary(+) Report

December 4, 2024