Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

User Science: Product Analytics & User Research
Gold
Thursday, March 11, 2021 • Advancing Research 2021
Share the love for this talk
User Science: Product Analytics & User Research
Speakers: Marieke McCloskey
Link:

Summary

Want to help make better product decisions? You've got to combine qualitative human insights from user research with data analytics and experimentation. Too often research questions are "sent to the team that can answer them best." Questions about how many users do something goes to analytics, questions about which design might work better goes to user research. But what if you partnered with those other teams to answer the questions together? In this session Marieke will share how, as a qualitative UX researcher she's partnered with analysts to identify high-growth opportunities and gain a deeper understanding of users.

Key Insights

  • Combining qualitative research and data science leads to richer, more actionable user insights.

  • Early collaboration between UX researchers and data teams helps reconcile conflicting insights.

  • Identifying highly engaged users (‘activators’) through data-derived engagement scores focuses research efforts.

  • Organizational buy-in and leadership support are critical to integrated user science approaches.

  • Curious and thoughtful data partners who understand and care about people are optimal collaborators.

  • Using shared language around metrics improves understanding and communication across teams.

  • Opportunity solution trees help align research questions and experiments with strategic outcomes.

  • Ethical considerations are important when interpreting engagement metrics; more usage isn't always better.

  • UX researchers are well-positioned to bridge gaps due to their cross-functional skills and storytelling ability.

  • Data literacy among UX researchers doesn't require full expertise but benefits from honesty and collaboration with experts.

Notable Quotes

"If you're a person who studies people, then you're a person who understands data."

"We get stuck answering questions we know we can find answers to, and lose the chance to see the big picture."

"The data teams want the company to be successful just like UX researchers do."

"I shared Brent Turetsky's article to spark curiosity and start collaboration with my data partner."

"Many meetings and doc edits later, he realized interviewing wasn’t for him but deeply respected it."

"We’ve affectionately called our most engaged users activators – those intrigued and motivated by learning."

"It’s not about calling you a UX researcher or product analyst but about understanding how users interact."

"Leadership said discovering more about these most active users is a key priority this year."

"The earliest collaboration helps present a unified case rather than conflicting insights to product managers."

"I have way more power in the insights I gather from interviews than any of the data analysis."

Ask the Rosenbot
John Cutler
Oxbows, Rivers, and Estuaries: How to navigate the currents of change (without burning out)
2024 • Advancing Service Design 2024
Gold
Max Gadney
Assessing UX jobs for impact in climate
2024 • Climate UX Interest Group (Rosenfeld Community)
Cheryl Platz
Demystifying Multimodal Design: The Design Practice You Didn't Know You're Doing (Videoconference)
2024 • Rosenfeld Community
George Hinchliffe
Delivering Amazing Experiences
2021 • Design at Scale 2021
Gold
Chelsea Mauldin
Let's Talk About Money
2022 • Civic Design 2022
Gold
Adam Thomas
Survival Metrics – Making Change in a Fast, Data-Informed, and Politically Safe Way
2022 • Design in Product 2022
Gold
Jilanna Wilson
Distributed Design Operations Management
2019 • DesignOps Summit 2019
Gold
Samuel Proulx
Invisible barriers: Why accessible service design can’t be an afterthought
2024 • Advancing Service Design 2024
Gold
Bria Alexander
Opening Remarks
2023 • Advancing Research 2023
Gold
Jeff Gothelf
Innovation Studios: the Engines of Enterprise Experimentation
2015 • Enterprise UX 2015
Gold
Angelos Arnis
State of DesignOps: Learnings from the 2021 Global Report
2021 • DesignOps Summit 2021
Gold
Chris Geison
Theme 1 Intro
2022 • Advancing Research 2022
Gold
B. Pagels-Minor
Breaking the Tension: The Power of Enabling Your Employees to Show Up Authentically
2022 • Design at Scale 2022
Gold
Civic Design in 2022 (Videoconference)
2022 • Civic Design Community
Mandy Drew
What Role(s) Can Research Play in Responsible Design?
2021 • Advancing Research 2021
Gold
Marieke McCloskey
User Science: Product Analytics & User Research
2021 • Advancing Research 2021
Gold

More Videos

Adam Cutler

"Don't be cool, be good—work hard at managing your teams because they need you to nail it."

Adam Cutler Karen Pascoe Ian Swinson Susan Worthman

Discussion

June 8, 2016

Peter Merholz

"UX directors often feel like this poor person in the middle here getting pulled in all these directions."

Peter Merholz

The Trials and Tribulations of Directors of UX (Videoconference)

July 13, 2023

Lisa Welchman

"Governance is about decision making, not workflow processes."

Lisa Welchman

Cleaning Up Our Mess: Digital Governance for Designers

June 14, 2018

Vincent Brathwaite

"The time for action is now, and it must be collaborative."

Vincent Brathwaite

Opener: Past, Present, and Future—Closing the Racial Divide in Design Teams

October 22, 2020

Brenna Fallon

"The squad model flopped for us after six months but created culture triads that stuck around."

Brenna Fallon

Learning Over Outcomes

October 24, 2019

Tricia Wang

"Treat identities as elastic, not as fixed personas, because people’s needs and roles are complex and changing."

Tricia Wang

Spatial Collapse: Designing for Emergent Culture

January 8, 2024

Edgar Anzaldua Moreno

"Proto personas created by cross-department participants helped us build unbiased, relevant survey questions."

Edgar Anzaldua Moreno

Using Research to Determine Unique Value Proposition

March 11, 2021

"We want to build teams with diverse skill sets so we can create a full picture during the knowledge creation phase."

Designing Systems at Scale

November 7, 2018

Erin Weigel

"Randomization is magic — it evenly distributes confounds so the only difference affecting results is your change."

Erin Weigel

Get Your Whole Team Testing to Design for Impact

July 24, 2024