Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Data-Prompted Interviews
Friday, December 17, 2021 • QuantQual Interest Group (Rosenfeld Community)
Share the love for this talk
Data-Prompted Interviews
Speakers: Amelia Cole
Link:

Summary

In this session, Amelia unpacks data-prompted interviews with an emphasis on Experience Sampling Methods. You will learn the essentials of running an Experience Sampling study and how to use quantitative data during interviews to enhance our understanding of daily life activities and experiences.

Key Insights

  • Experience sampling methods (ESM) use participant-generated real-time data to capture lived experience longitudinally.

  • ESM combines quantitative frequent data collection with qualitative unstructured interviews for richer understanding.

  • Key ESM design tradeoffs involve balancing sampling frequency, survey length, and participant fatigue.

  • There are four trigger types in ESM: random, fixed, contextual, and self-initiated event-based.

  • Reactivity is an inherent feature of ESM, as self-monitoring often changes participant behavior.

  • Pre-study pilot tests and clear communication with participants improve data quality and reduce attrition.

  • Unstructured interviews after ESM can explore participant interpretations and meanings behind their data.

  • Visual dashboards presenting individual ESM data enhance participant engagement and interview depth.

  • ESM suits research on sensitive or complex experiences, such as health treatment or learning processes.

  • Paying participants creatively, like incremental incentives and drawings, helps maintain engagement over time.

Notable Quotes

"Our mission is to facilitate and strengthen collaboration between quantitative and qualitative practitioners."

"Data prompted interviews use the participant's own data to enhance understanding of their specific experience."

"Experience sampling captures what people are doing, thinking, and feeling right now in the moment."

"The triangle of budget, time, and scope applies to how often and how long your ESM surveys should be."

"Random triggers are useful to understand activities throughout the entire day."

"Reactivity is more of a feature of this method than a bug."

"Prepping with pilot studies helps ensure your study runs smoothly and collects the right data."

"Unstructured interviews allow the participant to largely control the conversation to provide rich data."

"Visualizing data in dashboards can enrich interviews by grounding discussions in participants' own experiences."

"Never collect data that doesn’t specifically address your research question—it’s about being ethical and focused."

Bria Alexander
Theme Two Intro
2023 • DesignOps Summit 2023
Gold
Daniel Gloyd
Warming the User Experience: Lessons from America's first and most radical human-centered designers (Videoconference)
2024 • Rosenfeld Community
Anna Avrekh
User Research, Design, and Product - A Love Story
2021 • Advancing Research 2021
Gold
Jack Behar
How to Build Prototypes that Behave like an End-Product
2022 • Design in Product 2022
Gold
Sam Proulx
Mobile Accessibility: Why Moving Accessibility Beyond the Desktop is Critical in a Mobile-first World
2022 • Advancing Research 2022
Gold
Victor Lombardi
Bridging Design and Climate Science (Videoconference)
2024 • Climate UX Interest Group (Rosenfeld Community)
Verónica Urzúa
The B-side of the Research Impact
2021 • Advancing Research 2021
Gold
Jayne Engle
Civic Design for the Next Seven Generations—A Discussion on Sacred Civics (Videoconference)
2022 • Civic Design Community
Dave Hora
A Research Skills Evolution
2021 • Advancing Research 2021
Gold
Samuel Proulx
Designing beyond caricatures: Embracing real, diverse user needs
2024 • Advancing Service Design 2024
Gold
Iulia Cornigeanu
QuantQual Book Club: Small Data (Videoconference)
2024 • QuantQual Interest Group (Rosenfeld Community)
Maria Skaaden
Panel Discussion: Methodologies and Work Environments
2018 • DesignOps Summit 2018
Gold
Tutti Taygerly
Make Space to Lead
2021 • Design at Scale 2021
Gold
Maria Skaaden
Continuous Design: One eye on the horizon and the other on the next wave
2018 • DesignOps Summit 2018
Gold
Sarit Geertjes
People, not Petri Dishes: Stories from a Research Recruiter (Videoconference)
2019 • DesignOps Community
Carol Massa
Designing Health: Integrating Service Design, Technology, and Strategy to Transform Patient and Clinician Experiences
2024 • Advancing Service Design 2024
Gold

More Videos

Daniela Magaña Flores

"The method is not just about the homepage but the whole experience the participant explores freely within minutes."

Daniela Magaña Flores Ariane Rahn Jeff Ephraim Bander

Ahead of Competition: Learn What UX Benchmarking Can Do for Your Business Today

March 10, 2022

Savina Hawkins

"AI tools can do the entire process of qualitative analysis at the click of a button."

Savina Hawkins

Harnessing AI in UXR: Practical Strategies for Positive Impact

March 26, 2024

Alex Hurworth

"Each species lost is a thread untethered from the web of life that supports us all."

Alex Hurworth Bonnie John Fahd Arshad Antoine Marin

Designing a Contact Tracing App for Universal Access

October 23, 2020

Matt Duignan

"Don’t mistake motion for progress — you might just be learning the same things over and over again."

Matt Duignan

HITS, Microsoft's internal human insight system: From research library to living body of knowledge (Videoconference)

July 16, 2019

Craig Villamor

"The only form of ethical persuasion that exists is when the goals of the persuader are aligned with the goals of the persuading - Tristan Harris."

Craig Villamor

Design Systems for Ethical Design (Videoconference)

January 26, 2023

Ovetta Sampson

"Move from thoughts to things — the faster you get something tangible, the faster people stop debating opinions."

Ovetta Sampson

Turning UX Passion into Real Product Influence

June 7, 2023

Rima Campbell

"Numbers drive conversations, numbers drive decisions. That’s the executive language."

Rima Campbell Amrit S Bhachu

Increase Productivity and Drive Business Impact

September 24, 2024

Amy Gawronski Zuccaro

"People will tell you what frustrates them, so listen and prioritize what many people complain about."

Amy Gawronski Zuccaro

Advice for DesignOps Employee #1

September 29, 2021

Victor Udoewa

"Awareness does not necessarily lead to action; it often makes us feel stuck or powerless."

Victor Udoewa

Beyond Methods and Diversity: The Roots of Inclusion

March 26, 2024