Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Data-Prompted Interviews

Friday, December 17, 2021 • QuantQual Interest Group
Share the love for this talk
Data-Prompted Interviews
Speakers: Amelia Cole
Link:

Summary

In this session, Amelia unpacks data-prompted interviews with an emphasis on Experience Sampling Methods. You will learn the essentials of running an Experience Sampling study and how to use quantitative data during interviews to enhance our understanding of daily life activities and experiences.

Key Insights

  • Data prompted interviews use participants’ own quantitative data to guide qualitative exploration, enhancing insight depth.

  • Experience Sampling Methods capture real-time, repeated snapshots of participants’ thoughts and actions to track temporal patterns.

  • Balancing sampling frequency, survey length, and study duration is critical to avoid participant fatigue in longitudinal ESM studies.

  • Four trigger types in ESM—random, fixed, contextual, and self-initiated—serve distinct research purposes.

  • High attrition and resource intensity are common challenges in ESM, necessitating careful preparation and participant engagement.

  • Reactivity, where participants alter behavior due to observation, is an inherent feature of ESM and can enhance participant metacognition.

  • Unstructured interviews following ESM offer participant-controlled, rich narratives that reveal the why behind quantitative patterns.

  • ESM is well-suited for sensitive topics by enabling in-the-moment data collection in natural settings.

  • Tools like XPL facilitate ESM research by providing mobile-friendly forms, scheduling, and easy data export for analysis.

  • Mixed methods pairing of ESM and qualitative interviews can be tailored by purposive sampling from the quantitative pool for deeper understanding.

Notable Quotes

"Data prompted interviews use the participant's own data to enhance understanding of their specific experience."

"Experience sampling captures real-time lived experience repeatedly to examine patterns of change and growth."

"Balancing how often you signal someone and how many questions you ask is key to reduce participant fatigue."

"There are four trigger types: random, fixed, contextual, and self-initiated, each serving a unique purpose."

"This method has a degree of reactivity; paying attention to something may alter or change behavior."

"Preparation is key: pilot studies and a data analysis plan before launching ensure data quality and study success."

"Unstructured interviews are participant-controlled, spontaneous, and offer rich data but are less replicable."

"ESM improves ecological validity by collecting data in real-world situations as they occur."

"You can use experience sampling data to select a small qualitative sample to dive deeper in interviews."

"Never collect data that doesn’t specifically address your research question."

Ask the Rosenbot
Kate Koch
Flex Your Super Powers: When a Design Ops Team Scales to Power CX
2021 • DesignOps Summit 2021
Gold
Sandra Camacho
Creating More Bias-Proof Designs
2025 • Rosenfeld Community
Ariel Kennan
Building a Design Culture
2017 • Enterprise Experience 2017
Gold
Luz Bratcher
This Is a Talk for Tired People
2022 • Design at Scale 2022
Gold
Christian Bason
Expand—Rethinking Design for Public Challenges
2022 • Civic Design Community
Ian Johnson
Latent Scope: Finding structure in unstructured data
2025 • Designing with AI 2025
Gold
Sam Proulx
Understanding Screen Readers on Mobile: How And Why to Learn from Native Users
2023 • Enterprise UX 2023
Gold
Erin Malone
Understanding the past to prepare for the future
2024 • Rosenfeld Community
Benjamin Real
Showing the Value of DesignOps by Not Having a DesignOps Team
2020 • DesignOps Summit 2020
Gold
Gina Mendolia
Therapists, Coaches, and Grandmas: Techniques for Service Design in Complex Systems
2024 • Advancing Service Design 2024
Gold
Robert Reimann
Taming Design Complexity with UX Models
2017 • Enterprise Experience 2017
Gold
Kat Vellos
Opener: The Other L Word
2024 • DesignOps Summit 2020
Gold
Sean Fitzell
Craft of User Research: Building Out Jobs to be Done Maps
2021 • Advancing Research 2021
Gold
Alla Weinberg
How to Build and Scale Team Safety
2024 • DesignOps Summit 2020
Gold
Sheryl Cababa
Expanding your Design Lens with Systems Thinking
2023 • Advancing Research 2023
Gold
Kristin Wisnewski
Measuring What Matters
2019 • DesignOps Summit 2019
Gold

More Videos

Erin Weigel

"Everything is an experiment."

Erin Weigel

Real-world lessons to improve your conversion rates

June 26, 2024

Daniel Korczynski

"AI has this strange weakness that when working with a large dataset, they often miss crucial, subtle findings."

Daniel Korczynski

Why AI Is Bad at Research (and how to make it actually useful)

March 10, 2026

Kim Lenox

"The telephone game scenario happens with distributed teams all the time and when that happens, customers suffer."

Kim Lenox

Leading Distributed Global Teams

May 20, 2019

Brendan Jarvis

"The stories we tell are framed by the questions we ask. Our stories repeated become our beliefs and our beliefs influence our behavior."

Brendan Jarvis

Framing Tomorrow by Questioning Today

June 8, 2022

Carol Massa

"Good trouble is part of our craft—it's about making the right amount of disruption to improve healthcare."

Carol Massa

Designing Health: Integrating Service Design, Technology, and Strategy to Transform Patient and Clinician Experiences

December 3, 2024

Dr Chloe Sharp

"When I first came into the role, I almost took the consultant approach of writing a big report with recommendations, but that overwhelmed the team."

Dr Chloe Sharp

Using Evidence and Collaboration for Setting and Defending Priorities

November 29, 2023

Sarah Auslander

"Always design a thing by considering it in this next largest temporal context — a day in a month, a decade in a century."

Sarah Auslander Betsy Ramaccia Gordon Ross

Insights Panel

November 18, 2022

Susan Simon-Daniels

"The fundamental things do apply as time goes by."

Susan Simon-Daniels

War Stories LIVE! Susan Simon-Daniels

March 30, 2020

Farid Sabitov

"By automating deliverables analysis, we saved 12 hours per week within one design team alone."

Farid Sabitov

Automatization for Large Enterprise Teams

January 8, 2024