Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Data-Prompted Interviews
Friday, December 17, 2021 • QuantQual Interest Group (Rosenfeld Community)
Share the love for this talk
Data-Prompted Interviews
Speakers: Amelia Cole
Link:

Summary

In this session, Amelia unpacks data-prompted interviews with an emphasis on Experience Sampling Methods. You will learn the essentials of running an Experience Sampling study and how to use quantitative data during interviews to enhance our understanding of daily life activities and experiences.

Key Insights

  • Experience sampling methods (ESM) use participant-generated real-time data to capture lived experience longitudinally.

  • ESM combines quantitative frequent data collection with qualitative unstructured interviews for richer understanding.

  • Key ESM design tradeoffs involve balancing sampling frequency, survey length, and participant fatigue.

  • There are four trigger types in ESM: random, fixed, contextual, and self-initiated event-based.

  • Reactivity is an inherent feature of ESM, as self-monitoring often changes participant behavior.

  • Pre-study pilot tests and clear communication with participants improve data quality and reduce attrition.

  • Unstructured interviews after ESM can explore participant interpretations and meanings behind their data.

  • Visual dashboards presenting individual ESM data enhance participant engagement and interview depth.

  • ESM suits research on sensitive or complex experiences, such as health treatment or learning processes.

  • Paying participants creatively, like incremental incentives and drawings, helps maintain engagement over time.

Notable Quotes

"Our mission is to facilitate and strengthen collaboration between quantitative and qualitative practitioners."

"Data prompted interviews use the participant's own data to enhance understanding of their specific experience."

"Experience sampling captures what people are doing, thinking, and feeling right now in the moment."

"The triangle of budget, time, and scope applies to how often and how long your ESM surveys should be."

"Random triggers are useful to understand activities throughout the entire day."

"Reactivity is more of a feature of this method than a bug."

"Prepping with pilot studies helps ensure your study runs smoothly and collects the right data."

"Unstructured interviews allow the participant to largely control the conversation to provide rich data."

"Visualizing data in dashboards can enrich interviews by grounding discussions in participants' own experiences."

"Never collect data that doesn’t specifically address your research question—it’s about being ethical and focused."

Ask the Rosenbot
Clara Kliman-Silver
UX Futures: The Role of Artificial Intelligence in Design
2023 • Enterprise UX 2023
Gold
Milan Guenther
A Shared Language for Co-Creating Ambitious Endeavours
2023 • Enterprise UX 2023
Gold
Jorge Arango
Meeting of the Waters: Designing for Successful Inorganic Growth (Videoconference)
2021 • Enterprise Community
Florence Okoye
AfroFuturism and UX Research
2023 • Advancing Research 2023
Gold
Nicole Aleong
What UX research can learn from other research practices [Advancing Research Community Workshop Series] (Videoconference)
2023 • Advancing Research Community
Melinda Belcher
Insider preview of Enterprise Experience 2020 (Videoconference)
2020 • Enterprise Community
Matt Bernius
Learnings from Applying Trauma-Informed Principles to the Research Process
2022 • Advancing Research 2022
Gold
Andrew Custage
The Digital Journey: Research on Consumer Frustration and Loyalty
2023 • Advancing Research 2023
Gold
Renee Reid
Becoming a ResearchH.E.R (Highly Enterprise Ready)
2019 • Enterprise Experience 2019
Gold
Sara Asche Anderson
Not Your Ordinary Re-Brand: Design's Path to Driving Customer Obsession at Best Buy
2024 • Enterprise Experience 2020
Gold
Joanna Vodopivec
One Research Team for All - Influence Without Authority
2022 • Advancing Research 2022
Gold
Soma Ghosh
What emerging methods are advancing UX research [Advancing Research Community Workshop Series] (Videoconference)
2023 • Advancing Research Community
Jorge Arango
[Demo] How to re-categorize content at scale using LLMs
2024 • Designing with AI 2024
Gold
Bria Alexander
Welcome
2024 • Enterprise Experience 2020
Gold
Farid Sabitov
Theme Four Intro
2022 • DesignOps Summit 2022
Gold
Kyria Stephens
Power to Heal: Civic Design in the Aftermath of Tragedy
2022 • Civic Design 2022
Gold

More Videos

Jemma Ahmed

"Knowledge multiplies the more it’s shared, it’s not a zero-sum game where someone loses power."

Jemma Ahmed Steve Carrod Chris Geison Dr. Shadi Janansefat Christopher Nash

Democratization: Working with it, not against it [Advancing Research Community Workshop Series]

July 24, 2024

Nina Jurcic

"You need sponsorship from senior leadership but also buy-in from all corners of the company to succeed."

Nina Jurcic

The Design System Rollercoaster: From Enabler and Bottleneck to Catalyst for Change

October 3, 2023

Nathan Curtis

"I try to position the system as an enabling force for designers to do their work better and succeed better."

Nathan Curtis Nalini P. Kotamraju Jack Moffett Dawn Ressel

Discussion

June 9, 2016

Saara Kamppari-Miller

"Our KSPs don’t change yearly because they’re fundamental to the core business; changing them often would be very disruptive."

Saara Kamppari-Miller Nicole Bergstrom Shashi Jain

Key Metrics: Comparing Three Letter Acronym Metrics That Include the Word “Key”

November 13, 2024

Malini Rao

"The sum of parts is not always the whole — we lost sight of the mental model in our employee record feature."

Malini Rao

Lessons Learned from a 4-year Product Re-platforming Journey

June 9, 2021

Mackenzie Cockram

"We use a magic R studio button that, with one click, processes all the survey data automatically."

Mackenzie Cockram Sara Branco Cunha Ian Franklin

Integrating Qualitative and Quantitative Research from Discovery to Live

December 16, 2022

Bria Alexander

"Day one of Design at Scale is going to be about ensuring craft on a massive scale."

Bria Alexander

Opening Remarks

June 9, 2021

Jackie Ho

"Lean governance tries to find the sweet spot between chaos and command and control."

Jackie Ho

Lead Effectively While Preserving Team Autonomy with Growth Boards

January 8, 2024

Dan Hill

"The street used to be for public life; then cars took over and changed it profoundly."

Dan Hill

Designing for the infrastructures of everyday life

June 4, 2024