Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Data-Prompted Interviews
Friday, December 17, 2021 • QuantQual Interest Group (Rosenfeld Community)
Share the love for this talk
Data-Prompted Interviews
Speakers: Amelia Cole
Link:

Summary

In this session, Amelia unpacks data-prompted interviews with an emphasis on Experience Sampling Methods. You will learn the essentials of running an Experience Sampling study and how to use quantitative data during interviews to enhance our understanding of daily life activities and experiences.

Key Insights

  • Experience sampling methods (ESM) use participant-generated real-time data to capture lived experience longitudinally.

  • ESM combines quantitative frequent data collection with qualitative unstructured interviews for richer understanding.

  • Key ESM design tradeoffs involve balancing sampling frequency, survey length, and participant fatigue.

  • There are four trigger types in ESM: random, fixed, contextual, and self-initiated event-based.

  • Reactivity is an inherent feature of ESM, as self-monitoring often changes participant behavior.

  • Pre-study pilot tests and clear communication with participants improve data quality and reduce attrition.

  • Unstructured interviews after ESM can explore participant interpretations and meanings behind their data.

  • Visual dashboards presenting individual ESM data enhance participant engagement and interview depth.

  • ESM suits research on sensitive or complex experiences, such as health treatment or learning processes.

  • Paying participants creatively, like incremental incentives and drawings, helps maintain engagement over time.

Notable Quotes

"Our mission is to facilitate and strengthen collaboration between quantitative and qualitative practitioners."

"Data prompted interviews use the participant's own data to enhance understanding of their specific experience."

"Experience sampling captures what people are doing, thinking, and feeling right now in the moment."

"The triangle of budget, time, and scope applies to how often and how long your ESM surveys should be."

"Random triggers are useful to understand activities throughout the entire day."

"Reactivity is more of a feature of this method than a bug."

"Prepping with pilot studies helps ensure your study runs smoothly and collects the right data."

"Unstructured interviews allow the participant to largely control the conversation to provide rich data."

"Visualizing data in dashboards can enrich interviews by grounding discussions in participants' own experiences."

"Never collect data that doesn’t specifically address your research question—it’s about being ethical and focused."

George Abraham
Design Systems To-Go: Indigo.Design Overview and Exploring the Developer Workflow (Part 3)
2021 • DesignOps Summit 2021
Gold
Lisanne Norman
Why I Left Research
2023 • Advancing Research 2023
Gold
Sheri Byrne-Haber
Accessibility at Scale
2021 • Design at Scale 2021
Gold
Uday Gajendar
Theme 1: Introduction
2021 • Design at Scale 2021
Gold
Sofía Delsordo
Public Policy for Jalisco's Designers to Make Design Matter
2021 • Civic Design 2021
Gold
Rachael Dietkus, LCSW
Leading through the long tail of trauma (Videoconference)
2022 • Enterprise Community
Saara Kamppari-Miller
Theme Three Intro
2022 • DesignOps Summit 2022
Gold
Jessica Norris
ADHD: A DesignOps Superpower
2022 • DesignOps Summit 2022
Gold
Dave Malouf
Theme 3: Introduction and Provocation
2024 • DesignOps Summit 2020
Gold
Miles Orkin
Creativity and Culture
2018 • DesignOps Summit 2018
Gold
Alberto Ferreira
Making it Count: Developing a custom digital metric framework that works
2021 • QuantQual Interest Group (Rosenfeld Community)
Steve Baty
Discussion
2016 • Enterprise UX 2016
Gold
Jorge Arango
Design as an Antidote to VUCA (Videoconference)
2019 • Enterprise Community
Daniel Gloyd
Designing Warmth
2025 • Rosenfeld Community
Renee Bouwens
Landing Product Impact: Aligning Research as a Foundational Driver for Delivering the World’s Best Products (Videoconference)
2023 • QuantQual Interest Group (Rosenfeld Community)
George Hinchliffe
Delivering Amazing Experiences
2021 • Design at Scale 2021
Gold

More Videos

Monty Hammontree

"People will work harder for people than for a number, so thick data is critical to inspire advocacy and action."

Monty Hammontree

The Future of UX Research (Videoconference)

December 3, 2020

Liz Ebengo

"Knowing your positionality as a researcher is critical because refugees often fear losing their status and have precarious rights."

Liz Ebengo

The Burden on Children: The Cost of Insufficient Post-Conflict Services and Pathways Forward

December 4, 2024

Billy Carlson

"I tell people to find inspiration from existing designs and bring those into your wireframes to look like real products."

Billy Carlson

Tips to Utilize Wireframes to Tell an Effective Product Story

June 6, 2023

Saara Kamppari-Miller

"Don’t be ideal, do better — the ideal will always be out of reach, but we should strive towards it regardless."

Saara Kamppari-Miller

Inclusive Design is DesignOps

September 29, 2021

Ian Swinson

"People care so much about titles, but honestly, I’d prefer the star-bellied sneak on the business card."

Ian Swinson

Designing and Driving UX Careers

June 8, 2016

Jonathon Colman

"People assumed Facebook was always listening to their conversations because we didn’t clearly explain how and why the feature worked."

Jonathon Colman

How to Maximize the Impact of Content Design

January 8, 2024

Maria Skaaden

"Opening the feedback board to the whole team made developers feel responsible and inspired to solve user needs."

Maria Skaaden

Continuous Design: One eye on the horizon and the other on the next wave

November 8, 2018

Bryce Benton

"Python is great for writing scrapers, and these large language models are great for writing Python."

Bryce Benton

[Demo] AI-powered UX enhancement: Aligning GitHub documentation with USWDS at Austin Public Library

June 4, 2024

Marc Fonteijn

"We do not take cost of living, inflation, or taxes into account, so it’s your homework to contextualize the salary data."

Marc Fonteijn

First Insights from the 2025 Service Design Salary(+) Report

December 4, 2024