Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Data-Prompted Interviews
Friday, December 17, 2021 • QuantQual Interest Group (Rosenfeld Community)
Share the love for this talk
Data-Prompted Interviews
Speakers: Amelia Cole
Link:

Summary

In this session, Amelia unpacks data-prompted interviews with an emphasis on Experience Sampling Methods. You will learn the essentials of running an Experience Sampling study and how to use quantitative data during interviews to enhance our understanding of daily life activities and experiences.

Key Insights

  • Experience sampling methods (ESM) use participant-generated real-time data to capture lived experience longitudinally.

  • ESM combines quantitative frequent data collection with qualitative unstructured interviews for richer understanding.

  • Key ESM design tradeoffs involve balancing sampling frequency, survey length, and participant fatigue.

  • There are four trigger types in ESM: random, fixed, contextual, and self-initiated event-based.

  • Reactivity is an inherent feature of ESM, as self-monitoring often changes participant behavior.

  • Pre-study pilot tests and clear communication with participants improve data quality and reduce attrition.

  • Unstructured interviews after ESM can explore participant interpretations and meanings behind their data.

  • Visual dashboards presenting individual ESM data enhance participant engagement and interview depth.

  • ESM suits research on sensitive or complex experiences, such as health treatment or learning processes.

  • Paying participants creatively, like incremental incentives and drawings, helps maintain engagement over time.

Notable Quotes

"Our mission is to facilitate and strengthen collaboration between quantitative and qualitative practitioners."

"Data prompted interviews use the participant's own data to enhance understanding of their specific experience."

"Experience sampling captures what people are doing, thinking, and feeling right now in the moment."

"The triangle of budget, time, and scope applies to how often and how long your ESM surveys should be."

"Random triggers are useful to understand activities throughout the entire day."

"Reactivity is more of a feature of this method than a bug."

"Prepping with pilot studies helps ensure your study runs smoothly and collects the right data."

"Unstructured interviews allow the participant to largely control the conversation to provide rich data."

"Visualizing data in dashboards can enrich interviews by grounding discussions in participants' own experiences."

"Never collect data that doesn’t specifically address your research question—it’s about being ethical and focused."

Ask the Rosenbot
Bria Alexander
Theme Two Intro
2022 • DesignOps Summit 2022
Gold
Florence Okoye
AfroFuturism and UX Research
2023 • Advancing Research 2023
Gold
Jemma Ahmed
Democratization: Working with it, not against it [Advancing Research Community Workshop Series]
2024 • Advancing Research Community
Laura Schaefer
DesignOps: A Conduit for Inclusion
2022 • DesignOps Summit 2022
Gold
John Devanney
The Design Management Office
2017 • DesignOps Summit 2017
Gold
Bilan Hashi
The Tension Between Story Collecting and Story Telling in Research
2021 • Advancing Research 2021
Gold
Research Operations at Scale
2017 • DesignOps Summit 2017
Gold
Jacqui Frey
Scale is Social Work (Videoconference)
2020 • DesignOps Community
Bria Alexander
Welcome
2024 • Enterprise Experience 2020
Gold
Jack Moffett
UX Metrics That Matter and The Future of our Design at Scale Conference: A Community Conversation (Videoconference)
2022 • Enterprise Community
Catt Small
Moving from Execution to Strategy as a Designer
2022 • Design in Product 2022
Gold
Christopher Geison
Theme 1 Intro
2024 • Advancing Research 2024
Gold
Louis Rosenfeld
Opening Remarks
2023 • Design in Product 2023
Gold
Jess Greco
Creating a Basis for Change: Scaling Design Maturity
2022 • Design at Scale 2022
Gold
Amy Evans
How to Create Change
2024 • DesignOps 2024
Gold
Nicole Umphress
Delivering Design Education During a Global Pandemic: Lessons Learned
2022 • Design at Scale 2022
Gold

More Videos

Adam Cutler

"Can you show me your process, not just your portfolio? That shows me your real design thinking."

Adam Cutler Karen Pascoe Ian Swinson Susan Worthman

Discussion

June 8, 2016

Peter Merholz

"Developing trust means showing you understand what it takes to get something shipped, that you’re reliable, and that people can be vulnerable with you."

Peter Merholz

The Trials and Tribulations of Directors of UX (Videoconference)

July 13, 2023

Lisa Welchman

"Governance frameworks can facilitate whatever an organization wants to do, fast or slow, loose or tight."

Lisa Welchman

Cleaning Up Our Mess: Digital Governance for Designers

June 14, 2018

Vincent Brathwaite

"Transportation must evolve to be more sustainable and accessible for all."

Vincent Brathwaite

Opener: Past, Present, and Future—Closing the Racial Divide in Design Teams

October 22, 2020

Brenna Fallon

"Engineers can be our biggest allies in making really important process changes."

Brenna Fallon

Learning Over Outcomes

October 24, 2019

Tricia Wang

"We are all experiencing a spatial collapse, a disruption of our mental models of how we navigate physical and virtual spaces."

Tricia Wang

Spatial Collapse: Designing for Emergent Culture

January 8, 2024

Edgar Anzaldua Moreno

"We used a Python algorithm with a correlation matrix to identify meaningful clusters from survey responses."

Edgar Anzaldua Moreno

Using Research to Determine Unique Value Proposition

March 11, 2021

"We want to build teams with diverse skill sets so we can create a full picture during the knowledge creation phase."

Designing Systems at Scale

November 7, 2018

Erin Weigel

"If my experiment made front-page news tomorrow, what would the headline be? Would my mother be proud?"

Erin Weigel

Get Your Whole Team Testing to Design for Impact

July 24, 2024