Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Data-Prompted Interviews
Friday, December 17, 2021 • QuantQual Interest Group (Rosenfeld Community)
Share the love for this talk
Data-Prompted Interviews
Speakers: Amelia Cole
Link:

Summary

In this session, Amelia unpacks data-prompted interviews with an emphasis on Experience Sampling Methods. You will learn the essentials of running an Experience Sampling study and how to use quantitative data during interviews to enhance our understanding of daily life activities and experiences.

Key Insights

  • Experience sampling methods (ESM) use participant-generated real-time data to capture lived experience longitudinally.

  • ESM combines quantitative frequent data collection with qualitative unstructured interviews for richer understanding.

  • Key ESM design tradeoffs involve balancing sampling frequency, survey length, and participant fatigue.

  • There are four trigger types in ESM: random, fixed, contextual, and self-initiated event-based.

  • Reactivity is an inherent feature of ESM, as self-monitoring often changes participant behavior.

  • Pre-study pilot tests and clear communication with participants improve data quality and reduce attrition.

  • Unstructured interviews after ESM can explore participant interpretations and meanings behind their data.

  • Visual dashboards presenting individual ESM data enhance participant engagement and interview depth.

  • ESM suits research on sensitive or complex experiences, such as health treatment or learning processes.

  • Paying participants creatively, like incremental incentives and drawings, helps maintain engagement over time.

Notable Quotes

"Our mission is to facilitate and strengthen collaboration between quantitative and qualitative practitioners."

"Data prompted interviews use the participant's own data to enhance understanding of their specific experience."

"Experience sampling captures what people are doing, thinking, and feeling right now in the moment."

"The triangle of budget, time, and scope applies to how often and how long your ESM surveys should be."

"Random triggers are useful to understand activities throughout the entire day."

"Reactivity is more of a feature of this method than a bug."

"Prepping with pilot studies helps ensure your study runs smoothly and collects the right data."

"Unstructured interviews allow the participant to largely control the conversation to provide rich data."

"Visualizing data in dashboards can enrich interviews by grounding discussions in participants' own experiences."

"Never collect data that doesn’t specifically address your research question—it’s about being ethical and focused."

Ask the Rosenbot
Maggie Dieringer
Creating Consistency Through Constant Change
2024 • DesignOps Summit 2020
Gold
Sean Dolan
A Practical Look at Creating More Usable Enterprise Customer Journeys (Videoconference)
2019 • Enterprise Community
Corey Nelson
Layoffs (Videoconference)
2022 • Advancing Research Community
Tony Turner
Capturing Deep Insights
2021 • DesignOps Summit 2021
Gold
Iram Shah
Closing Keynote: The View from the Top
2019 • Enterprise Experience 2019
Gold
Tricia Wang
From Users to Shapers of AI: The Future of Research
2024 • Advancing Research 2024
Gold
Louis Rosenfeld
Welcome / Housekeeping
2023 • Enterprise UX 2023
Gold
Angelos Arnis
Navigating the Rapid Shifts in Tech's Turbulent Terrain
2023 • DesignOps Summit 2023
Gold
Meaghan Waters
Lack of Product Thinking will Doom Your Legacy Modernization
2021 • Design at Scale 2021
Gold
Anna Nguyen
Why Our Voice of the Customer is Better Than Yours
2022 • Advancing Research 2022
Gold
Jilanna Wilson
Distributed DesignOps Management (Videoconference)
2019 • DesignOps Community
Chris Hammond
Embedding sustainability into enterprise design and development: A journey towards "sustainability consciousness"
2025 • Climate UX Interest Group (Rosenfeld Community)
Sam Ladner
How Research Can Drive Strategic Foresight
2022 • Advancing Research 2022
Gold
Louis Rosenfeld
Coffee with Lou: Should You Write a (UX) Book? (Videoconference)
2024 • Rosenfeld Community
Lija Hogan
Doing more with more: Lessons from the Front Lines of Democratization
2022 • Advancing Research 2022
Gold
Bria Alexander
Opening Remarks
2023 • DesignOps Summit 2023
Gold

More Videos

"Users’ perception predicts attrition and paid referrals — design absolutely matters when people decide to buy or go."

Standardizing Product Merits for Leaders, Designers, and Everyone

June 15, 2018

Simon Wardley

"Most strategy today is guesswork based on what others are doing, not based on situational awareness."

Simon Wardley

Maps and Topographical Intelligence (Videoconference)

January 31, 2019

Sandra Camacho

"Many smartwatch designs assume male hands as default, excluding smaller wrists and diverse body types."

Sandra Camacho

Creating More Bias-Proof Designs

January 22, 2025

Darian Davis

"By observing Jeff’s concerns and asking questions, I was able to show empathy and focus on the problem rather than get defensive."

Darian Davis

Lessons from a Toxic Work Relationship

January 8, 2024

Fisayo Osilaja

"Providing more holistic recommendations helped us gain more trust and buy-in from stakeholders, increasing UX maturity."

Fisayo Osilaja

[Demo] The AI edge: From researcher to strategist

June 4, 2024

Uday Gajendar

"Creating tangible artifacts forces reaction and debate, helping break enterprise paralysis and drive decisions."

Uday Gajendar

The Wicked Craft of Enterprise UX

May 13, 2015

Davis Neable

"No official kickoff was held, which meant shifting expectations and lack of alignment."

Davis Neable Guy Segal

How to Drive a Design Project When you Don’t Have a Design Team

June 10, 2021

Eniola Oluwole

"Launching a design system is not a sprint, there’s no end, it’s always a continuous process."

Eniola Oluwole

Lessons From the DesignOps Journey of the World's Largest Travel Site

October 24, 2019

Aurobinda Pradhan

"At Qubits, you can customize or copy standard design processes like Lean UX and add or remove activities easily."

Aurobinda Pradhan Shashank Deshpande

Introduction to Collaborative DesignOps using Cubyts

September 9, 2022