Rosenverse
Data-Prompted Interviews

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Data-Prompted Interviews

Friday, December 17, 2021 • QuantQual Interest Group
Share the love for this talk
Data-Prompted Interviews
Speakers: Amelia Cole
Link:

Summary

In this session, Amelia unpacks data-prompted interviews with an emphasis on Experience Sampling Methods. You will learn the essentials of running an Experience Sampling study and how to use quantitative data during interviews to enhance our understanding of daily life activities and experiences.

Key Insights

  • •

    Data prompted interviews use participants’ own quantitative data to guide qualitative exploration, enhancing insight depth.

  • •

    Experience Sampling Methods capture real-time, repeated snapshots of participants’ thoughts and actions to track temporal patterns.

  • •

    Balancing sampling frequency, survey length, and study duration is critical to avoid participant fatigue in longitudinal ESM studies.

  • •

    Four trigger types in ESM—random, fixed, contextual, and self-initiated—serve distinct research purposes.

  • •

    High attrition and resource intensity are common challenges in ESM, necessitating careful preparation and participant engagement.

  • •

    Reactivity, where participants alter behavior due to observation, is an inherent feature of ESM and can enhance participant metacognition.

  • •

    Unstructured interviews following ESM offer participant-controlled, rich narratives that reveal the why behind quantitative patterns.

  • •

    ESM is well-suited for sensitive topics by enabling in-the-moment data collection in natural settings.

  • •

    Tools like XPL facilitate ESM research by providing mobile-friendly forms, scheduling, and easy data export for analysis.

  • •

    Mixed methods pairing of ESM and qualitative interviews can be tailored by purposive sampling from the quantitative pool for deeper understanding.

Notable Quotes

"Data prompted interviews use the participant's own data to enhance understanding of their specific experience."

"Experience sampling captures real-time lived experience repeatedly to examine patterns of change and growth."

"Balancing how often you signal someone and how many questions you ask is key to reduce participant fatigue."

"There are four trigger types: random, fixed, contextual, and self-initiated, each serving a unique purpose."

"This method has a degree of reactivity; paying attention to something may alter or change behavior."

"Preparation is key: pilot studies and a data analysis plan before launching ensure data quality and study success."

"Unstructured interviews are participant-controlled, spontaneous, and offer rich data but are less replicable."

"ESM improves ecological validity by collecting data in real-world situations as they occur."

"You can use experience sampling data to select a small qualitative sample to dive deeper in interviews."

"Never collect data that doesn’t specifically address your research question."

Ask the Rosenbot
Chris Chapo
Data Science and Design: A Tale of Two Tribes
2015 • Enterprise UX 2015
Gold
Kwabena Opoku
Methodological toolkit for unique research impact
2026 • Advancing Research 2026
Gold
Jennifer Fraser
What would Emmy Noether Do? Math, Models and Mulling in UX Research
2023 • Advancing Research 2023
Gold
Janelle Estes
UX Research Trends
2021 • Advancing Research Community
Sam Proulx
Designing For Screen Readers: Understanding the Mental Models and Techniques of Real Users
2021 • Civic Design 2021
Gold
Benjamin Real
Showing the Value of DesignOps by Not Having a DesignOps Team
2020 • DesignOps Summit 2020
Gold
Holly Cole
Understanding Experiences: When you have to do more than work
2018 • DesignOps Summit 2018
Gold
Phil Gilbert
A Consistent Culture of Design
2015 • Enterprise UX 2015
Gold
Ana Maria Montero Barrantes
The Authentic UX Talent Show
2024 • Enterprise Experience 2020
Gold
Yalenka Mariën
Designing for Digital Inclusion in the Belgian Government
2021 • Civic Design 2021
Gold
Wendy Johansson
Be a Product Boss!
2022 • Design in Product 2022
Gold
Emily Danielson
“I mean, I can lift a shovel”: Design Skills in Disaster Response
2022 • Design at Scale 2022
Gold
Séamus Byrne
Aligning Teams with Choreography
2024 • Enterprise Experience 2020
Gold
Devon Powers
Imagining Better Futures
2022 • Advancing Research 2022
Gold
Laura Weiss
There is No Playbook: Leader as Coach During Challenging Times
2024 • Rosenfeld Community
Kristin Sundermeyer
Design Ops Metrics
2021 • DesignOps Summit 2021
Gold

More Videos

Erin Hauber

"Scaled Agile felt at first like a step backwards—design looked like just the finishing touch, not a key ingredient."

Erin Hauber

Design is Not the Frosting on the Scaled Agile Layer Cake

October 24, 2019

Megan Kierstead

"Thoughts cause feelings, and feelings motivate actions. Changing thoughts changes everything."

Megan Kierstead

You Are a Badass at UX: Overcoming Imposter Syndrome

March 10, 2021

Maggie Dieringer

"We maintain structured flexibility so we can move people where the work is regardless of politics or whatever else is going on."

Maggie Dieringer

Creating Consistency Through Constant Change

January 8, 2024

Meaghan Waters

"Allocate about 30% of your analysis and design effort to change management for successful adoption."

Meaghan Waters Fotina Koutropoulous

Lack of Product Thinking will Doom Your Legacy Modernization

June 9, 2021

Jemma Ahmed

"Market researchers have an air of arrogance like an old cat, confident and unbothered by disruption."

Jemma Ahmed

Bringing together market and user research

October 17, 2019

Maria Taylor

"Building trust should absolutely be a core value for design ops teams aiming to steward knowledge effectively."

Maria Taylor

Knowledge is Power: Managing the Lifeblood of the Design Org

October 3, 2023

Sam Proulx

"When blind users choose between Android and iPhone, they weigh trade-offs between stability and customizability."

Sam Proulx

Understanding Screen Readers on Mobile: How And Why to Learn from Native Users

June 6, 2023

Catherine Blizzard

"Some managers felt undermined because they were part of the delivery team rather than just overseeing it."

Catherine Blizzard

Using Integrated Insight to Drive Growth

March 10, 2022

Randolph Duke II

"Do I find a way to make this conversation more about the software as scheduled or do I show Laura how to react to the unplanned?"

Randolph Duke II

War Stories LIVE! Randy Duke II

March 30, 2020