Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Remote User Research: Dos and Don'ts from the Virtual Field (Videoconference)
Thursday, June 11, 2020 • Advancing Research Community
Share the love for this talk
Remote User Research: Dos and Don'ts from the Virtual Field (Videoconference)
Speakers: Sarah Rink
Link:

Summary

Faced with the coronavirus crisis, the world switched from office to remote work almost overnight. Likewise, many design teams suddenly found themselves having to conduct user research remotely. For some, this wasn't entirely new. For others, it was the first time going all-out remote, which took some getting used to!

Key Insights

  • Remote research became essential overnight due to the COVID-19 lockdown but is not universally suitable for all research questions.

  • Deep contextual inquiries and ethnographic studies are significantly impaired by remote setups and often not cost-effective.

  • Certain research goals, such as digital product usability testing, prototype validation, and mental model exploration, are highly adaptable to remote methods.

  • Asynchronous remote research enables participants to log activities in real time, reducing recall bias.

  • Preparation for remote research requires much more time and effort than in-person research, given limitations in improvisation during sessions.

  • Recruitment bias towards digitally literate users is a major challenge for remote research, threatening inclusivity.

  • Over-recruiting by 50% is recommended to compensate for technology issues and participant drop-offs in remote sessions.

  • Screening for participant stressors related to COVID-19, such as job loss or health concerns, is crucial to ensure ethical and effective research.

  • Having backup communication tools and clear technical support protocols during sessions dramatically reduces disruptions.

  • Large numbers of observers during remote sessions can negatively affect interview quality; clear rules and boundaries are necessary.

Notable Quotes

"Remote research is not a silver bullet; some things can be done remotely really easily, others require creativity, and some just won’t work remotely."

"The best way to understand something is to become part of it, which is very hard to do remotely."

"In remote interviews, you have to prepare way more and it takes way longer because you can’t just improvise as easily as in person."

"Recruitment in remote research often biases towards people with access to computers with webcams, which is dangerous for inclusivity."

"Over recruiting by 50% helps because there are so many tech glitches and people dropping out or not showing up."

"Pre-interview phone calls to screen participants and assess their current situation were vital during the pandemic."

"Having formal backup tools like Google Meet or phone calls ready is essential because technical failures will happen."

"Stakeholders new to observing research remotely may interrupt sessions, so clear rules and expectations are critical."

"I’m a body speaker and I really suffer with remote because I communicate a lot through gestures that get lost."

"Sometimes we had to drop parts of the research questions if the context had changed so drastically, like in job search platforms during mass layoffs."

Dorelle Rabinowitz
The Magic Word is Trust
2018 • Enterprise Experience 2018
Gold
Adam Cutler
People + Places + Practices = Outcomes
2016 • Enterprise UX 2016
Gold
James Rampton
The Basics of Automotive UX & Why Phones Are a Part of That Future
2024 • Rosenfeld Community
Scott Jensen
Short Take #2: UX/Product Lessons from Your Industry Peers
2022 • Design in Product 2022
Gold
Maggie Dieringer
Creating Consistency Through Constant Change
2024 • DesignOps Summit 2020
Gold
Steve Portigal
Discussion
2015 • Enterprise UX 2015
Gold
Luz Bratcher
This Is a Talk for Tired People
2022 • Design at Scale 2022
Gold
Indra Klavins
A Design Ops Girl in a Dev Ops World
2019 • DesignOps Summit 2019
Gold
Clemens Janssen
Efficiently Scaling Research as a Team of One
2023 • Advancing Research 2023
Gold
Phil Gilbert
A Consistent Culture of Design
2015 • Enterprise UX 2015
Gold
Peace is waged with sticky notes: Mapping Real-World Experiences
2018 • Enterprise Experience 2018
Gold
Jemma Ahmed
Democratization: Working with it, not against it [Advancing Research Community Workshop Series]
2024 • Advancing Research Community
Nicole Aleong
What UX research can learn from other research practices [Advancing Research Community Workshop Series] (Videoconference)
2023 • Advancing Research Community
Katy Mogal
But Do Your Insights Scale?
2021 • Advancing Research 2021
Gold
Fisayo Osilaja
[Demo] The AI edge: From researcher to strategist
2024 • Designing with AI 2024
Gold
Billy Carlson
Ideation tips for Product Managers
2022 • Design in Product 2022
Gold

More Videos

Wyatt Hayman

"We reward people financially rather than rely on sharebacks, as engagement remained consistent without sharebacks."

Wyatt Hayman

Global Research Panels (Videoconference)

August 8, 2020

PJ Buddhari

"We hold quarterly town halls and office hours to keep the community informed and supported."

PJ Buddhari Nate Baldwin

Meet Spectrum, Adobe’s Design System

June 9, 2021

Sarah Gallimore

"Sacramento’s Civic Enrichment Center is an artifact aligning a city around community and future workforce needs."

Sarah Gallimore

Inspire Progress with Artifacts from the Future

November 18, 2022

Peter Merholz

"UXers are less satisfied than their peers because we have failed to set expectations about the real work of UX in organizations."

Peter Merholz

The Trials and Tribulations of Directors of UX (Videoconference)

July 13, 2023

Dr. Jamika D. Burge

"Time poverty is a huge problem for women, especially those from marginalized backgrounds, and researchers must ask how much time they can give."

Dr. Jamika D. Burge Mansi Gupta

Advancing the Inclusion of Womxn in Research Practices (Videoconference)

September 15, 2022

Amy Marquez

"Product principles are minimal but help us say, oh, this is meeting that or not meeting that."

Amy Marquez

INVEST: Discussion

June 15, 2018

Dane DeSutter

"Games are not a point in time you run away from — you don’t just drop the cartridge and walk away."

Dane DeSutter Natalie Gedeon Deborah Hendersen Cheryl Platz

Beyond the Console: The rise of the Gamer Experience and how gaming will impact UX Research across industries (Videoconference)

May 17, 2024

Zariah Cameron

"Denying the body is not an antidote to the suffering of the world. When we protect our rest, we protect our dreaming."

Zariah Cameron

ReDesigning Wellbeing for Equitable Care in the Workplace

September 23, 2024

Jessica Norris

"Ask what helps you work better—this simple question is one of the most important things for colleagues and managers."

Jessica Norris

ADHD: A DesignOps Superpower

September 9, 2022