Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Remote User Research: Dos and Don'ts from the Virtual Field (Videoconference)
Thursday, June 11, 2020 • Advancing Research Community
Share the love for this talk
Remote User Research: Dos and Don'ts from the Virtual Field (Videoconference)
Speakers: Sarah Rink
Link:

Summary

Faced with the coronavirus crisis, the world switched from office to remote work almost overnight. Likewise, many design teams suddenly found themselves having to conduct user research remotely. For some, this wasn't entirely new. For others, it was the first time going all-out remote, which took some getting used to!

Key Insights

  • Remote research became essential overnight due to the COVID-19 lockdown but is not universally suitable for all research questions.

  • Deep contextual inquiries and ethnographic studies are significantly impaired by remote setups and often not cost-effective.

  • Certain research goals, such as digital product usability testing, prototype validation, and mental model exploration, are highly adaptable to remote methods.

  • Asynchronous remote research enables participants to log activities in real time, reducing recall bias.

  • Preparation for remote research requires much more time and effort than in-person research, given limitations in improvisation during sessions.

  • Recruitment bias towards digitally literate users is a major challenge for remote research, threatening inclusivity.

  • Over-recruiting by 50% is recommended to compensate for technology issues and participant drop-offs in remote sessions.

  • Screening for participant stressors related to COVID-19, such as job loss or health concerns, is crucial to ensure ethical and effective research.

  • Having backup communication tools and clear technical support protocols during sessions dramatically reduces disruptions.

  • Large numbers of observers during remote sessions can negatively affect interview quality; clear rules and boundaries are necessary.

Notable Quotes

"Remote research is not a silver bullet; some things can be done remotely really easily, others require creativity, and some just won’t work remotely."

"The best way to understand something is to become part of it, which is very hard to do remotely."

"In remote interviews, you have to prepare way more and it takes way longer because you can’t just improvise as easily as in person."

"Recruitment in remote research often biases towards people with access to computers with webcams, which is dangerous for inclusivity."

"Over recruiting by 50% helps because there are so many tech glitches and people dropping out or not showing up."

"Pre-interview phone calls to screen participants and assess their current situation were vital during the pandemic."

"Having formal backup tools like Google Meet or phone calls ready is essential because technical failures will happen."

"Stakeholders new to observing research remotely may interrupt sessions, so clear rules and expectations are critical."

"I’m a body speaker and I really suffer with remote because I communicate a lot through gestures that get lost."

"Sometimes we had to drop parts of the research questions if the context had changed so drastically, like in job search platforms during mass layoffs."

Ask the Rosenbot
Bria Alexander
Charting the future of DesignOps: A community workshop (Videoconference)
2024 • DesignOps Community
Mike Davidson
Fireside Chat
2022 • Advancing Research 2022
Gold
PJ Buddhari
Meet Spectrum, Adobe’s Design System
2021 • Design at Scale 2021
Gold
Brianna Sylver
Lead With Purpose
2020 • Advancing Research 2020
Gold
Sheri Byrne-Haber
Accessibility at Scale
2021 • Design at Scale 2021
Gold
Jennifer Strickland
Fireside Chat: How Design Addresses a World on Fire (Videoconference)
2022 • Civic Design Community
Margot Bloomstein
Fostering Trust in Your Brand and Beyond (Videoconference)
2020 • Enterprise Community
Bria Alexander
OKRs—Helpful or Harmful? (Videoconference)
2022 • DesignOps Community
Michele Wong
Helping Them Help Us
2024 • Enterprise Experience 2020
Gold
Angelos Arnis
Navigating the Rapid Shifts in Tech's Turbulent Terrain
2023 • DesignOps Summit 2023
Gold
Laura Smith
Embedding Service Design and Agile Practice within UK Planning Teams to Create Services that Last
2024 • Advancing Service Design 2024
Gold
Stephanie Wade
Building and Sustaining Design in Government
2021 • Civic Design 2021
Gold
Research Operations at Scale
2017 • DesignOps Summit 2017
Gold
Steve Portigal
Discussion
2015 • Enterprise UX 2015
Gold
Deanna Smith
Leading Change with Confidence: Strategies for Optimizing Your Process
2024 • DesignOps 2024
Gold
Sandra Camacho
Creating More Bias-Proof Designs
2025 • Rosenfeld Community

More Videos

"You’re born on third base but think you hit a triple — that’s the enterprise software delusion."

Standardizing Product Merits for Leaders, Designers, and Everyone

June 15, 2018

Simon Wardley

"The Red Queen effect means if others adapt, you must adapt or lose."

Simon Wardley

Maps and Topographical Intelligence (Videoconference)

January 31, 2019

Sandra Camacho

"The Reflexive Compass helps us discern bias patterns early, take accountability, and measure impact."

Sandra Camacho

Creating More Bias-Proof Designs

January 22, 2025

Darian Davis

"Taking responsibility starts with an apology and seeking regular feedback."

Darian Davis

Lessons from a Toxic Work Relationship

January 8, 2024

Fisayo Osilaja

"Using ChatGPT allowed me to elevate from a researcher to a strategist by increasing my visibility and trust in the company."

Fisayo Osilaja

[Demo] The AI edge: From researcher to strategist

June 4, 2024

Uday Gajendar

"Craft should evolve from making a beautiful final object to serving as a facilitative anchor in enterprise UX."

Uday Gajendar

The Wicked Craft of Enterprise UX

May 13, 2015

Davis Neable

"Experience vision is a powerful tool because it gives everyone a tangible goal to work towards."

Davis Neable Guy Segal

How to Drive a Design Project When you Don’t Have a Design Team

June 10, 2021

Eniola Oluwole

"TripAdvisor is really nine major business units each thinking like sub companies instead of one end-to-end user experience."

Eniola Oluwole

Lessons From the DesignOps Journey of the World's Largest Travel Site

October 24, 2019

Aurobinda Pradhan

"We believe tracking design metrics aligned to business goals is important to demonstrate design’s impact."

Aurobinda Pradhan Shashank Deshpande

Introduction to Collaborative DesignOps using Cubyts

September 9, 2022