Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Remote User Research: Dos and Don'ts from the Virtual Field (Videoconference)
Thursday, June 11, 2020 • Advancing Research Community
Share the love for this talk
Remote User Research: Dos and Don'ts from the Virtual Field (Videoconference)
Speakers: Sarah Rink
Link:

Summary

Faced with the coronavirus crisis, the world switched from office to remote work almost overnight. Likewise, many design teams suddenly found themselves having to conduct user research remotely. For some, this wasn't entirely new. For others, it was the first time going all-out remote, which took some getting used to!

Key Insights

  • Remote research became essential overnight due to the COVID-19 lockdown but is not universally suitable for all research questions.

  • Deep contextual inquiries and ethnographic studies are significantly impaired by remote setups and often not cost-effective.

  • Certain research goals, such as digital product usability testing, prototype validation, and mental model exploration, are highly adaptable to remote methods.

  • Asynchronous remote research enables participants to log activities in real time, reducing recall bias.

  • Preparation for remote research requires much more time and effort than in-person research, given limitations in improvisation during sessions.

  • Recruitment bias towards digitally literate users is a major challenge for remote research, threatening inclusivity.

  • Over-recruiting by 50% is recommended to compensate for technology issues and participant drop-offs in remote sessions.

  • Screening for participant stressors related to COVID-19, such as job loss or health concerns, is crucial to ensure ethical and effective research.

  • Having backup communication tools and clear technical support protocols during sessions dramatically reduces disruptions.

  • Large numbers of observers during remote sessions can negatively affect interview quality; clear rules and boundaries are necessary.

Notable Quotes

"Remote research is not a silver bullet; some things can be done remotely really easily, others require creativity, and some just won’t work remotely."

"The best way to understand something is to become part of it, which is very hard to do remotely."

"In remote interviews, you have to prepare way more and it takes way longer because you can’t just improvise as easily as in person."

"Recruitment in remote research often biases towards people with access to computers with webcams, which is dangerous for inclusivity."

"Over recruiting by 50% helps because there are so many tech glitches and people dropping out or not showing up."

"Pre-interview phone calls to screen participants and assess their current situation were vital during the pandemic."

"Having formal backup tools like Google Meet or phone calls ready is essential because technical failures will happen."

"Stakeholders new to observing research remotely may interrupt sessions, so clear rules and expectations are critical."

"I’m a body speaker and I really suffer with remote because I communicate a lot through gestures that get lost."

"Sometimes we had to drop parts of the research questions if the context had changed so drastically, like in job search platforms during mass layoffs."

Ask the Rosenbot
Alexia Cohen
Increasing Health Equity and Improving the Service Experience for Under-Served Latine Communities in Arizona
2024 • Advancing Service Design 2024
Gold
Julie Baher
Culture Change—My Journey
2015 • Enterprise UX 2015
Gold
Gonzalo Goyanes
Design ROI: Cover a Little, Get a Lot
2022 • DesignOps Summit 2022
Gold
Jon Fukuda
Theme One Intro
2023 • DesignOps Summit 2023
Gold
Kristin Skinner
8 Types of Measures in Design Operations (Videoconference)
2020 • DesignOps Community
Denise Jacobs
Interactive Keynote: Social Change by Design
2024 • Enterprise Experience 2020
Gold
Indi Young
Thinking styles: Mend hidden cracks in your market
2025 • Rosenfeld Community
Rusha Sopariwala
Remote, Together: Craft and Collaboration Across Disciplines, Borders, Time Zones, and a Design Org of 170+
2022 • Design at Scale 2022
Gold
Natalia Radywyl
Co-Designing New Power in Australia's Public Sector
2022 • Civic Design 2022
Gold
Dave Malouf
Closing Keynote: Amplify. Not Optimize.
2019 • DesignOps Summit 2019
Gold
Meredith Black
Scaling Design Culture
2017 • DesignOps Summit 2017
Gold
Kit Unger
Theme 1 Intro
2022 • Design at Scale 2022
Gold
Saara Kamppari-Miller
Theme Three Intro
2023 • DesignOps Summit 2023
Gold
Nick Cochran
Growing in Enterprise Design through Making Connections
2019 • Enterprise Experience 2019
Gold
Richard Buchanan
Creativity and Principles in the Flourishing Enterprise
2018 • Enterprise Experience 2018
Gold
Kristin Skinner
Group Activity: A Deep Dive Into Value and Outcomes
2019 • DesignOps Summit 2019
Gold

More Videos

Adam Cutler

"Can you show me your process, not just your portfolio? That shows me your real design thinking."

Adam Cutler Karen Pascoe Ian Swinson Susan Worthman

Discussion

June 8, 2016

Peter Merholz

"UX directors often feel like this poor person in the middle here getting pulled in all these directions."

Peter Merholz

The Trials and Tribulations of Directors of UX (Videoconference)

July 13, 2023

Lisa Welchman

"If you haven’t designed who your teams are and who your players are, expecting people to comply with standards won’t work."

Lisa Welchman

Cleaning Up Our Mess: Digital Governance for Designers

June 14, 2018

Vincent Brathwaite

"The time for action is now, and it must be collaborative."

Vincent Brathwaite

Opener: Past, Present, and Future—Closing the Racial Divide in Design Teams

October 22, 2020

Brenna Fallon

"If you forget the individual, you cut out psychological safety, and that’s the foundation of strong teams."

Brenna Fallon

Learning Over Outcomes

October 24, 2019

Tricia Wang

"We are all experiencing a spatial collapse, a disruption of our mental models of how we navigate physical and virtual spaces."

Tricia Wang

Spatial Collapse: Designing for Emergent Culture

January 8, 2024

Edgar Anzaldua Moreno

"Marital status mattered because car buying decisions often involve family members, not just the individual."

Edgar Anzaldua Moreno

Using Research to Determine Unique Value Proposition

March 11, 2021

"Successful operations must have a well-laid-out and transparent process and documentation, but that process must become invisible in its application."

Designing Systems at Scale

November 7, 2018

Erin Weigel

"Most product teams work linearly, but systems thinking captures the real-world complexity of moving forward and sometimes stepping back."

Erin Weigel

Get Your Whole Team Testing to Design for Impact

July 24, 2024