Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Remote User Research: Dos and Don'ts from the Virtual Field (Videoconference)
Thursday, June 11, 2020 • Advancing Research Community
Share the love for this talk
Remote User Research: Dos and Don'ts from the Virtual Field (Videoconference)
Speakers: Sarah Rink
Link:

Summary

Faced with the coronavirus crisis, the world switched from office to remote work almost overnight. Likewise, many design teams suddenly found themselves having to conduct user research remotely. For some, this wasn't entirely new. For others, it was the first time going all-out remote, which took some getting used to!

Key Insights

  • Remote research became essential overnight due to the COVID-19 lockdown but is not universally suitable for all research questions.

  • Deep contextual inquiries and ethnographic studies are significantly impaired by remote setups and often not cost-effective.

  • Certain research goals, such as digital product usability testing, prototype validation, and mental model exploration, are highly adaptable to remote methods.

  • Asynchronous remote research enables participants to log activities in real time, reducing recall bias.

  • Preparation for remote research requires much more time and effort than in-person research, given limitations in improvisation during sessions.

  • Recruitment bias towards digitally literate users is a major challenge for remote research, threatening inclusivity.

  • Over-recruiting by 50% is recommended to compensate for technology issues and participant drop-offs in remote sessions.

  • Screening for participant stressors related to COVID-19, such as job loss or health concerns, is crucial to ensure ethical and effective research.

  • Having backup communication tools and clear technical support protocols during sessions dramatically reduces disruptions.

  • Large numbers of observers during remote sessions can negatively affect interview quality; clear rules and boundaries are necessary.

Notable Quotes

"Remote research is not a silver bullet; some things can be done remotely really easily, others require creativity, and some just won’t work remotely."

"The best way to understand something is to become part of it, which is very hard to do remotely."

"In remote interviews, you have to prepare way more and it takes way longer because you can’t just improvise as easily as in person."

"Recruitment in remote research often biases towards people with access to computers with webcams, which is dangerous for inclusivity."

"Over recruiting by 50% helps because there are so many tech glitches and people dropping out or not showing up."

"Pre-interview phone calls to screen participants and assess their current situation were vital during the pandemic."

"Having formal backup tools like Google Meet or phone calls ready is essential because technical failures will happen."

"Stakeholders new to observing research remotely may interrupt sessions, so clear rules and expectations are critical."

"I’m a body speaker and I really suffer with remote because I communicate a lot through gestures that get lost."

"Sometimes we had to drop parts of the research questions if the context had changed so drastically, like in job search platforms during mass layoffs."

Ask the Rosenbot
Sam Proulx
Understanding Screen Readers on Mobile: How And Why to Learn from Native Users
2023 • Enterprise UX 2023
Gold
Alfred Kahn
A Seat at the Table: Making Your Team a Strategic Partner
2023 • Design in Product 2023
Gold
Gregg Bernstein
Opportunistic Research with Gregg Bernstein (Videoconference)
2019 • Advancing Research Community
Tricia Wang
From Users to Shapers of AI: The Future of Research
2024 • Advancing Research 2024
Gold
Jim Kalbach
Jazz Improvisation as a Model for Team Collaboration
2019 • Enterprise Experience 2019
Gold
Changying (Z) Zheng
Navigating Innovation with Integrity
2024 • DesignOps 2024
Gold
Sam Proulx
Designing For Screen Readers: Understanding the Mental Models and Techniques of Real Users
2021 • DesignOps Summit 2021
Gold
Harry Max
Prioritization for Leaders (2nd of 3 seminars) (Videoconference)
2024 • Rosenfeld Community
What DesignOps Can Learn From DevOps
2017 • DesignOps Summit 2017
Gold
Mansi Gupta
Drawing from Feminist Practice to Make Inclusive Design Operational
2022 • DesignOps Summit 2022
Gold
Alberto Ferreira
Making it Count: Developing a custom digital metric framework that works
2021 • QuantQual Interest Group (Rosenfeld Community)
Brianna Sylver
Lead With Purpose
2020 • Advancing Research 2020
Gold
Robin Beers
Panel: Excellence in Communicating Insights
2024 • Advancing Research 2024
Gold
Dorelle Rabinowitz
The Magic Word is Trust
2018 • Enterprise Experience 2018
Gold
Jose Coronado
People First - Design at JP Morgan
2021 • Design at Scale 2021
Gold
Luca Rager
Empowering Gaming at Scale: How Xbox Builds Powerful, Automated, and Distributed Design Systems with Sketch
2021 • DesignOps Summit 2021
Gold

More Videos

Zariah Cameron

"Jobs always ask for three references. I think I might start asking for three happy employees."

Zariah Cameron

ReDesigning Wellbeing for Equitable Care in the Workplace

September 23, 2024

John Cutler

"Individuals tend to confuse prioritization with personal productivity or time management."

John Cutler Harry Max

Prioritization for designers and product managers (1st of 3 seminars) (Videoconference)

June 13, 2024

Nick Cochran

"Inviting people from other disciplines to experience user research helped Felipe see why user experience matters."

Nick Cochran

Growing in Enterprise Design through Making Connections

June 3, 2019

Deanna Smith

"Use pilots as a tool to get buy-in from stakeholders and provide evidence for why change might be needed."

Deanna Smith

Leading Change with Confidence: Strategies for Optimizing Your Process

September 23, 2024

Magdalena Zadara

"Meeting stakeholders where they are means understanding their language and prior knowledge, not just the physical location."

Magdalena Zadara

Zero Hour: How to Get Far Quickly When Starting Your Digital Service Unit Late

November 16, 2022

Nova Wehman-Brown

"We asked people to step out of their comfort zones and do things they'd never done before."

Nova Wehman-Brown

We've Never Done This Before

June 4, 2019

Liwei Dai

"Research thinking—not specific research methods—is foundational and evergreen for human researchers in AI."

Liwei Dai

The Heart and Brain of the AI Research

March 31, 2020

Gordon Ross

"My phone buzzed again. I have a job this weekend for you and your team to help on the COVID response if you’re available."

Gordon Ross

12 Months of COVID-19 Design and Digital Response with the British Columbia Government

December 8, 2021

Tutti Taygerly

"Ruthless prioritization tells us to be more efficient, but it feeds into a punishment culture."

Tutti Taygerly

Make Space to Lead

June 12, 2021