Log in or create a free Rosenverse account to watch this video.
Log in Create free account100s of community videos are available to free members. Conference talks are generally available to Gold members.
Summary
Faced with the coronavirus crisis, the world switched from office to remote work almost overnight. Likewise, many design teams suddenly found themselves having to conduct user research remotely. For some, this wasn't entirely new. For others, it was the first time going all-out remote, which took some getting used to!
Key Insights
-
•
Remote research became essential overnight due to the COVID-19 lockdown but is not universally suitable for all research questions.
-
•
Deep contextual inquiries and ethnographic studies are significantly impaired by remote setups and often not cost-effective.
-
•
Certain research goals, such as digital product usability testing, prototype validation, and mental model exploration, are highly adaptable to remote methods.
-
•
Asynchronous remote research enables participants to log activities in real time, reducing recall bias.
-
•
Preparation for remote research requires much more time and effort than in-person research, given limitations in improvisation during sessions.
-
•
Recruitment bias towards digitally literate users is a major challenge for remote research, threatening inclusivity.
-
•
Over-recruiting by 50% is recommended to compensate for technology issues and participant drop-offs in remote sessions.
-
•
Screening for participant stressors related to COVID-19, such as job loss or health concerns, is crucial to ensure ethical and effective research.
-
•
Having backup communication tools and clear technical support protocols during sessions dramatically reduces disruptions.
-
•
Large numbers of observers during remote sessions can negatively affect interview quality; clear rules and boundaries are necessary.
Notable Quotes
"Remote research is not a silver bullet; some things can be done remotely really easily, others require creativity, and some just won’t work remotely."
"The best way to understand something is to become part of it, which is very hard to do remotely."
"In remote interviews, you have to prepare way more and it takes way longer because you can’t just improvise as easily as in person."
"Recruitment in remote research often biases towards people with access to computers with webcams, which is dangerous for inclusivity."
"Over recruiting by 50% helps because there are so many tech glitches and people dropping out or not showing up."
"Pre-interview phone calls to screen participants and assess their current situation were vital during the pandemic."
"Having formal backup tools like Google Meet or phone calls ready is essential because technical failures will happen."
"Stakeholders new to observing research remotely may interrupt sessions, so clear rules and expectations are critical."
"I’m a body speaker and I really suffer with remote because I communicate a lot through gestures that get lost."
"Sometimes we had to drop parts of the research questions if the context had changed so drastically, like in job search platforms during mass layoffs."
Or choose a question:
More Videos
"Jobs always ask for three references. I think I might start asking for three happy employees."
Zariah CameronReDesigning Wellbeing for Equitable Care in the Workplace
September 23, 2024
"Individuals tend to confuse prioritization with personal productivity or time management."
John Cutler Harry MaxPrioritization for designers and product managers (1st of 3 seminars) (Videoconference)
June 13, 2024
"Inviting people from other disciplines to experience user research helped Felipe see why user experience matters."
Nick CochranGrowing in Enterprise Design through Making Connections
June 3, 2019
"Use pilots as a tool to get buy-in from stakeholders and provide evidence for why change might be needed."
Deanna SmithLeading Change with Confidence: Strategies for Optimizing Your Process
September 23, 2024
"Meeting stakeholders where they are means understanding their language and prior knowledge, not just the physical location."
Magdalena ZadaraZero Hour: How to Get Far Quickly When Starting Your Digital Service Unit Late
November 16, 2022
"We asked people to step out of their comfort zones and do things they'd never done before."
Nova Wehman-BrownWe've Never Done This Before
June 4, 2019
"Research thinking—not specific research methods—is foundational and evergreen for human researchers in AI."
Liwei DaiThe Heart and Brain of the AI Research
March 31, 2020
"My phone buzzed again. I have a job this weekend for you and your team to help on the COVID response if you’re available."
Gordon Ross12 Months of COVID-19 Design and Digital Response with the British Columbia Government
December 8, 2021
"Ruthless prioritization tells us to be more efficient, but it feeds into a punishment culture."
Tutti TaygerlyMake Space to Lead
June 12, 2021