Log in or create a free Rosenverse account to watch this video.
Log in Create free account100s of community videos are available to free members. Conference talks are generally available to Gold members.
Summary
Faced with the coronavirus crisis, the world switched from office to remote work almost overnight. Likewise, many design teams suddenly found themselves having to conduct user research remotely. For some, this wasn't entirely new. For others, it was the first time going all-out remote, which took some getting used to!
Key Insights
-
•
Remote research became essential overnight due to the COVID-19 lockdown but is not universally suitable for all research questions.
-
•
Deep contextual inquiries and ethnographic studies are significantly impaired by remote setups and often not cost-effective.
-
•
Certain research goals, such as digital product usability testing, prototype validation, and mental model exploration, are highly adaptable to remote methods.
-
•
Asynchronous remote research enables participants to log activities in real time, reducing recall bias.
-
•
Preparation for remote research requires much more time and effort than in-person research, given limitations in improvisation during sessions.
-
•
Recruitment bias towards digitally literate users is a major challenge for remote research, threatening inclusivity.
-
•
Over-recruiting by 50% is recommended to compensate for technology issues and participant drop-offs in remote sessions.
-
•
Screening for participant stressors related to COVID-19, such as job loss or health concerns, is crucial to ensure ethical and effective research.
-
•
Having backup communication tools and clear technical support protocols during sessions dramatically reduces disruptions.
-
•
Large numbers of observers during remote sessions can negatively affect interview quality; clear rules and boundaries are necessary.
Notable Quotes
"Remote research is not a silver bullet; some things can be done remotely really easily, others require creativity, and some just won’t work remotely."
"The best way to understand something is to become part of it, which is very hard to do remotely."
"In remote interviews, you have to prepare way more and it takes way longer because you can’t just improvise as easily as in person."
"Recruitment in remote research often biases towards people with access to computers with webcams, which is dangerous for inclusivity."
"Over recruiting by 50% helps because there are so many tech glitches and people dropping out or not showing up."
"Pre-interview phone calls to screen participants and assess their current situation were vital during the pandemic."
"Having formal backup tools like Google Meet or phone calls ready is essential because technical failures will happen."
"Stakeholders new to observing research remotely may interrupt sessions, so clear rules and expectations are critical."
"I’m a body speaker and I really suffer with remote because I communicate a lot through gestures that get lost."
"Sometimes we had to drop parts of the research questions if the context had changed so drastically, like in job search platforms during mass layoffs."
Or choose a question:
More Videos
"The time for debate has passed; we need to act decisively and collaboratively."
Alex Hurworth Bonnie John Fahd Arshad Antoine MarinDesigning a Contact Tracing App for Universal Access
October 23, 2020
"We started to ask ourselves, does every new Design Ops practitioner need 10 years of experience like Lisa and I? What opportunities are we missing by not having more junior roles?"
Laine Riley Prokay Lisa GordonCarving a Path for Early Career DesignOps Practitioners
September 9, 2022
"Everyone wanted to know what was the official pattern and who was accountable for it."
Eniola OluwoleLessons From the DesignOps Journey of the World's Largest Travel Site
October 24, 2019
"Strategy should be continuous, circular, and evolve with every action the organization takes."
Nathan ShedroffDouble Your Mileage: Use Your Research Strategically
March 31, 2020
"Accessibility is an ongoing process where we iterate, improve, and expand, and mobile-first makes the journey easier."
Sam ProulxMobile Accessibility: Why Moving Accessibility Beyond the Desktop is Critical in a Mobile-first World
November 17, 2022
"Documentation and making findings visible even without a dedicated research librarian helps maintain program momentum."
Feleesha SterlingBuilding a Rapid Research Program (Videoconference)
May 18, 2023
"Culture is the most influential factor impacting people's perceptions and values today."
Neil BarrieWidening the Aperture: The Case for Taking a Broader Lens to the Dialogue between Products and Culture
March 25, 2024
"Incremental improvements and disruptive innovation require very different methods and measures."
John DevanneyThe Design Management Office
November 6, 2017
"If they don’t give you a seat at the table, bring a folding chair."
Katy MogalBut Do Your Insights Scale?
March 12, 2021