Log in or create a free Rosenverse account to watch this video.
Log in Create free account100s of community videos are available to free members. Conference talks are generally available to Gold members.
Summary
In this talk, Wyatt conducts a deep dive into the Airbnb Global Research Panels, the program he has been developing at Airbnb over the past two years. Launch: why Airbnb created the Global Research Panels, the key decisions and the internal alignment required for launching the first version of the Global Research Panel Process: detailed look into the current version of the Global Research Panels, including the mechanics and tools used to manage it Impact: demonstration of ways the Global Research Panels have provided value over the past two years at Airbnb Evolution: see how the Global Research Panels has grown through six iterations so far and the vision for the Global Research Panels program going forward
Key Insights
-
•
Airbnb’s global research panels were founded to address the gap in accessing fast, quality feedback from non-English speaking users worldwide.
-
•
The first pilot panels were launched in Sydney (English) and Tokyo (non-English) markets to test operations before scaling.
-
•
Participants are rewarded with an amount adjusted by purchasing power parity, roughly equivalent to $400 in the US over six months.
-
•
Qualtrics’ Target Audience platform was chosen due to existing relationships and capability to manage multi-language panels.
-
•
All survey translations and open-ended responses are human translated to ensure quality over automated tools.
-
•
Panels shifted focus from hybrid qualitative-quantitative to primarily qualitative to match sample size and research needs.
-
•
Researchers use panels not only to collect feedback but also to validate assumptions and check for cultural sensitivities.
-
•
Panels support multiple Airbnb teams including homes, experiences, China new hosts, customer support, and travel managers, showing a flexible, customized application.
-
•
The two-week survey cycle balances quality translation needs and providing timely feedback to researchers.
-
•
Non-research teams also leverage the panels for quick community feedback, demonstrating the tool’s broader organizational value.
Notable Quotes
"We did all these analyses for each market and then fit the group to be proportional to key hosting and traveling characteristics."
"The majority of the participants last through the six-month commitment with only about 5% removed for low engagement."
"Human translation is preferred for accuracy, though Google Translate is used occasionally for urgent needs."
"We scaled panels down to about 60 countries in 11 languages focusing on markets important to Airbnb teams."
"Panels enable researchers to check cultural assumptions and sensitivities before launching larger studies."
"Survey question volume can range from one question to up to 40, but most participants answer around 20 questions."
"Researchers submit questions that get combined into one survey, translated, then responses are translated back for analysis."
"We reward people financially rather than rely on sharebacks, as engagement remained consistent without sharebacks."
"At first we considered outside research team access but decided to keep the panels limited within research for initial version."
"One of the coolest things is that product managers without formal research backgrounds can quickly talk to hosts across six countries without recruiting hassle."
Dig deeper—ask the Rosenbot:
More Videos
"The first impression triggers unconscious processes that heavily influence purchase decisions."
Daniela Magaña Flores Ariane Rahn Jeff Ephraim BanderAhead of Competition: Learn What UX Benchmarking Can Do for Your Business Today
March 10, 2022
"I’m willing to bet that every researcher in this room by the end of 2025 will add prompt engineering to their research skillset."
Savina HawkinsHarnessing AI in UXR: Practical Strategies for Positive Impact
March 26, 2024
"Innovation in conservation practices is desperately needed to keep pace with environmental changes."
Alex Hurworth Bonnie John Fahd Arshad Antoine MarinDesigning a Contact Tracing App for Universal Access
October 23, 2020
"We try to avoid researchers just dumping entire presentations; we encourage structuring insights natively in Hits."
Matt DuignanHITS, Microsoft's internal human insight system: From research library to living body of knowledge (Videoconference)
July 16, 2019
"Making something easier isn’t always better; it can create addictive behaviors - Aza Raskin, inventor of infinite scroll."
Craig VillamorDesign Systems for Ethical Design (Videoconference)
January 26, 2023
"Think of UX as risk mitigation, not a zero-sum game, and share the risk with your stakeholders."
Ovetta SampsonTurning UX Passion into Real Product Influence
June 7, 2023
"Most creative teams are always teetering on the edge of greatness."
Rima Campbell Amrit S BhachuIncrease Productivity and Drive Business Impact
September 24, 2024
"We had to negotiate getting Figma behind our single sign-on to ensure security, and it took multiple calls."
Amy Gawronski ZuccaroAdvice for DesignOps Employee #1
September 29, 2021
"We have to move into radical participatory research where researcher is community member."
Victor UdoewaBeyond Methods and Diversity: The Roots of Inclusion
March 26, 2024
