Anatomy of a Strong User Panel
Summary
User panels are one of the fastest ways to connect with your audience and extract valuable insights—when done right. In this session, Sydney Lawson, Senior Product Marketing Manager at Rally, dives deep into real user panels—tearing them up, not down—to uncover what top research teams are doing well and what’s worth stealing for your own panel. From sign-up to participation, she’ll break down what makes panels effective and how to optimize every step of the experience.
Key Insights
-
•
Every successful user panel has a dedicated landing page with a clear call to action and explanation of participation benefits.
-
•
Keeping screener questions between five to ten helps maintain low friction and improves sign-up rates.
-
•
Using single-select, closed-ended questions for job functions avoids messy and unusable data compared to open-text fields.
-
•
Including questions about AI usage and interest helps target relevant participants for specialized research.
-
•
Large companies like Google can afford more extensive screener forms with conditional logic due to their broad user base and resource availability.
-
•
Separate FAQ pages linked from the landing page reduce clutter and provide potential panelists with detailed sign-up information.
-
•
Panel engagement improves when participants see study results and understand how their feedback influences product decisions.
-
•
Creative incentive models like digital badges (from Outsystems) can gamify participation when budgets for monetary rewards are limited.
-
•
Including fake tools or options in screening questions (Genesys example) helps identify and filter out insincere panelists motivated only by incentives.
-
•
Tracking participant location enables compliance with regional incentive regulations and data privacy laws.
Notable Quotes
"Every single one of these companies has a landing page on their marketing website with a call to action to sign up."
"The most successful way to ask about job function is a single-select question, not an open field."
"We love to see questions around AI and even asking if participants want to join AI studies specifically."
"Incentives are a benefit but should not be the number one reason people join a panel."
"Google’s sign-up has a progress bar which is really helpful so participants know how far they are along."
"If you ask accessibility questions, it’s so important to actually respect the answers."
"Outsystems gamified their research panel with badges because they didn’t have budget for monetary incentives."
"Genesys includes a fake tool in the software list to stop incentive-driven participants from checking all boxes."
"You want your panel to be representative of your customer base, not exactly all your customers."
"Sharing the results of studies with panelists gets them excited about contributing and keeps them engaged."
Or choose a question:
More Videos
"You have to build something, ship something, and make something especially when dealing with hundreds of thousands of objects."
Uday GajendarTheme 1: Introduction
June 9, 2021
"If we want research to thrive, we need to equip ourselves with more tools, not fewer."
Megan BlockerTheme 2 Intro
March 12, 2025
"Information is power in organizations, so deploying AI agents means reconsidering who gets access to what data."
Tina WeisserWhen AI Agents Meet Reality. Service Design Lessons from a Pilot
February 26, 2026
"Team ops goes wide to support 300-plus UX designers globally; product ops goes deep supporting 40-plus product design teams."
John Calhoun Rachel PosmanTwo Sides of the DesignOps Coin: Teams Ops and Product Ops
January 8, 2024
"This poor young airman is not entering into a super cool sci-fi command center but using apps built by their grandparents."
Michal Anne RogondinoSaving Outer Space: The First UX Design System for Our Nation’s Satellites
January 8, 2024
"Unmanaged challenges reduce the quality of life in society."
Onur Kocan Ayhan EnsiciUnderstanding the Strategy for Civic Design in a Complex City: Istanbul
November 16, 2022
"AI can empower researchers to solve pain points — like anticipating trends or critiquing discussion guides — amplifying impact rather than replacing work."
Llewyn PaineCoexisting with AI: A practical guide for researchers to navigate tools, ethics, and integration
March 11, 2025
"Community engagement is a powerful lever often left out of systems thinking processes."
Sheryl CababaExpanding Your Design Lens with Systems Thinking
February 23, 2023
"No surprises. Tell participants everything they’ll be experiencing from who will be in the room to if the session will be recorded."
Marisa BernsteinIt Takes GRIT: Lessons from the Small, but Mighty World of Civic Usability Testing
December 9, 2021
Latest Books All books
Dig deeper with the Rosenbot
Why is interoperability and API access critical in modern user research tooling ecosystems?
Who are natural allies for healthcare UX professionals inside complex healthcare systems, and how do you engage them?
How can lifelong learning be incorporated as a core principle of design education and beyond?