Rosenverse

Anatomy of a Strong User Panel

Conference ticket
Tuesday, March 10, 2026 • Advancing Research 2026
Share the love for this talk
Anatomy of a Strong User Panel
Speakers: Sydney Lawson
Link:

Summary

User panels are one of the fastest ways to connect with your audience and extract valuable insights—when done right. In this session, Sydney Lawson, Senior Product Marketing Manager at Rally, dives deep into real user panels—tearing them up, not down—to uncover what top research teams are doing well and what’s worth stealing for your own panel. From sign-up to participation, she’ll break down what makes panels effective and how to optimize every step of the experience.

Key Insights

  • Every successful user panel has a dedicated landing page with a clear call to action and explanation of participation benefits.

  • Keeping screener questions between five to ten helps maintain low friction and improves sign-up rates.

  • Using single-select, closed-ended questions for job functions avoids messy and unusable data compared to open-text fields.

  • Including questions about AI usage and interest helps target relevant participants for specialized research.

  • Large companies like Google can afford more extensive screener forms with conditional logic due to their broad user base and resource availability.

  • Separate FAQ pages linked from the landing page reduce clutter and provide potential panelists with detailed sign-up information.

  • Panel engagement improves when participants see study results and understand how their feedback influences product decisions.

  • Creative incentive models like digital badges (from Outsystems) can gamify participation when budgets for monetary rewards are limited.

  • Including fake tools or options in screening questions (Genesys example) helps identify and filter out insincere panelists motivated only by incentives.

  • Tracking participant location enables compliance with regional incentive regulations and data privacy laws.

Notable Quotes

"Every single one of these companies has a landing page on their marketing website with a call to action to sign up."

"The most successful way to ask about job function is a single-select question, not an open field."

"We love to see questions around AI and even asking if participants want to join AI studies specifically."

"Incentives are a benefit but should not be the number one reason people join a panel."

"Google’s sign-up has a progress bar which is really helpful so participants know how far they are along."

"If you ask accessibility questions, it’s so important to actually respect the answers."

"Outsystems gamified their research panel with badges because they didn’t have budget for monetary incentives."

"Genesys includes a fake tool in the software list to stop incentive-driven participants from checking all boxes."

"You want your panel to be representative of your customer base, not exactly all your customers."

"Sharing the results of studies with panelists gets them excited about contributing and keeps them engaged."

Ask the Rosenbot
Brenna Fallon
Learning Over Outcomes
2019 • DesignOps Summit 2019
Gold
Bassel Deeb
Do More With Less: Equip and Lead Design Orgs Through Adversity
2023 • DesignOps Summit 2023
Gold
Matteo Gratton
Can Data and Ethics Live Together?
2021 • DesignOps Summit 2021
Gold
Sheryl Cababa
Thinking in systems to address climate with Sheryl Cababa
2024 • Climate UX Interest Group
Louis Rosenfeld
How to use the Rosenbot
2026 • Rosenfeld Community
Bud Caddell
DesignOps Community Sensing Session
2021 • DesignOps Community
Louis Rosenfeld
Coffee with Lou
2024 • Rosenfeld Community
Sam Proulx
Mobile Accessibility: Why Moving Accessibility Beyond the Desktop is Critical in a Mobile-first World
2022 • Advancing Research 2022
Gold
Chris Geison
What is Research Strategy?
2021 • Advancing Research 2021
Gold
Brad Peters
Short Take #1: UX/Product Lessons from Your Industry Peers
2022 • Design in Product 2022
Gold
Ilana Lipsett
Anticipating Risk, Regulating Tech: A Playbook for Ethical Technology Governance
2021 • Civic Design 2021
Gold
Sam Proulx
Online Shopping: Designing an Accessible Experience
2023 • DesignOps Summit 2023
Gold
Jemma Ahmed
Bringing together market and user research
2019 • Advancing Research Community
Wendy Johansson
An Education on Design Education for Orgs
2021 • Design at Scale 2021
Gold
Saskia Liebenberg
Start Small for Big Impact
2019 • DesignOps Community
James Lang
If you can design an app, you can design a community
2025 • Rosenfeld Community

More Videos

Christian Crumlish

"When something good happens, I want to name the person who did it and say yes, they passed through me. When something bad happens, I say let me and my team go look into it."

Christian Crumlish Wendy Johansson Rich Mironov Aditi Ruiz Adam Thomas

Afternoon Insights Panel

December 6, 2022

Jon Temple

"An SOW at LinkedIn takes six to eight weeks, and by then sometimes the project isn’t even relevant anymore."

Jon Temple Kalee Dankner Bruce Falk Lauren Galanter

Panel: Stacks, Security, and Stakeholders: The Hidden Work of UXR Tool Procurement

March 12, 2026

Himanshu Bharadwaj

"Our brains are like Ferrari with several petabytes of memory, but most of our thoughts are negative."

Himanshu Bharadwaj

If design had a heart

April 16, 2026

Nicole Umphress

"A key component is the hands-on experience working on real IBM business unit projects applying enterprise design thinking."

Nicole Umphress

Delivering Design Education During a Global Pandemic: Lessons Learned

June 9, 2022

Smitha Papolu

"The pandemic pulled our remote team much closer—being physically apart made us feel closer."

Smitha Papolu Nova Wehman-Brown Melissa Schmidt Adam Menter

Theme 3 Discussion

January 8, 2024

Sarah Flamion

"Marketers don’t try very interesting things when their confidence in data is low, which can create a downward spiraling reinforcing loop."

Sarah Flamion

Complex Problem? Add Clarity by Combining Research and Systems Thinking

March 31, 2020

Marjorie Stainback

"In a team of two supporting 35 researchers, we planned a roadmap to focus on a few ops pillars at a time."

Marjorie Stainback Molly Fargotstein Stephanie Marsh

What Research Ops Professionals Have Learned from COVID-19

July 16, 2020

Louis Rosenfeld

"We want you to take all AI-generated info with a grain of salt but it gets you part of the way."

Louis Rosenfeld Peter Van Dijck

GenAI for UXers: A Rosenbot Demo and Discussion

September 11, 2025

Jerome “Axle” Brown

"Combining synchronous and asynchronous communication within one session gets us from awareness to action."

Jerome “Axle” Brown

How to Use Self-Directed Learning to Ensure Your Research Insights are Heard and Acted Upon

March 11, 2021