Rosenverse

Anatomy of a Strong User Panel

Gold
Tuesday, March 10, 2026 • Advancing Research 2026
Share the love for this talk
Anatomy of a Strong User Panel
Speakers: Sydney Lawson
Link:

Summary

User panels are one of the fastest ways to connect with your audience and extract valuable insights—when done right.

In this session, Sydney Lawson, Senior Product Marketing Manager at Rally, dives deep into real user panels—tearing them up, not down—to uncover what top research teams are doing well and what’s worth stealing for your own panel. From sign-up to participation, she’ll break down what makes panels effective and how to optimize every step of the experience.

Key Insights

  • •

    Every successful user panel has a dedicated landing page with a clear call to action and explanation of participation benefits.

  • •

    Keeping screener questions between five to ten helps maintain low friction and improves sign-up rates.

  • •

    Using single-select, closed-ended questions for job functions avoids messy and unusable data compared to open-text fields.

  • •

    Including questions about AI usage and interest helps target relevant participants for specialized research.

  • •

    Large companies like Google can afford more extensive screener forms with conditional logic due to their broad user base and resource availability.

  • •

    Separate FAQ pages linked from the landing page reduce clutter and provide potential panelists with detailed sign-up information.

  • •

    Panel engagement improves when participants see study results and understand how their feedback influences product decisions.

  • •

    Creative incentive models like digital badges (from Outsystems) can gamify participation when budgets for monetary rewards are limited.

  • •

    Including fake tools or options in screening questions (Genesys example) helps identify and filter out insincere panelists motivated only by incentives.

  • •

    Tracking participant location enables compliance with regional incentive regulations and data privacy laws.

Notable Quotes

"Every single one of these companies has a landing page on their marketing website with a call to action to sign up."

"The most successful way to ask about job function is a single-select question, not an open field."

"We love to see questions around AI and even asking if participants want to join AI studies specifically."

"Incentives are a benefit but should not be the number one reason people join a panel."

"Google’s sign-up has a progress bar which is really helpful so participants know how far they are along."

"If you ask accessibility questions, it’s so important to actually respect the answers."

"Outsystems gamified their research panel with badges because they didn’t have budget for monetary incentives."

"Genesys includes a fake tool in the software list to stop incentive-driven participants from checking all boxes."

"You want your panel to be representative of your customer base, not exactly all your customers."

"Sharing the results of studies with panelists gets them excited about contributing and keeps them engaged."

Ask the Rosenbot
Lily Aduana
5 Reasons to Bring Your Recruiting in-House (and How To Do It)
2021 • Advancing Research 2021
Gold
Kim Fellman Cohen
Measuring the Designer Experience
2019 • DesignOps Summit 2019
Gold
Nathan Shedroff
Redefining Value: Bridging the Innovation Culture Divide
2015 • Enterprise UX 2015
Gold
Liz Ebengo
The Burden on Children: The Cost of Insufficient Post-Conflict Services and Pathways Forward
2024 • Advancing Service Design 2024
Gold
Peter Van Dijck
Building impactful AI products for design and product leaders, Part 3: Understand AI architectures: RAG, Agents, Oh My!
2025 • Rosenfeld Community
David Sternberg
Uncovering the hidden forces shaping user behavior
2025 • Rosenfeld Community
Bria Alexander
Reflect and Chart Forward
2021 • Civic Design 2021
Gold
Abbey Smalley
Scaling UX Past the Size of Your Team
2024 • Enterprise Experience 2020
Gold
Joerg Beringer
Scaling User Research with AI: Continuous Discovery of User Needs in Minutes
2025 • Designing with AI 2025
Gold
John Taschek
Making People the X-Factor in the Enterprise
2018 • Enterprise Experience 2018
Gold
Steve Portigal
Discussion
2015 • Enterprise UX 2015
Gold
Scher Foord
Turn the Ship Around: How to Apply Design Thinking Across Your Organization
2021 • Design at Scale 2021
Gold
Jackie Ho
Lead Effectively While Preserving Team Autonomy with Growth Boards
2024 • Enterprise Experience 2020
Gold
Briana Thomas
The Quiet Force: Uncovering Hidden Leadership in High-Impact Design Teams
2024 • DesignOps Summit 2024
Gold
Kate Towsey
Shaping the future of research ops: Expanding roles and strategies for a more integrated research ecosystem
2025 • Advancing Research 2025
Gold
Tutti Taygerly
Make Space to Lead
2021 • Design at Scale 2021
Gold

More Videos

Jon Fukuda

"If you don’t operationalize content early, you end up with last minute crunches breaking the design."

Jon Fukuda Jake Burghardt Jose Coronado Natalie Dunbar Denise Tilles

All the Ops: Successful cross-functional collaboration

September 10, 2025

Alana Washington

"Sponsor sessions support the theme and allow you to play around with awesome tools."

Alana Washington

Theme 3 Intro

October 1, 2021

Andrew Michael

"At Hotcho, we started with a qualitative focus, swung too far into quantitative, and then found a balanced middle ground."

Andrew Michael

Building a Product Insights Team

March 10, 2022

Nalini P. Kotamraju

"Leadership is a mode, not a title, and anyone can be a leader."

Nalini P. Kotamraju

Two Jobs in One: Being a “Leader who is a Researcher” and a “Researcher who is a Leader"

March 10, 2021

Prayag Narula

"It's important not to be a parachute researcher who just jumps in, asks questions, and jumps out without impact."

Prayag Narula Rida Qadri

HCI 2.0: Humanity Deserves the Attention that UX Research has to Offer

March 28, 2023

Yunyan Li

"Post-implementation reviews help catch bugs or style issues before customers see them, maintaining high quality."

Yunyan Li Anna Le Jen Kim

UX Best Practices

June 11, 2021

Shipra Kayan

"We stuck with NPS because it was a pure metric with a long history we could trend, instead of muddying things with loyalty or revenue."

Shipra Kayan

How we Built a VoC (Voice of the Customer) Practice at Upwork from the Ground Up

September 30, 2021

Dorelle Rabinowitz

"Just because they have a different opinion doesn’t mean they’re bad people."

Dorelle Rabinowitz

The Magic Word is Trust

June 15, 2018

Sarah Brooks

"There are values that have really stood out to us together: evolving, relational, decolonized, life centered, healing, equitable."

Sarah Brooks

Theme 3 Intro

December 10, 2021