Rosenverse

Redefining Toolkits: Unbundling to Create a Perfect Match

Gold
Tuesday, March 11, 2025 • Advancing Research 2025
Share the love for this talk
Redefining Toolkits: Unbundling to Create a Perfect Match
Speakers: Benjamin Wiedmaier and Annie Mayfield
Link:

Summary

"Redefining the Research Toolkit" not only applies to methods, but tools, too. The marketplace for research platforms continues growing and evolving, offerings professionals the opportunity to find a nearly perfect research match. This means that more teams are opting to "unbundle" their research stack, choosing best-in-class options for critical phases instead of an all-in-one. This session has two goals: 1) Highlight some of the of tools researchers are prioritizing for their stacks 2) Present a case study of a best-in-class stack in action Join to learn about the freedom of choice researchers have for their toolkits and some of the best-in-class options available.

Key Insights

  • All-in-one research platforms average $100,000 per year and may not flexibly adapt as research needs evolve.

  • BYO toolkits enable teams to select best-in-class tools tailored to their specific research methods and questions.

  • User Interviews specializes in upstream participant recruitment, maintaining an exceptionally low fraud rate of 0.3%.

  • AI-driven participant matching improves recruitment quality and reduces panel churn in User Interviews’ platform.

  • Calendly uses a BYO stack combining Sprig for in-app surveys and User Interviews for recruiting to address diverse research needs.

  • Flexibility in tool choice allows teams with limited headcount and budgets to scale research effectively.

  • BYO stacks support democratizing research by enabling controlled access for non-researchers like PMs and designers.

  • User Interviews offers direct integrations and flexible API partnerships, plus options to use any tool via URL links.

  • Effective fraud detection combines automated monitoring with researcher-controlled flags to maintain data integrity.

  • Focusing on a core strength—in this case, participant recruitment—and partnering with specialized tools leads to more effective research workflows.

Notable Quotes

"Budgets are tight across research, design, and product; all-in-one platforms are costly and often don’t fit those budgets."

"When you get a best in class tool, you are able to execute more rigorous research and show clearer ROI."

"We found a greater variety and depth of questions that require richer methodologies, so BYO works better for us."

"Our fraudulent participant rate is about 0.3%, compared to the industry average of 20 to 22%."

"We built AI that suggests projects to participants that pre-match what you’re asking for instead of mass blasting everyone."

"The world is your oyster with whatever tool you want to use, even if we don’t directly integrate with it."

"The only way to do research wrong is to not do it at all."

"BYO gives researchers more control over who gets access to the panel and where you want guardrails versus freedom."

"My time is more expensive than my money; fraudulent data wastes valuable time."

"We focus on getting top quality participants and let others specialize in testing or analysis tools."

Ask the Rosenbot
Malini Rao
Lessons Learned from a 4-year Product Re-platforming Journey
2021 • Design at Scale 2021
Gold
Ned Dwyer
The Future of DesignOps is Tool Consolidation
2024 • DesignOps Summit 2024
Gold
Jorge Arango
Design as an Antidote to VUCA
2019 • Enterprise Community
Matt Webb
Context Window: Five Futures for AI
2025 • Designing with AI 2025
Gold
Nick Cochran
Growing in Enterprise Design through Making Connections
2019 • Enterprise Community
Lily Aduana
5 Reasons to Bring Your Recruiting in-House (and How To Do It)
2021 • Advancing Research 2021
Gold
Megan Blocker
Day 2 Theme Panel
2025 • Advancing Research 2025
Gold
Stephanie Wade
Building and Sustaining Design in Government
2021 • Civic Design 2021
Gold
Emily Danielson
“I mean, I can lift a shovel”: Design Skills in Disaster Response
2022 • Design at Scale 2022
Gold
Heidi Trost
When AI Becomes the User’s Point Person—and Point of Failure
2025 • Rosenfeld Community
Michael Land
Establishing Design Operations in Government
2021 • DesignOps Community
Erin Malone
Understanding the past to prepare for the future
2024 • Rosenfeld Community
Kyria Stephens
Power to Heal: Civic Design in the Aftermath of Tragedy
2022 • Civic Design 2022
Gold
Dan Willis
Enterprise Storytelling Sessions
2017 • Enterprise Experience 2017
Gold
Christian Bason
Innovating With People: Unleashing the Potential of Civic Design
2021 • Civic Design 2021
Gold
Prabhas Pokharel
Order and Chaos: New Ways of Collaborating on Synthesis and Storytelling
2022 • Advancing Research 2022
Gold

More Videos

Sheri Byrne-Haber

"Employees are now suing employers for inaccessible tools, with million-dollar verdicts even in conservative courts."

Sheri Byrne-Haber

The Importance of Accessible Design Systems

January 8, 2024

Mujtaba Hameed

"It often feels like research becomes beholden to exact quotes rather than the richer story that context provides, what I call the tyranny of transcripts."

Mujtaba Hameed

The new horizon of ethnography: using AI to unlock the full potential of in-person research

March 11, 2026

Sofía Delsordo

"Pat Helisco funds projects that have social impact and provides designers space to exhibit and connect with stakeholders."

Sofía Delsordo Kassim Vera

Public Policy for Jalisco's Designers to Make Design Matter

December 8, 2021

Dave Hoffer

"Launching and shipping things is a big deal and shows real impact beyond metrics."

Dave Hoffer Joanne Weaver

UX Job Search AMA #2 with Joanne Weaver and Dave Hoffer

April 3, 2025

Liam Thurston

"Our skills matrix became the center of gravity for our practice—it started writing job descriptions and guiding recruitment."

Liam Thurston

Why Your Design Team Is Quitting, And How To Fix It

June 10, 2022

Shipra Kayan

"Visual communication is still really important—it's always better to show rather than tell."

Shipra Kayan Robert Kortenoeven Eileen Tang

Emerging principles for using AI in Design: What the product design team at Miro has learned from deeply integrating AI in their workflow

June 11, 2025

Dharani Perera

"Service design has a critical role in mapping human and agent interactions in an AI and automation world."

Dharani Perera

The mandala of service design: unlocking alignment and action through service design

November 20, 2025

Jorge Arango

"Use clear and obvious terms in taxonomies—unusual acronyms won’t make sense to GPT or others."

Jorge Arango

[Demo] How to re-categorize content at scale using LLMs

June 5, 2024

Audrey Crane

"It’s not naive to want metrics, but the ROI conversation is often code for fear and resistance to change."

Audrey Crane

Shadow Design–Where Else is Design Happening in Your Organization?

April 20, 2023