Rosenverse

Redefining Toolkits: Unbundling to Create a Perfect Match

Gold
Tuesday, March 11, 2025 • Advancing Research 2025
Share the love for this talk
Redefining Toolkits: Unbundling to Create a Perfect Match
Speakers: Benjamin Wiedmaier and Annie Mayfield
Link:

Summary

"Redefining the Research Toolkit" not only applies to methods, but tools, too. The marketplace for research platforms continues growing and evolving, offerings professionals the opportunity to find a nearly perfect research match. This means that more teams are opting to "unbundle" their research stack, choosing best-in-class options for critical phases instead of an all-in-one. This session has two goals: 1) Highlight some of the of tools researchers are prioritizing for their stacks 2) Present a case study of a best-in-class stack in action Join to learn about the freedom of choice researchers have for their toolkits and some of the best-in-class options available.

Key Insights

  • •

    All-in-one research platforms average $100,000 per year and may not flexibly adapt as research needs evolve.

  • •

    BYO toolkits enable teams to select best-in-class tools tailored to their specific research methods and questions.

  • •

    User Interviews specializes in upstream participant recruitment, maintaining an exceptionally low fraud rate of 0.3%.

  • •

    AI-driven participant matching improves recruitment quality and reduces panel churn in User Interviews’ platform.

  • •

    Calendly uses a BYO stack combining Sprig for in-app surveys and User Interviews for recruiting to address diverse research needs.

  • •

    Flexibility in tool choice allows teams with limited headcount and budgets to scale research effectively.

  • •

    BYO stacks support democratizing research by enabling controlled access for non-researchers like PMs and designers.

  • •

    User Interviews offers direct integrations and flexible API partnerships, plus options to use any tool via URL links.

  • •

    Effective fraud detection combines automated monitoring with researcher-controlled flags to maintain data integrity.

  • •

    Focusing on a core strength—in this case, participant recruitment—and partnering with specialized tools leads to more effective research workflows.

Notable Quotes

"Budgets are tight across research, design, and product; all-in-one platforms are costly and often don’t fit those budgets."

"When you get a best in class tool, you are able to execute more rigorous research and show clearer ROI."

"We found a greater variety and depth of questions that require richer methodologies, so BYO works better for us."

"Our fraudulent participant rate is about 0.3%, compared to the industry average of 20 to 22%."

"We built AI that suggests projects to participants that pre-match what you’re asking for instead of mass blasting everyone."

"The world is your oyster with whatever tool you want to use, even if we don’t directly integrate with it."

"The only way to do research wrong is to not do it at all."

"BYO gives researchers more control over who gets access to the panel and where you want guardrails versus freedom."

"My time is more expensive than my money; fraudulent data wastes valuable time."

"We focus on getting top quality participants and let others specialize in testing or analysis tools."

Ask the Rosenbot
Dave Hora
A Research Skills Evolution
2021 • Advancing Research 2021
Gold
Victor Udoewa
Theme One Intro
2023 • Advancing Research 2023
Gold
Satyam Kantamneni
Do You Have an Experience Vision?
2023 • Enterprise Community
Chris Geison
Theme Two Intro
2023 • Advancing Research 2023
Gold
Hugh Dubberly
Problems with Problems: Reconsidering the Frame of Designing as Problem-Solving
2019 • Enterprise Community
Rebecca Topps
Planning and conducting remote usability studies for accessibility
2020 • Advancing Research Community
Louis Rosenfeld
Becoming a Civic Designer: Making the Move from Private to Public Sector
2022 • Civic Design 2022
Gold
Ben Reason
Making the system visible: The fastest path to better decisions
2025 • Advancing Service Design 2025
Gold
Amy Brana Stuart
Rest in Peace Fly-in-fly-out Design
2022 • Design at Scale 2022
Gold
Fredrik Matheson
First-time users, longtime strategies: Why Parkinson’s Law is making you less effective at work – and how to design a fix.
2016 • Enterprise UX 2016
Gold
Matt Duignan
HITS, Microsoft's internal human insight system: From research library to living body of knowledge
2019 • Advancing Research Community
Amy Marquez
INVEST: Discussion
2018 • Enterprise Experience 2018
Gold
Jackie Ho
Lead Effectively While Preserving Team Autonomy with Growth Boards
2024 • Enterprise Experience 2020
Gold
Lisanne Norman
Why I Left Research
2023 • Advancing Research 2023
Gold
Jose Coronado
From Zero to Hero
2022 • DesignOps Summit 2022
Gold
Jason Mesut
Unmasking Design Leadership: Navigating leadership without neglecting ourselves
2025 • Rosenfeld Community

More Videos

Frances Yllana

"Government might expand its self-perception from service provider to facilitator who partners with constituents."

Frances Yllana Ann Buechner Jess Jones Betsy Ramaccia

D.E.A.R.R. Diaries (Discipline, Experience, Architecture, Reflection + Revolution)

November 16, 2022

Bria Alexander

"I simply cannot wait for you all to see the outstanding presentations they prepared."

Bria Alexander

Theme Two Intro

September 8, 2022

Dr. Jamika D. Burge

"Policy like the California Privacy Rights Act requires us to explain data use and comply with user deletion requests."

Dr. Jamika D. Burge

Broad Strokes: Connecting Design, Research, and AI to the World Around Us

June 7, 2023

Joshua Graves

"Anger doesn’t mean you have to yell—it’s about speaking clearly to the problem you see."

Joshua Graves

We Need To Talk: Navigating Conversations with Your Boss (Part 1 of 3)

April 14, 2025

Lavrans Løvlie

"Customer journeys used to be specialist knowledge, but now they’re a normalized, even commodified, organizational artifact."

Lavrans Løvlie Ben Reason

Ask me anything – Authors of Service Design: From Insight to Implementation

November 19, 2025

Rebecca Buck

"I love that clients don’t actually care what I call myself as long as I’m helping them achieve great outcomes."

Rebecca Buck

Mission: Keep Talent in Research Roles!

March 10, 2021

Sarah Williams

"Language, language, language—using familiar company terms helped teams feel comfortable adopting and practicing the experience principles."

Sarah Williams

Verizon_A Framework for CX Transformation

January 8, 2024

Bria Alexander

"Respect and kindness are mandatory; please read our code of conduct to ensure a positive community experience."

Bria Alexander

Opening Remarks

September 9, 2022

Joanna Vodopivec

"Bringing stakeholders into the kitchen early helped us learn even before sessions started and adjust designs accordingly."

Joanna Vodopivec Prabhas Pokharel

One Research Team for All - Influence Without Authority

March 9, 2022