Rosenverse

Redefining Toolkits: Unbundling to Create a Perfect Match

Gold
Tuesday, March 11, 2025 • Advancing Research 2025
Share the love for this talk
Redefining Toolkits: Unbundling to Create a Perfect Match
Speakers: Benjamin Wiedmaier and Annie Mayfield
Link:

Summary

"Redefining the Research Toolkit" not only applies to methods, but tools, too. The marketplace for research platforms continues growing and evolving, offerings professionals the opportunity to find a nearly perfect research match.
This means that more teams are opting to "unbundle" their research stack, choosing best-in-class options for critical phases instead of an all-in-one. This session has two goals:

1) Highlight some of the of tools researchers are prioritizing for their stacks
2) Present a case study of a best-in-class stack in action

Join to learn about the freedom of choice researchers have for their toolkits and some of the best-in-class options available.

Key Insights

  • •

    All-in-one research platforms average $100,000 per year and may not flexibly adapt as research needs evolve.

  • •

    BYO toolkits enable teams to select best-in-class tools tailored to their specific research methods and questions.

  • •

    User Interviews specializes in upstream participant recruitment, maintaining an exceptionally low fraud rate of 0.3%.

  • •

    AI-driven participant matching improves recruitment quality and reduces panel churn in User Interviews’ platform.

  • •

    Calendly uses a BYO stack combining Sprig for in-app surveys and User Interviews for recruiting to address diverse research needs.

  • •

    Flexibility in tool choice allows teams with limited headcount and budgets to scale research effectively.

  • •

    BYO stacks support democratizing research by enabling controlled access for non-researchers like PMs and designers.

  • •

    User Interviews offers direct integrations and flexible API partnerships, plus options to use any tool via URL links.

  • •

    Effective fraud detection combines automated monitoring with researcher-controlled flags to maintain data integrity.

  • •

    Focusing on a core strength—in this case, participant recruitment—and partnering with specialized tools leads to more effective research workflows.

Notable Quotes

"Budgets are tight across research, design, and product; all-in-one platforms are costly and often don’t fit those budgets."

"When you get a best in class tool, you are able to execute more rigorous research and show clearer ROI."

"We found a greater variety and depth of questions that require richer methodologies, so BYO works better for us."

"Our fraudulent participant rate is about 0.3%, compared to the industry average of 20 to 22%."

"We built AI that suggests projects to participants that pre-match what you’re asking for instead of mass blasting everyone."

"The world is your oyster with whatever tool you want to use, even if we don’t directly integrate with it."

"The only way to do research wrong is to not do it at all."

"BYO gives researchers more control over who gets access to the panel and where you want guardrails versus freedom."

"My time is more expensive than my money; fraudulent data wastes valuable time."

"We focus on getting top quality participants and let others specialize in testing or analysis tools."

Ask the Rosenbot
Sam Proulx
Designing For Screen Readers: Understanding the Mental Models and Techniques of Real Users
2021 • DesignOps Summit 2021
Gold
Billy Carlson
Ideation tips for Product Managers
2022 • Design in Product 2022
Gold
Lisa Gironda
Opener: Chief of Staff–An unexpected journey
2024 • DesignOps Summit 2020
Gold
Jay Bustamante
Navigating the Ethical Frontier: DesignOps Strategies for Responsible AI Innovation
2023 • DesignOps Summit 2023
Gold
Kate Towsey
Shaping the future of research ops: Expanding roles and strategies for a more integrated research ecosystem
2025 • Advancing Research 2025
Gold
Gina Mendolia
Coordinated collaboration: a Service Design & DesignOps love story
2025 • Advancing Service Design 2025
Gold
Michal Anne Rogondino
Saving Outer Space: The First UX Design System for Our Nation’s Satellites
2024 • Enterprise Experience 2020
Gold
Megan Blocker
Positioning insight: Structuring teams, roles and careers for a changing research landscape
2025 • Advancing Research 2025
Gold
Laine Riley Prokay
Carving a Path for Early Career DesignOps Practitioners
2022 • DesignOps Summit 2022
Gold
Taiye Akin-Akinyosoye
Amplifying voices and enhancing user research through group interviews
2025 • Advancing Research 2025
Gold
Yasmine Khan
Checking Bias and Listening to Financially Vulnerable Americans
2020 • Advancing Research 2020
Gold
Jennifer Fraser
What would Emmy Noether Do? Math, Models and Mulling in UX Research
2023 • Advancing Research 2023
Gold
Sarah Fathallah
Beyond insights: Rethinking the role of researchers as stewards of organizational wisdom
2025 • Advancing Research 2025
Gold
Andreas Huebner
What Is It Like To Be Part of The UX Team at Compass?
2021 • Advancing Research 2021
Gold
Kathleen Asjes
Research Democratization: the Good, the Bad and the Ugly
2022 • Advancing Research 2022
Gold
Chris Hammond
Embedding sustainability into enterprise design and development: A journey towards "sustainability consciousness"
2025 • Climate UX Interest Group

More Videos

Jon Fukuda

"Different ops functions have different incentives; aligning those incentives could make leaps and bounds in collaboration."

Jon Fukuda Jake Burghardt Jose Coronado Natalie Dunbar Denise Tilles

All the Ops: Successful cross-functional collaboration

September 10, 2025

Alana Washington

"One theme was very clear and that was around the future."

Alana Washington

Theme 3 Intro

October 1, 2021

Andrew Michael

"At Hotcho, we started with a qualitative focus, swung too far into quantitative, and then found a balanced middle ground."

Andrew Michael

Building a Product Insights Team

March 10, 2022

Nalini P. Kotamraju

"I don’t exactly even know who I am if not a researcher."

Nalini P. Kotamraju

Two Jobs in One: Being a “Leader who is a Researcher” and a “Researcher who is a Leader"

March 10, 2021

Prayag Narula

"Companies have started building their own base camps, but these feel more exclusionary compared to grassroots ones."

Prayag Narula Rida Qadri

HCI 2.0: Humanity Deserves the Attention that UX Research has to Offer

March 28, 2023

Yunyan Li

"Building trust in the user is fundamental, especially in digital products like our doggy daycare app example."

Yunyan Li Anna Le Jen Kim

UX Best Practices

June 11, 2021

Shipra Kayan

"VOC wasn’t a replacement for user research, but an enhancer that captured nuggets researchers might miss during discovery."

Shipra Kayan

How we Built a VoC (Voice of the Customer) Practice at Upwork from the Ground Up

September 30, 2021

Dorelle Rabinowitz

"People outside of your design organization are making design decisions; they are also designers."

Dorelle Rabinowitz

The Magic Word is Trust

June 15, 2018

Sarah Brooks

"We want to hear what resonates most in your hearts and minds."

Sarah Brooks

Theme 3 Intro

December 10, 2021