Rosenverse

Why AI Is Bad at Research (and how to make it actually useful)

Gold
Tuesday, March 10, 2026 • Advancing Research 2026
Share the love for this talk
Why AI Is Bad at Research (and how to make it actually useful)
Speakers: Daniel Korczynski
Link:

Summary

LLMs are everywhere, but when it comes to real research, they often fall short. Generic LLMs weren’t built for continuous research workflows, and product researchers quickly see the problem: the outputs are generic, lack full context, and struggle to connect multiple data sources. Instead of surfacing meaningful insights, they can amplify noise. In this session, Daniel will break down why AI often fails research teams and what’s missing. He’ll show how to make AI actually useful for continuous product research. Accelerating analysis, connecting insights across sources, and keeping researchers at the center, equipped with a powerful tool rather than replaced by one.

Key Insights

  • AI in research struggles with large datasets, often averaging results and missing subtle but important signals.

  • Curating and filtering datasets by removing irrelevant data improves AI research output quality.

  • Scoping research into focused projects or topics helps AI deliver more precise responses.

  • Asking one question at a time significantly enhances the quality of AI-generated answers.

  • Providing detailed contextual information (personas, company background, product details) to AI boosts specificity and nuance in responses.

  • AI hallucinations and trust issues necessitate human-in-the-loop processes to verify output quality and citations.

  • Iterative refinement of AI outputs, similar to app development, is critical for achieving polished research results.

  • Spot checking AI-generated citations can be an effective and efficient way to validate research quality.

  • Context passed as embedded knowledge rather than repeated in prompts yields better AI results.

  • Using multiple specialized AI agents to critique each other’s outputs can mitigate bias and improve research accuracy.

Notable Quotes

"AI has this strange weakness that when working with a large dataset, they often miss crucial, subtle findings."

"The larger the dataset you work with, the more costly it is to run a single operation on AI models."

"Whenever possible, you should be breaking down your work into specific research projects or topics."

"When you ask a question, try to ask one at a time so the model doesn't get lost."

"Context is everything — providing AI with a folder of your company’s knowledge makes responses more detailed and useful."

"Research with AI requires as much iteration and verification as building an app or prototype."

"AI-generated research reports should always be tied to real feedback that you can verify behind every sentence."

"There's no way to deny it: every industry needs to adapt to AI, but nobody really knows how yet."

"Human in the loop means constantly interacting with AI, documenting your thoughts and assuring quality."

"Some engineers build a council of agents that debate and generate responses, which can help with bias and accuracy."

Ask the Rosenbot
Sam Proulx
Accessibility: An Opportunity to Innovate
2022 • DesignOps Summit 2022
Gold
Alla Weinberg
Design Teams Need Psychological Safety: Here’s How to Create It
2022 • DesignOps Summit 2022
Gold
Magdalena Zadara
Zero Hour: How to Get Far Quickly When Starting Your Digital Service Unit Late
2022 • Civic Design 2022
Gold
Louis Rosenfeld
Coffee with Lou
2024 • Rosenfeld Community
Bria Alexander
Opening Remarks
2022 • Civic Design 2022
Gold
Amy Paris
Delivering Equity: Government Services for All Ages, Languages, Sexual Orientations, and Gender Identities
2021 • Civic Design 2021
Gold
Christian Crumlish
Introduction by our Conference Chair
2022 • Design in Product 2022
Gold
Jon White
Unsticking Research for Better Information Flow
2026 • Advancing Research 2026
Gold
Sarah Coyle
Design and Analytics with Sarah Coyle
2020 • DesignOps Community
Kristin Skinner
Theme 2: Introduction and Provocation
2024 • DesignOps Summit 2020
Gold
Kevin M. Hoffman
Theme 2: Enterprise Team Journey
2019 • Enterprise Experience 2019
Gold
Sarah Brooks
Theme Three Intro
2022 • Civic Design 2022
Gold
Leisa Reichelt
Opening Keynote: Operating in Context
2018 • DesignOps Summit 2018
Gold
Yasmine Khan
Checking Bias and Listening to Financially Vulnerable Americans
2020 • Advancing Research 2020
Gold
Tracy McGoldrick
IBM User Experience Program—The What, Why and How
2021 • Advancing Research Community
Brianna Sylver
Lead With Purpose
2020 • Advancing Research 2020
Gold

More Videos

Uday Gajendar

"Designing at scale means handling millions of users and dozens of geographies with all their unique challenges."

Uday Gajendar

Theme 1: Introduction

June 9, 2021

Megan Blocker

"When the ground shifts beneath us, we get to decide, do we scramble to regain our footing exactly where we stood before? Or do we take a step in a new direction, explore new terrain, and expand the boundaries of what’s possible?"

Megan Blocker

Theme 2 Intro

March 12, 2025

Tina Weisser

"We must design who is in the loop and who is in the lead. The responsibility can’t be handed over to AI."

Tina Weisser

When AI Agents Meet Reality. Service Design Lessons from a Pilot

February 26, 2026

John Calhoun

"DPM loneliness and siloing happen because of wearing too many hats and inheriting mismatched responsibilities."

John Calhoun Rachel Posman

Two Sides of the DesignOps Coin: Teams Ops and Product Ops

January 8, 2024

Michal Anne Rogondino

"Nearly 30 years into my career, I’m doing the most rewarding work of my life helping modernize military space systems."

Michal Anne Rogondino

Saving Outer Space: The First UX Design System for Our Nation’s Satellites

January 8, 2024

Onur Kocan

"Current projects mostly focus on collecting complaints rather than understanding the state."

Onur Kocan Ayhan Ensici

Understanding the Strategy for Civic Design in a Complex City: Istanbul

November 16, 2022

Llewyn Paine

"If we are haphazard about AI adoption and trust marketers over rigorous testing, it looks like all our hand wringing about research accuracy was just gatekeeping."

Llewyn Paine

Coexisting with AI: A practical guide for researchers to navigate tools, ethics, and integration

March 11, 2025

Sheryl Cababa

"Today's problems come from yesterday's solutions."

Sheryl Cababa

Expanding Your Design Lens with Systems Thinking

February 23, 2023

Marisa Bernstein

"Build your pool, build your practice. If you provide a great testing experience, you’ve got another person to add to your group."

Marisa Bernstein

It Takes GRIT: Lessons from the Small, but Mighty World of Civic Usability Testing

December 9, 2021