Rosenverse

Why AI Is Bad at Research (and how to make it actually useful)

Gold
Tuesday, March 10, 2026 • Advancing Research 2026
Share the love for this talk
Why AI Is Bad at Research (and how to make it actually useful)
Speakers: Daniel Korczynski
Link:

Summary

LLMs are everywhere, but when it comes to real research, they often fall short. Generic LLMs weren’t built for continuous research workflows, and product researchers quickly see the problem: the outputs are generic, lack full context, and struggle to connect multiple data sources. Instead of surfacing meaningful insights, they can amplify noise.

In this session, Daniel will break down why AI often fails research teams and what’s missing. He’ll show how to make AI actually useful for continuous product research.

Accelerating analysis, connecting insights across sources, and keeping researchers at the center, equipped with a powerful tool rather than replaced by one.

Key Insights

  • •

    AI in research struggles with large datasets, often averaging results and missing subtle but important signals.

  • •

    Curating and filtering datasets by removing irrelevant data improves AI research output quality.

  • •

    Scoping research into focused projects or topics helps AI deliver more precise responses.

  • •

    Asking one question at a time significantly enhances the quality of AI-generated answers.

  • •

    Providing detailed contextual information (personas, company background, product details) to AI boosts specificity and nuance in responses.

  • •

    AI hallucinations and trust issues necessitate human-in-the-loop processes to verify output quality and citations.

  • •

    Iterative refinement of AI outputs, similar to app development, is critical for achieving polished research results.

  • •

    Spot checking AI-generated citations can be an effective and efficient way to validate research quality.

  • •

    Context passed as embedded knowledge rather than repeated in prompts yields better AI results.

  • •

    Using multiple specialized AI agents to critique each other’s outputs can mitigate bias and improve research accuracy.

Notable Quotes

"AI has this strange weakness that when working with a large dataset, they often miss crucial, subtle findings."

"The larger the dataset you work with, the more costly it is to run a single operation on AI models."

"Whenever possible, you should be breaking down your work into specific research projects or topics."

"When you ask a question, try to ask one at a time so the model doesn't get lost."

"Context is everything — providing AI with a folder of your company’s knowledge makes responses more detailed and useful."

"Research with AI requires as much iteration and verification as building an app or prototype."

"AI-generated research reports should always be tied to real feedback that you can verify behind every sentence."

"There's no way to deny it: every industry needs to adapt to AI, but nobody really knows how yet."

"Human in the loop means constantly interacting with AI, documenting your thoughts and assuring quality."

"Some engineers build a council of agents that debate and generate responses, which can help with bias and accuracy."

Ask the Rosenbot
Kristin Skinner
Opening Keynote: Org Design for Design Orgs
2017 • DesignOps Summit 2017
Gold
Phil Hesketh
Designing Accessible Research Workflows
2021 • DesignOps Summit 2021
Gold
Bria Alexander
OKRs—Helpful or Harmful?
2022 • DesignOps Community
Jack Moffett
UX Metrics That Matter and The Future of our Design at Scale Conference: A Community Conversation
2022 • Enterprise Community
Christian Rohrer
Research Operations at Scale
2017 • DesignOps Summit 2017
Gold
Jennifer Fraser
What would Emmy Noether Do? Math, Models and Mulling in UX Research
2023 • Advancing Research 2023
Gold
Patrizia Bertini
DesignOps + KPIs = Measure your Impact!
2024 • DesignOps Summit 2020
Gold
Taylor Jennings
Research Debate Club
2026 • Advancing Research 2026
Gold
Samuel Proulx
Designing for Disability, Innovating for Everyone
2025 • Advancing Research 2025
Gold
Steve Turbek
Designing Interactive Graphics with AI Code Help
2026 • Rosenfeld Community
Robin Beers
Navigating organizational systems: Rethinking researcher’s role in driving change
2025 • Advancing Research 2025
Gold
James Wieselman Schulman
Research is a team sport: advancing the work when everyone does the research
2026 • Advancing Research 2026
Gold
Dave Malouf
Theme 3: Introduction and Provocation
2024 • DesignOps Summit 2020
Gold
Benjamin Real
Maturity Models: A Core Tool for Creating a DesignOps Strategy
2021 • DesignOps Summit 2021
Gold
Bria Alexander
Opening Remarks
2021 • DesignOps Summit 2021
Gold
Michelle Chin
The DesignOps Starter Kit
2021 • DesignOps Summit 2021
Gold

More Videos

Dave Malouf

"We have do’s and don’ts, but approaching it from a rules-based perspective just reduces buy-in."

Dave Malouf Amy Thibodeau

Panel: Design Systems and Documentation

November 7, 2017

John Donmoyer

"Throwing away old methods for something new can unlock skills you didn’t know you had."

John Donmoyer

Shipping your code generation experiments to production

June 11, 2025

Clara Kliman-Silver

"Novice users can try things out thanks to automation, but experts can focus on the challenging and creative pieces."

Clara Kliman-Silver

UX Futures: The Role of Artificial Intelligence in Design

June 7, 2023

Mark Templeton

"The post-PC era has had more impact on enterprise UX and computing than any other factor in all history."

Mark Templeton

Creating a Legacy: the ultimate experience

June 9, 2017

Sarah Gallimore

"Artifacts of the future help us envision and grasp the change that we’re hoping to have—it’s not just bullet points or vision statements."

Sarah Gallimore

Inspire Progress with Artifacts from the Future

November 18, 2022

Sam Proulx

"You may need to operate the prototype on behalf of users whose assistive tech can’t click or interact with clickable prototypes."

Sam Proulx

Prototype Reviews, People With Disabilities, and You

December 8, 2021

Anna Nguyen

"The ultimate goal is that feedback leads to actual actions, whether quick wins or longer strategic roadmap changes."

Anna Nguyen Emily Brogan

Why Our Voice of the Customer is Better Than Yours

March 10, 2022

Anna Poznyakov

"Unmoderated tools can achieve 100% completion rates and rapid insights if designed thoughtfully."

Anna Poznyakov Richa Prajapati

Get The Most Out Of Stakeholder Collaboration—and Maximize Your Research Impact

March 12, 2021

Nalini P. Kotamraju

"Sometimes being a leader means making decisions that feel like high stakes gambling with incomplete data."

Nalini P. Kotamraju

Two Jobs in One: Being a “Leader who is a Researcher” and a “Researcher who is a Leader"

March 10, 2021