Rosenverse
Why AI projects fail (and what we can do about it)

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Why AI projects fail (and what we can do about it)

Wednesday, May 14, 2025 • Rosenfeld Community
Share the love for this talk
Why AI projects fail (and what we can do about it)
Speakers: Dan Saffer
Link:

Summary

Most AI projects fail. Somewhere between 50-90% of them, which is double the rate of more traditional tech projects. This Rosenverse Session will draw on years of Carnegie Mellon HCII research to dive into the five traps that AI projects can fall into, and then talk about what designers and project managers can do to avoid those traps. Including one startling finding: user-centered design alone isn’t enough.

Key Insights

  • •

    Most AI projects fail due to choosing the wrong problems rather than poor execution.

  • •

    The AI innovation gap occurs because data scientists focus on technically hard but low-value problems.

  • •

    User-centered design alone often identifies problems unsuitable for AI solutions.

  • •

    AI works best for low-risk, moderate accuracy (~90%), narrow tasks like spam filtering or smart text suggestions.

  • •

    Executives push AI fast to avoid falling behind, risking deployments without clear user or business value.

  • •

    Consequences scanning is a vital method to detect and mitigate ethical risks before AI product launch.

  • •

    Matchmaking AI capabilities with real user needs and organizational goals increases project success.

  • •

    Agents add new AI capabilities to sense, think, and act, requiring adapted design processes.

  • •

    AI lacks context, aesthetic taste, and common sense—designers must provide these to create effective AI products.

  • •

    There is currently little corporate or legal accountability for AI ethics; responsibility largely falls to product teams.

Notable Quotes

"Welcome to the AI party, we've got 10 years of research to share."

"Executives said it's better to go fast and fail than to go slow and succeed."

"AI can be magical, but it's also just not that smart."

"Don Norman was named the top accomplished woman in UX by AI, even though Don is a man."

"Companies hunt for AI innovation in technically challenging areas instead of simpler, more valuable places."

"Most AI fails because projects require near perfect accuracy, which AI can't reliably deliver."

"The traditional user-centered design process doesn't work well for AI problems."

"Matchmaking connects AI capabilities to user needs so you find the low hanging fruit projects."

"AI struggles with context, taste, and common sense, and designers bring that to the table."

"Consequences scanning helps detect unintended harms and risks before launching AI features."

Ask the Rosenbot
Jaime Creixems
Best Practices when Creating and Maintaining a Design System
2023 • Enterprise UX 2023
Gold
Christian Crumlish
The Pygmalion Effect: In Which a Vibe Coding Experiment Becomes a Million Lines…
2025 • Rosenfeld Community
Peter Merholz
The Mysterious Case of the Missing UX Career Path
2022 • DesignOps Community
Tamara Kartoziia
Think global, adapt local: how service design accelerated B2B market entry by 6 months
2025 • Advancing Service Design 2025
Gold
Smitha Papolu
Theme 3 Discussion
2024 • Enterprise Experience 2020
Gold
Erika Flowers
Introduction to MURAL for UX
2021 • Design at Scale 2021
Gold
Christian Crumlish
Afternoon Insights Panel
2022 • Design in Product 2022
Gold
Michelle Morrison
Practice What You Preach
2024 • DesignOps Summit 2020
Gold
Sheryl Cababa
Expanding Your Design Lens with Systems Thinking
2023 • Enterprise Community
Dan Willis
Enterprise Storytelling Sessions
2015 • Enterprise UX 2015
Gold
Lisa Spitz
Building Trust Through Equitable Research Practices
2022 • Civic Design 2022
Gold
Sam Proulx
Accessibility: An Opportunity to Innovate
2022 • Design at Scale 2022
Gold
Silke Bochat
5 Antifragile Strategies for a DesignOps 2.0
2024 • DesignOps Summit 2024
Gold
Alla Weinberg
Design Teams Need Psychological Safety: Here’s How to Create It
2022 • DesignOps Summit 2022
Gold
James Wieselman Schulman
Research is a team sport: advancing the work when everyone does the research
2026 • Advancing Research 2026
Gold
Kavana Ramesh
Meaningful inclusion: Practicing accessibility research with confidence
2024 • DesignOps Summit 2024
Gold

More Videos

Frances Yllana

"I was obnoxiously proud in my 20s, humbled and service-driven in my 30s."

Frances Yllana Ann Buechner Jess Jones Betsy Ramaccia

D.E.A.R.R. Diaries (Discipline, Experience, Architecture, Reflection + Revolution)

November 16, 2022

Bria Alexander

"You’re going to get the importance of empathy to the bottom line."

Bria Alexander

Theme Two Intro

September 8, 2022

Dr. Jamika D. Burge

"Algorithms that adjust care based on race don’t actually help and embed disparities instead."

Dr. Jamika D. Burge

Broad Strokes: Connecting Design, Research, and AI to the World Around Us

June 7, 2023

Joshua Graves

"The amygdala acts as the brain’s smoke detector, smashing a button when it senses anything unsafe."

Joshua Graves

We Need To Talk: Navigating Conversations with Your Boss (Part 1 of 3)

April 14, 2025

Lavrans Løvlie

"The proof of service design’s effectiveness is now out there in the growing diversity of case studies and practitioner voices."

Lavrans Løvlie Ben Reason

Ask me anything – Authors of Service Design: From Insight to Implementation

November 19, 2025

Rebecca Buck

"With all this influx into UX research, many still struggle to find their footing and feel underutilized."

Rebecca Buck

Mission: Keep Talent in Research Roles!

March 10, 2021

Sarah Williams

"Customer experience refers to the holistic picture of the customer relationship, not just interaction with a single digital channel."

Sarah Williams

Verizon_A Framework for CX Transformation

January 8, 2024

Bria Alexander

"Please keep your questions within the speaker’s thread so we don’t lose track of them in the busy chat."

Bria Alexander

Opening Remarks

September 9, 2022

Joanna Vodopivec

"Partnering with market researchers allowed us to ask specific product questions within their long-running exit survey."

Joanna Vodopivec Prabhas Pokharel

One Research Team for All - Influence Without Authority

March 9, 2022