Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Optimizing AI Conversations: A Case Study on Personalized Shopping Assistance Frameworks

Gold
Tuesday, June 10, 2025 • Designing with AI 2025

This video is featured in the Designing with AI 2025 playlist.

Share the love for this talk
Optimizing AI Conversations: A Case Study on Personalized Shopping Assistance Frameworks
Speakers: Kritika Yadav
Link:

Summary

The Challenge Users engaging with the AI shopping assistant often felt constrained by limited options, excessive follow-up questions, and a lack of personalization. These shortcomings led to user fatigue, misunderstandings, and a subpar shopping experience. Insights from user research (UXR) and transcripts revealed that users wanted more intuitive, human-like interactions that catered to their unique needs. The Solution A robust, adaptable framework was designed to transform AI conversations into sales-like consultations. By breaking user queries into three core components—use-case, constraints, and preferences—the framework enabled the bot to understand intent and deliver relevant, personalized results. Key enhancements included: Allowing users to skip questions and navigate freely. Providing contextual help for technical queries. Transitioning to open-ended interactions after gathering essential details to prevent over-questioning. Displaying diverse and curated results aligned with user preferences.

Key Insights

  • Traditional conversational AI severely limits visual bandwidth compared to traditional e-commerce interfaces, hindering effective product exploration.

  • The catalog exploration paradox highlights the tension between rich visual browsing and conversational limitations in AI assistants.

  • The expectation gap occurs when AI fails to understand cultural or contextual nuances, eroding user trust and satisfaction.

  • User queries vary widely in specificity; treating all queries the same is a missed opportunity in AI design.

  • Structuring user queries into use case, constraints, and preferences enables AI to perform intelligent reasoning like a skilled salesperson.

  • Carefully crafted prompt design, rather than large-scale fine tuning, can effectively guide LLM reasoning for better conversational AI.

  • Adaptive questioning avoids unnecessary or repetitive queries, improving user experience and reducing frustration.

  • Designing conversational AI as reasoning systems rather than linear scripted flows fundamentally improves interaction quality.

  • A multidisciplinary team combining design, data, and engineering perspectives was crucial to solving this AI conversation challenge.

  • Shifting from seeing AI as a task execution tool to a trusted, empathetic guide changes user perception and engagement positively.

Notable Quotes

"We are designing how the assistant is trying to reason, moving from scripting responses to orchestrating the AI's cognitive process."

"It's not just about fixing the chatbot, it's about bridging the gap between user expectations and actual experiences."

"LLMs don't just match keywords or labels. They infer meaning, extract subtle nuances, and understand intent behind words."

"The catalog exploration paradox shows how current conversational AI restricts browsing and comparison, creating uncertainty."

"Users frequently felt overwhelmed and misunderstood; this was a significant barrier to a positive shopping experience."

"What if we actively taught the model how to break down and analyze queries like a skilled salesperson would?"

"The AI assistant starts with reasoning and not results, engaging users in intelligent conversation to understand needs."

"Don't design for a response, design for reasoning. Teach AI to think critically, analyze information, and arrive at logical conclusions."

"The assistant asks open-ended questions that focus on what truly matters: performance, budget, and preferences."

"We saw a 2.5 times increase in active monthly users and a 1.5 times increase in purchases attributed to the AI assistant."

Ask the Rosenbot
Laura Gatewood
Beyond Buzzwords: Adding Heart to Effective Slack Communication
2024 • DesignOps Summit 2024
Gold
Sam Proulx
Accessibility: An Opportunity to Innovate
2022 • Design at Scale 2022
Gold
Sam Yen
Driving Organizational Change Through Design? Do more of this and less of that
2017 • Enterprise Experience 2017
Gold
Ariel Kennan
Theme 2 Intro
2021 • Civic Design 2021
Gold
Alla Weinberg
Healing Toxic Stress
2024 • DesignOps Summit 2024
Gold
Daniel J. Rosenberg
Designing with and for Artificial Intelligence
2022 • Enterprise Community
Uday Gajendar
The Rise of Meta-Design: A Starter Playbook
2022 • Enterprise Community
Dan Mall
“Ask Me Anything” with Dan Mall, Author of Upcoming Rosenfeld Title, Design that Scales
2023 • DesignOps Summit 2023
Gold
Dane DeSutter
Keeping the Body in Mind: What Gestures and Embodied Actions Tell You That Users May Not
2024 • Advancing Research 2024
Gold
Chris Geison
What is Research Strategy?
2021 • Advancing Research 2021
Gold
Uday Gajendar
10 Years of Enterprise UX: Reflecting on the community and the practice
2025 • Enterprise Community
Ned Dwyer
The Intersection of Design and ResearchOps
2024 • DesignOps Summit 2024
Gold
Joerg Beringer
Scaling User Research with AI: Continuous Discovery of User Needs in Minutes
2025 • DesignOps Summit 2025
Gold
Catherine Dubut
Bridging Physical and Digital Spaces: Approaches to Retail Service Design
2021 • Enterprise Community
Natalia Radywyl
Co-Designing New Power in Australia's Public Sector
2022 • Civic Design 2022
Gold
Doug Powell
Closing Keynote: Design at Scale
2018 • DesignOps Summit 2018
Gold

More Videos

Uday Gajendar

"We collaborate and iteratively build out these presentations as part of a continuing conversation."

Uday Gajendar

Theme 1: Introduction

June 9, 2021

Megan Blocker

"We need to transform our role as connectors between people, disciplines, and ideas that together make our work richer and more impactful."

Megan Blocker

Theme 2 Intro

March 12, 2025

Tina Weisser

"The chaos of undocumented processes makes it hard to build useful AI workflows; mapping and blueprinting help."

Tina Weisser

When AI Agents Meet Reality. Service Design Lessons from a Pilot

February 26, 2026

John Calhoun

"Imagine your current design ops team is like a coin and every time you flip it, it comes up heads, but coins have two sides."

John Calhoun Rachel Posman

Two Sides of the DesignOps Coin: Teams Ops and Product Ops

January 8, 2024

Michal Anne Rogondino

"Military contractors didn’t have design teams; most had never invested in UX design before."

Michal Anne Rogondino

Saving Outer Space: The First UX Design System for Our Nation’s Satellites

January 8, 2024

Onur Kocan

"Current projects mostly focus on collecting complaints rather than understanding the state."

Onur Kocan Ayhan Ensici

Understanding the Strategy for Civic Design in a Complex City: Istanbul

November 16, 2022

Llewyn Paine

"Volume is a losing game because we cannot outcompete full AI automation for sheer speed and quantity of insights."

Llewyn Paine

Coexisting with AI: A practical guide for researchers to navigate tools, ethics, and integration

March 11, 2025

Sheryl Cababa

"Today's problems come from yesterday's solutions."

Sheryl Cababa

Expanding Your Design Lens with Systems Thinking

February 23, 2023

Marisa Bernstein

"Compensation is so important to thank people for their time, and you will definitely build your recruitment pool much faster if you offer it."

Marisa Bernstein

It Takes GRIT: Lessons from the Small, but Mighty World of Civic Usability Testing

December 9, 2021