Designing AI-first products on top of a rapidly evolving technology
This video is featured in the AI and UX playlist.
Summary
This talk addresses the distinct challenges of designing AI-first products when the foundational technology is advancing at an unprecedented pace. We will discuss the practical implications of this rapid evolution on the design process and share our insights into creating effective user experiences in such a dynamic environment.
Key Insights
-
•
AI models evolve faster than previous tech revolutions, requiring adaptive product development.
-
•
Effective AI products use evals—automated tests on real data—to continuously measure quality.
-
•
Retrieval augmented generation and tool use are practical architectural tricks to reduce AI hallucination.
-
•
AI experiences must account for user trust despite AI’s confident but sometimes inaccurate outputs.
-
•
Human factors like worker anxiety about job security are critical to address in AI adoption.
-
•
Cross-disciplinary teams are essential in AI design due to the space’s novelty and uncertainty.
-
•
Prompt engineering skills grow best through extensive real use rather than frozen techniques.
-
•
Planning AI products with expectations of improved capabilities 6-9 months ahead optimizes outcomes.
-
•
Cultural acceptance of AI use inside organizations must be actively encouraged to avoid user hiding.
-
•
User testing of AI products still requires old-school observation combined with analytics and evals.
Notable Quotes
"You can’t have good AI without good information architecture."
"Everything’s changing really quickly—if you don’t revise your plan in a few months, you’re building for a world that’s already outdated."
"Hallucinations are when AI makes up stuff—it's a fundamental property of these models."
"Retrieval augmented generation is just adding results from a search into the model’s context to make it more grounded."
"Agents are models using tools in the loop, calling normal software functions as part of their process."
"People tend to trust AI a lot because it seems very confident—even when it’s not always accurate."
"Workers are often worried about layoffs and their value when AI speeds up their process, while executives like the efficiency gains."
"You should get good at prompt engineering by using AI a lot, not by memorizing outdated tricks."
"Building evals is like building tests to know if your AI system is good enough, and you can rerun them as models improve."
"User testing for AI still means watching people use it, plus collecting analytics and running evaluations."
Or choose a question:
More Videos
"Mergers and acquisitions require us to carefully avoid pitfalls when unifying user experiences."
Uday GajendarTheme 1: Introduction
June 9, 2021
"I want you to push yourselves to try one new approach, to challenge one of your assumptions, and to walk away ready to take an action."
Megan BlockerTheme 2 Intro
March 12, 2025
"Information is power in organizations, so deploying AI agents means reconsidering who gets access to what data."
Tina WeisserWhen AI Agents Meet Reality. Service Design Lessons from a Pilot
February 26, 2026
"Design ops is always swinging wildly between priorities, making partners wonder why invest if you’re always going this way or that."
John Calhoun Rachel PosmanTwo Sides of the DesignOps Coin: Teams Ops and Product Ops
January 8, 2024
"This poor young airman is not entering into a super cool sci-fi command center but using apps built by their grandparents."
Michal Anne RogondinoSaving Outer Space: The First UX Design System for Our Nation’s Satellites
January 8, 2024
"Testing and implementation processes require sustainable, acceptable approaches using prototype iterations and user feedback."
Onur Kocan Ayhan EnsiciUnderstanding the Strategy for Civic Design in a Complex City: Istanbul
November 16, 2022
"If we want our value to be defined as anything other than studies run, we must learn how to trace and articulate the actual business impact."
Llewyn PaineCoexisting with AI: A practical guide for researchers to navigate tools, ethics, and integration
March 11, 2025
"Designers need to be facilitators of other people's expertise and knowledge, not just creators of designed things."
Sheryl CababaExpanding Your Design Lens with Systems Thinking
February 23, 2023
"Technology that includes everyone, especially those from vulnerable populations, ensures that what gets built will work for everyone."
Marisa BernsteinIt Takes GRIT: Lessons from the Small, but Mighty World of Civic Usability Testing
December 9, 2021
Latest Books All books
Dig deeper with the Rosenbot
How can play help overcome the ‘messy middle’ between research insights and decision-making in organizations?
How does Rally’s research infrastructure facilitate participant management and integration with enterprise data systems?
How does Rosenfeld Media ensure high quality and relevance across its Rosenverse offerings?