Sentient Scenes and Radically Adaptive Experiences
This video is featured in the AI and UX playlist and 2 more.
Summary
Sentient Scenes is a little toy with big lessons—an intelligent interface that changes style, mood, and behavior on demand. The project explores what it means to treat AI as a design material, weaving open-ended intelligence into interfaces beyond chat. We’ll share lessons in both technique and perspective for how the designer’s role evolves—from crafting visuals to sketching prompts—and what it takes to craft systems where machine intelligence mediates the user experience.
Key Insights
-
•
AI can be treated as a design material with unique strengths and weaknesses rather than just a productivity tool.
-
•
Radically adaptive experiences adapt style, mood, behavior, and layout dynamically in response to user context and intent.
-
•
Open-ended AI interfaces must operate within constraints to maintain cohesion and avoid 'robot fever dreams'.
-
•
Large language models excel more at parsing user intent than merely providing factual answers.
-
•
The prompt itself becomes a hybrid artifact acting as design spec, requirement doc, and programming language.
-
•
Designers’ roles evolve into defining the interaction sandbox and parameters for AI-user collaboration rather than specifying every UI detail.
-
•
Personality and presence in AI interfaces can be achieved without pretending to be human, using animation and interaction cues.
-
•
Bespoke UI assembles and rearranges interface elements in real time to fit user needs, reducing complexity in workflows.
-
•
AI can enhance accessibility by tailoring font, color, and interaction styles to users’ abilities on demand.
-
•
Sentient Scenes took less than a day to build due to using plain language prompts, highlighting opportunities for rapid, imaginative prototyping.
Notable Quotes
"AI is not just a tool for productivity or efficiency; it's a design material with unusual strengths and weaknesses."
"Sentient Scenes doesn’t just talk about the scene, it becomes the scene, adapting continuously to user input."
"We wanted to create personality in interfaces without pretending they are human."
"Radically adaptive experiences are conceived and compiled in real time, responding to context and intent."
"The big design activity here is sketching prompts, guiding how the AI should behave rather than drawing UI."
"The prompt becomes part design spec, part requirement doc, and part programming language."
"Large language models are far better at figuring out what you mean than simply giving an answer."
"With bespoke UI, you don’t present every single path to the user; you let the right tool appear immediately for the job."
"AI can transform accessibility by changing experiences to meet user needs in the moment."
"This isn’t about Skynet; it’s about simple signals of awareness that adapt to immediate context."
Or choose a question:
More Videos
"Auto captions on YouTube struggle with accents and technical terms, so manual or human-reviewed captioning is essential for accuracy."
Sheri Byrne-HaberThe Importance of Accessible Design Systems
January 8, 2024
"We used AI tools like NotebookLM and Gemini primarily to shortcut getting up to speed and managing transcripts, without focusing on specific tools themselves."
Mujtaba HameedThe new horizon of ethnography: using AI to unlock the full potential of in-person research
March 11, 2026
"Good design needs better PR and the government has to be actively involved in the process."
Sofía Delsordo Kassim VeraPublic Policy for Jalisco's Designers to Make Design Matter
December 8, 2021
"Everything is designed around us; recognize that and use it to your advantage."
Dave Hoffer Joanne WeaverUX Job Search AMA #2 with Joanne Weaver and Dave Hoffer
April 3, 2025
"Soft skills often are a multiplier on your hard skills—they’re just as valuable, if not more so."
Liam ThurstonWhy Your Design Team Is Quitting, And How To Fix It
June 10, 2022
"We need to let go of perfectionism and favor efficiency when using AI in product work."
Shipra Kayan Robert Kortenoeven Eileen TangEmerging principles for using AI in Design: What the product design team at Miro has learned from deeply integrating AI in their workflow
June 11, 2025
"Service design has a critical role in mapping human and agent interactions in an AI and automation world."
Dharani PereraThe mandala of service design: unlocking alignment and action through service design
November 20, 2025
"A middle review step prevents hallucinations from making it into the production site."
Jorge Arango[Demo] How to re-categorize content at scale using LLMs
June 5, 2024
"The alternative to good design isn’t no design, it’s bad design."
Audrey CraneShadow Design–Where Else is Design Happening in Your Organization?
April 20, 2023
Latest Books All books
Dig deeper with the Rosenbot
How can personal energy assessments and understanding control help in managing work stress and growth?
How does including metadata like methodology, market, and date improve the quality of research repository search results?
What is the C-FRE framework and how does it relate to play in the workplace?