Sentient Scenes and Radically Adaptive Experiences
This video is featured in the AI and UX playlist and 2 more.
Summary
Key Insights
-
•
AI can be treated as a design material with unique strengths and weaknesses rather than just a productivity tool.
-
•
Radically adaptive experiences adapt style, mood, behavior, and layout dynamically in response to user context and intent.
-
•
Open-ended AI interfaces must operate within constraints to maintain cohesion and avoid 'robot fever dreams'.
-
•
Large language models excel more at parsing user intent than merely providing factual answers.
-
•
The prompt itself becomes a hybrid artifact acting as design spec, requirement doc, and programming language.
-
•
Designers’ roles evolve into defining the interaction sandbox and parameters for AI-user collaboration rather than specifying every UI detail.
-
•
Personality and presence in AI interfaces can be achieved without pretending to be human, using animation and interaction cues.
-
•
Bespoke UI assembles and rearranges interface elements in real time to fit user needs, reducing complexity in workflows.
-
•
AI can enhance accessibility by tailoring font, color, and interaction styles to users’ abilities on demand.
-
•
Sentient Scenes took less than a day to build due to using plain language prompts, highlighting opportunities for rapid, imaginative prototyping.
Notable Quotes
"AI is not just a tool for productivity or efficiency; it's a design material with unusual strengths and weaknesses."
"Sentient Scenes doesn’t just talk about the scene, it becomes the scene, adapting continuously to user input."
"We wanted to create personality in interfaces without pretending they are human."
"Radically adaptive experiences are conceived and compiled in real time, responding to context and intent."
"The big design activity here is sketching prompts, guiding how the AI should behave rather than drawing UI."
"The prompt becomes part design spec, part requirement doc, and part programming language."
"Large language models are far better at figuring out what you mean than simply giving an answer."
"With bespoke UI, you don’t present every single path to the user; you let the right tool appear immediately for the job."
"AI can transform accessibility by changing experiences to meet user needs in the moment."
"This isn’t about Skynet; it’s about simple signals of awareness that adapt to immediate context."
Or choose a question:
More Videos
"For every single component, we start with its purpose and emergent need to ground design in user experience."
Dave Malouf Amy ThibodeauPanel: Design Systems and Documentation
November 7, 2017
"One of the most important questions before starting is what tools do I have to work with."
John DonmoyerShipping your code generation experiments to production
June 11, 2025
"Novice users can try things out thanks to automation, but experts can focus on the challenging and creative pieces."
Clara Kliman-SilverUX Futures: The Role of Artificial Intelligence in Design
June 7, 2023
"Every person in a company has a customer, whether internal or external, and should focus on the experience they deliver."
Mark TempletonCreating a Legacy: the ultimate experience
June 9, 2017
"Artifacts of the future help us envision and grasp the change that we’re hoping to have—it’s not just bullet points or vision statements."
Sarah GallimoreInspire Progress with Artifacts from the Future
November 18, 2022
"Aim to work with at least one person on each platform your product supports, because assistive tech varies."
Sam ProulxPrototype Reviews, People With Disabilities, and You
December 8, 2021
"If you have a sense of ownership in the work, you naturally feel more engaged with the outcome and output."
Anna Nguyen Emily BroganWhy Our Voice of the Customer is Better Than Yours
March 10, 2022
"Stakeholder interviews are our way of doing research on our stakeholders to understand what keeps them up at night."
Anna Poznyakov Richa PrajapatiGet The Most Out Of Stakeholder Collaboration—and Maximize Your Research Impact
March 12, 2021
"Research run rampant — anyone feeling empowered to do research can sometimes cause quality challenges."
Nalini P. KotamrajuTwo Jobs in One: Being a “Leader who is a Researcher” and a “Researcher who is a Leader"
March 10, 2021