Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Sentient Design: New Postures for AI-Mediated Experiences (2nd of 3 seminars)
Wednesday, January 29, 2025 • Rosenfeld Community
Share the love for this talk
Sentient Design: New Postures for AI-Mediated Experiences (2nd of 3 seminars)
Speakers: Josh Clark and Veronika Kindred
Link:

Summary

How do you get your head around all the different machine-intelligent experiences available to you as a designer? What are the new design patterns, and which old ones fall away? How do you name and organize those experiences? And how do you develop an intuition for how and when to use each interaction paradigm? Watch Josh Clark and Veronika Kindred, authors of our forthcoming book Sentient Design, explore the emerging diversity of AI-mediated experiences. Just as the natural world demonstrates intelligence in many forms, the same is true for machine intelligence. New “species” of interfaces roam our screens, the manner of each tailored to purpose and environment—copilots, agents, chatbots, assistants, tools, adaptive interfaces, and many more. Sentient Design offers a framework for exploring and organizing these new experience patterns, or “postures”—the way each kind of experience positions itself in relation to the user. More than just distinct functionality, each posture has its own interaction style, manner of communication, and expectations that it sets. Josh and Veronika share over a dozen of these postures, from familiar options like dedicated tools to more exotic patterns including sculptors, bespoke UI, non-player characters, and data whisperers. Get a map for exploring these postures to expand both your perspective and your toolkit as a designer.

Key Insights

  • Sentient design treats AI as a new design material, enabling interfaces with real-time contextual awareness and adaptivity.

  • Josh and Veronica frame intelligent interfaces across three dimensions: grounded (reliable), interoperable (cross-system), and radically adaptive (dynamic).

  • There are four AI postures relative to users: tools (controlled input/output), sculptors (iterative conversational content creation), assistants (knowledgeable collaborative peers), and agents (autonomous task executors).

  • The sentient triangle framework helps designers categorize AI experiences and explore trade-offs between reliability, adaptability, and interoperability.

  • Inline AI tools like Notion’s contextual menus enhance user workflows by integrating assistance seamlessly into the user’s context.

  • Chat-based AI (sculptors and characters) often prioritize creativity and exploration over strict factual accuracy, functioning as partners in imagination rather than objective tools.

  • Bespoke UIs, like Google Gemini's adaptive interfaces, generate custom UI components on-the-fly to better suit user intent beyond static chat interfaces.

  • Radically adaptive agents, like Siri’s envisioned conductors or Adept AI, struggle with brittle and complex workflows, revealing deficiencies in current UX and APIs.

  • Embracing AI’s inherent weirdness and occasional unpredictability can unlock creative and experiential value instead of merely striving for hyper-accuracy.

  • Sentient design demands designers become more sentient themselves—mindful of risks, social impacts, and the complexities of infinite adaptability.

Notable Quotes

"What happens when you weave intelligence into digital interfaces is really what sentient design is about."

"Instead of thinking of AI as a maker of stuff, think of it as an enabler of experiences."

"Sentient designs are collaborative, active, and proactive partners in a journey."

"Tools do what they say they’re gonna do; they’re very controlled and predictable."

"Inline tools stay in the user's context the whole time and are invisible when you don’t need them."

"Sculptors digitally chisel machine generated content like clay, iterating until you get exactly what you want."

"Radically adaptive interfaces react in the moment and follow the user’s lead like improvisation."

"Agents work on their own; you delegate tasks and they plan, execute, and decide when they’re done."

"The map is not the territory; these categories are fluid and overlapping right now."

"Instead of fighting AI’s essential weirdness, what can we do if we embrace it as an asset?"

Ask the Rosenbot
David Conrad
The Feeling of Data (Videoconference)
2023 • Enterprise Community
Yunyan Li
UX Best Practices
2021 • Design at Scale 2021
Gold
Sam Proulx
Mobile Accessibility: Why Moving Accessibility Beyond the Desktop is Critical in a Mobile-first World
2022 • Advancing Research 2022
Gold
Xenia Adjoubei
Empowering Communities Through the Researcher in Residence Program
2023 • Advancing Research 2023
Gold
Maria Skaaden
Panel Discussion: Methodologies and Work Environments
2018 • DesignOps Summit 2018
Gold
Sam Proulx
Online Shopping: Designing an Accessible Experience
2023 • Enterprise UX 2023
Gold
Mackenzie Guinon
M.C. Escher’s UX Research Career Ladder
2022 • Advancing Research 2022
Gold
Bria Alexander
Opening Remarks Day 2
2024 • Advancing Research 2024
Gold
Gabrielle Verderber
Documentation Your Team Will Actually Use
2023 • DesignOps Summit 2023
Gold
Cheryl Platz
Collaborative Creativity through Improv
2018 • DesignOps Summit 2018
Gold
Jack Behar
How to Build Prototypes that Behave like an End-Product
2022 • Design in Product 2022
Gold
Sofia Quintero
The Product Philosophy Behind EnjoyHQ
2021 • Advancing Research 2021
Gold
Greg Petroff
Design is the Differentiator: Bringing New Design Innovations to a Very Antiquated and Very Large Industry
2021 • Design at Scale 2021
Gold
Jayne Engle
Civic Design for the Next Seven Generations—A Discussion on Sacred Civics (Videoconference)
2022 • Civic Design Community
Megan Campos
What Did I Miss? The Hidden Costs of Deprioritizing Diversity in User Research
2021 • Advancing Research 2021
Gold
Justin Entzminger
Risk and Reward: How to Diversify the Field of Civic Innovators and Designers
2022 • Civic Design 2022
Gold

More Videos

Alex Hurworth

"Each species lost is a thread untethered from the web of life that supports us all."

Alex Hurworth Bonnie John Fahd Arshad Antoine Marin

Designing a Contact Tracing App for Universal Access

October 23, 2020

Laine Riley Prokay

"Building connections early in their career could create even more opportunities further along their career path."

Laine Riley Prokay Lisa Gordon

Carving a Path for Early Career DesignOps Practitioners

September 9, 2022

Eniola Oluwole

"Launching a design system is not a sprint, there’s no end, it’s always a continuous process."

Eniola Oluwole

Lessons From the DesignOps Journey of the World's Largest Travel Site

October 24, 2019

Nathan Shedroff

"Living personas refreshed constantly with new research allow others to connect with real customer behaviors."

Nathan Shedroff

Double Your Mileage: Use Your Research Strategically

March 31, 2020

Sam Proulx

"Mobile browsers are typically updated with the OS, reducing variability compared to desktop browser versions."

Sam Proulx

Mobile Accessibility: Why Moving Accessibility Beyond the Desktop is Critical in a Mobile-first World

November 17, 2022

Feleesha Sterling

"Documentation and making findings visible even without a dedicated research librarian helps maintain program momentum."

Feleesha Sterling

Building a Rapid Research Program (Videoconference)

May 18, 2023

Neil Barrie

"We are at an inflection point where what got us here won't get us to a thriving future."

Neil Barrie

Widening the Aperture: The Case for Taking a Broader Lens to the Dialogue between Products and Culture

March 25, 2024

John Devanney

"A well framed project is a rare thing — it’s also a creative exercise that unleashes teams’ possibilities."

John Devanney

The Design Management Office

November 6, 2017

Katy Mogal

"Surveys and logs tell us what users do, but qualitative tells us why."

Katy Mogal

But Do Your Insights Scale?

March 12, 2021