Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

AI of the now: Designing for Agents
Wednesday, July 31, 2024 • Rosenfeld Community

This video is featured in the AI and UX playlist.

Share the love for this talk
AI of the now: Designing for Agents
Speakers: Christopher Noessel
Link:

Summary

AI agents are on the rise: people are talking about them, getting excited, and putting infrastructure into place to support them. You may be asked to design agents soon—or you may want to think through your product as an agent in order to get a leg up on your competition. What’s different about designing for agents? Are you ready? Rosenfeld author Christopher Noessel published Designing Agentive Technology back in 2017, and it seems like the world is just now catching up. Join Chris as he recaps the core ideas from that book, how agents have evolved since publication, and what it all might mean since the explosion of generative AI. Takeaways include… What is an agent? How do agents differ and complement other modes of interaction? Why are people getting excited about it now? What does generative AI bring to the agentive table?

Key Insights

  • An agent is defined as any entity with the ability to take actions and choose among them on behalf of a principal.

  • Agents differ from assistants mainly in user attention: agents act autonomously often outside user awareness, while assistants engage the user actively.

  • Designing agentive technology involves 27 unique use cases including setup, monitoring, alerts, handoff, and disengagement.

  • There are four modes of agency in systems: manual (user does all work), assistant (user mostly involved), agentive (AI does most work), and automation (AI fully handles).

  • Agentive systems do work outside the user’s attention, enabling an order of magnitude more tasks done for users than traditional interfaces.

  • AI agentic backends orchestrated by large language models solve limitations like hallucinations by delegating subtasks to specialized agents.

  • De-skilling and overreliance on AI agents present major risks, requiring new design patterns called cognitive forcing functions to maintain human skills.

  • Ethical concerns include hidden biases, corporate interests influencing agent decisions, and users being unaware of these agentic influences.

  • The rise of agents presents huge business opportunities because they provide value continuously without demanding active user attention.

  • UX designers must adapt to AI agent workflows and advocate for human-centered design to avoid being cut out of AI product development processes.

Notable Quotes

"An agent is anything that displays agency—the ability to take actions and choose which actions to take."

"An assistant is helping you do the task with your attention on it, whereas an agent does its work out of your attention."

"We are dealing with AI systems that are sophisticated enough to do the majority of the work for people."

"The AI parses a complicated request, makes a plan, and orchestrates which specialized agents handle the steps."

"Agents do their work outside of the user's attention, which means they can operate at a vastly larger scale than traditional products."

"Every time we hand a task over to a system, we slowly lose the ability to do it ourselves. That is de-skilling."

"Corporations are nefarious about inserting their self-interest into algorithms, and agentic systems risk hiding those interests more deeply."

"The future of design roles will shift as agents handle tedious tasks, freeing humans to focus on challenging problems."

"AI is one of the most interesting and complicated technologies that humanity has ever created, and it desperately needs design."

"We cannot just say ‘fast thinkers, you’re now baristas.’ Society needs to address how AI will affect different cognitive styles."

Ask the Rosenbot
Carl Turner
You Can Do This: Understand and Solve Organizational Problems to Jumpstart a Dead Project
2023 • Advancing Research 2023
Gold
Candace Myers
Standardizing Design at Scale
2022 • DesignOps Summit 2022
Gold
Matt Duignan
HITS, Microsoft's internal human insight system: From research library to living body of knowledge (Videoconference)
2019 • Advancing Research Community
Sam Proulx
Understanding Screen Readers on Mobile: How And Why to Learn from Native Users
2023 • Advancing Research 2023
Gold
Dane DeSutter
Keeping the Body in Mind: What Gestures and Embodied Actions Tell You That Users May Not
2024 • Advancing Research 2024
Gold
Kit Unger
Theme 2: Introduction
2021 • Design at Scale 2021
Gold
Malini Rao
Lessons Learned from a 4-year Product Re-platforming Journey
2021 • Design at Scale 2021
Gold
Christopher Geison
Theme 1 Intro
2024 • Advancing Research 2024
Gold
Susan Weinschenk
Evaluating the Maturity of UX in Your Organization (Videoconference)
2020 • Enterprise Community
Kate Kalcevich
Designing inclusively with AI
2024 • Designing with AI 2024
Gold
Joanna Vodopivec
One Research Team for All - Influence Without Authority
2022 • Advancing Research 2022
Gold
Robin Beers
How to create actionable insight in the face of politics and silos [Advancing Research Community Workshop Series] (Videoconference)
2023 • Advancing Research Community
Carla Casariego
DesignOps in Wonderland
2019 • DesignOps Summit 2019
Gold
Louis Rosenfeld
Opening Remarks
2023 • Advancing Research 2023
Gold
Chloe Amos-Edkins
A Cultural Approach: Research in the Context of Glocalisation
2023 • Advancing Research 2023
Gold
Greg Petroff
Design is the Differentiator: Bringing New Design Innovations to a Very Antiquated and Very Large Industry
2021 • Design at Scale 2021
Gold

More Videos

Adam Cutler

"If designers spend more time talking about titles than their work, we’re just gazing into our navels."

Adam Cutler Karen Pascoe Ian Swinson Susan Worthman

Discussion

June 8, 2016

Peter Merholz

"Playing politics in UX leadership is about maximizing relationships ethically to advance your agenda, not about being underhanded."

Peter Merholz

The Trials and Tribulations of Directors of UX (Videoconference)

July 13, 2023

Lisa Welchman

"Digital is a system, not a project. It’s there all the time and you have to keep iterating on it."

Lisa Welchman

Cleaning Up Our Mess: Digital Governance for Designers

June 14, 2018

Vincent Brathwaite

"The solutions are out there; we just need the will to implement them."

Vincent Brathwaite

Opener: Past, Present, and Future—Closing the Racial Divide in Design Teams

October 22, 2020

Brenna Fallon

"If you forget the individual, you cut out psychological safety, and that’s the foundation of strong teams."

Brenna Fallon

Learning Over Outcomes

October 24, 2019

Tricia Wang

"Treat identities as elastic, not as fixed personas, because people’s needs and roles are complex and changing."

Tricia Wang

Spatial Collapse: Designing for Emergent Culture

January 8, 2024

Edgar Anzaldua Moreno

"Research should be done the same way products are built, with stakeholders as your users."

Edgar Anzaldua Moreno

Using Research to Determine Unique Value Proposition

March 11, 2021

"The toy shouldn’t be the goal of play, but a tool or a process that unlocks the unlimited possibilities set forth before a child."

Designing Systems at Scale

November 7, 2018

Erin Weigel

"Ethics evolve faster than law; just because something is legal doesn’t mean it’s ethical."

Erin Weigel

Get Your Whole Team Testing to Design for Impact

July 24, 2024