Log in or create a free Rosenverse account to watch this video.
Log in Create free account100s of community videos are available to free members. Conference talks are generally available to Gold members.
When AI Agents Meet Reality. Service Design Lessons from a Pilot
Summary
Why does the introduction of AI agents so often lead to confusion instead of clarity? Drawing on an applied pilot project on Human-Agent Teams, this session shares key learnings from integrating AI agents into everyday work. The focus is not on the technology itself, but on structure. How roles shift. Where decisions get stuck. How trust is shaped or undermined. And why teams struggle even when the system technically works. The session shows how Service Design helped make these dynamics visible and manageable. Not as a creativity method, but as a way to design clear responsibility, decision paths, and collaboration between humans and agents. Presentation and discussion.
Key Insights
-
•
Agentic AI represents a shift from AI as a tool to AI as autonomous collaborators that run background workflows.
-
•
Many organizations have AI agents built, but a large gap remains in making them truly helpful and valuable.
-
•
Service design methods like process blueprints and human-in-the-loop approaches are key to designing effective AI-human workflows.
-
•
Building AI agents quickly is easy, but identifying where they add value requires deep problem understanding and organizational context.
-
•
Chaos in undocumented or inconsistent workflows complicates designing useful AI workflows.
-
•
Trust and responsibility must remain human-led with clear definitions of when and how humans intervene in AI processes.
-
•
Organizational power dynamics around information sharing critically impact the effectiveness of AI agent deployment.
-
•
Iterative quality feedback loops where AI agents improve based on continuous human input are vital for success.
-
•
Co-creative, multidisciplinary engagement including non-technical stakeholders increases adoption and reduces resistance to AI.
-
•
AI literacy at all organizational levels is necessary; leaders must engage with AI to properly support teams using it.
Notable Quotes
"Before for me, AI was just a tool, but now these agents are running in the background and are mostly invisible, changing everything."
"Lots of people have agents running, but they don't feel they’re really useful yet."
"It’s not about pure automation. It's like playing tennis—back and forth between human and agent."
"We must design who is in the loop and who is in the lead. The responsibility can’t be handed over to AI."
"If you spend more time building an agent than doing the task, it’s not worth it."
"The chaos of undocumented processes makes it hard to build useful AI workflows; mapping and blueprinting help."
"Information is power in organizations, so deploying AI agents means reconsidering who gets access to what data."
"It’s dangerous to believe everything AI says or to believe nothing. We must find a balance."
"You can't delegate AI decisions to IT alone; every team needs to figure out how AI agents support their work."
"If we don't do hard thinking and critical collaboration when building agents, we’ll end up with armies of unused agents."
Or choose a question:
More Videos
"Evals are really your intellectual property—they define what good looks like in your domain."
Peter Van DijckBuilding impactful AI products for design and product leaders, Part 2: Evals are your moat
July 23, 2025
"The Researcher in Residence program invites members of affected communities to use our tools over a funded three-month period pro bono."
Xenia Adjoubei Sean BruceEmpowering Communities Through the Researcher in Residence Program
March 29, 2023
"Rivian told Volkswagen, You tell us how to make a software-based vehicle; we’ll build the frame around the computer system and sensors."
James RamptonThe Basics of Automotive UX & Why Phones Are a Part of That Future
July 25, 2024
"With User Interviews, you can launch a project immediately and get your first qualified participant as fast as three hours."
Lily Aduana Savannah Hobbs Brittany Rutherford5 Reasons to Bring Your Recruiting in-House (and How To Do It)
March 12, 2021
"I started spending more time understanding agent processes at a deeper level beyond just answering tactical questions."
Kayla Farrell Chelsey Glasson Sean Fitzell Jared LeClercWhat It's Like To Be a User Researcher at Compass
March 12, 2021
"It's cheaper to fix accessibility issues in the design phase than to wait until after coding or production."
Kate KalcevichIntegrating Accessibility in DesignOps
September 23, 2024
"The nuance is the enemy of machine learning and AI; they struggle with ambiguity where humans thrive."
Ovetta SampsonResearch in the Automated Future
March 11, 2022
"By embedding themselves in environments, the product team underwent a fundamental shift in perspective."
Deanna MitchellDesigning with culture: Unlocking impactful insights for Product and UX
March 12, 2025
"The chatbot method is very transactional: user asks, system responds, and that is pretty much it."
Ren PopeBuilding Experiences for Knowledge Systems
June 6, 2023
