Rosenverse
When AI Agents Meet Reality. Service Design Lessons from a Pilot

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

When AI Agents Meet Reality. Service Design Lessons from a Pilot

Thursday, February 26, 2026 • Rosenfeld Community
Share the love for this talk
When AI Agents Meet Reality. Service Design Lessons from a Pilot
Speakers: Tina Weisser
Link:

Summary

Why does the introduction of AI agents so often lead to confusion instead of clarity? Drawing on an applied pilot project on Human-Agent Teams, this session shares key learnings from integrating AI agents into everyday work. The focus is not on the technology itself, but on structure. How roles shift. Where decisions get stuck. How trust is shaped or undermined. And why teams struggle even when the system technically works. The session shows how Service Design helped make these dynamics visible and manageable. Not as a creativity method, but as a way to design clear responsibility, decision paths, and collaboration between humans and agents. Presentation and discussion.

Key Insights

  • Agentic AI represents a shift from AI as a tool to AI as autonomous collaborators that run background workflows.

  • Many organizations have AI agents built, but a large gap remains in making them truly helpful and valuable.

  • Service design methods like process blueprints and human-in-the-loop approaches are key to designing effective AI-human workflows.

  • Building AI agents quickly is easy, but identifying where they add value requires deep problem understanding and organizational context.

  • Chaos in undocumented or inconsistent workflows complicates designing useful AI workflows.

  • Trust and responsibility must remain human-led with clear definitions of when and how humans intervene in AI processes.

  • Organizational power dynamics around information sharing critically impact the effectiveness of AI agent deployment.

  • Iterative quality feedback loops where AI agents improve based on continuous human input are vital for success.

  • Co-creative, multidisciplinary engagement including non-technical stakeholders increases adoption and reduces resistance to AI.

  • AI literacy at all organizational levels is necessary; leaders must engage with AI to properly support teams using it.

Notable Quotes

"Before for me, AI was just a tool, but now these agents are running in the background and are mostly invisible, changing everything."

"Lots of people have agents running, but they don't feel they’re really useful yet."

"It’s not about pure automation. It's like playing tennis—back and forth between human and agent."

"We must design who is in the loop and who is in the lead. The responsibility can’t be handed over to AI."

"If you spend more time building an agent than doing the task, it’s not worth it."

"The chaos of undocumented processes makes it hard to build useful AI workflows; mapping and blueprinting help."

"Information is power in organizations, so deploying AI agents means reconsidering who gets access to what data."

"It’s dangerous to believe everything AI says or to believe nothing. We must find a balance."

"You can't delegate AI decisions to IT alone; every team needs to figure out how AI agents support their work."

"If we don't do hard thinking and critical collaboration when building agents, we’ll end up with armies of unused agents."

Ask the Rosenbot
Connect with the Advancing Research Community
2026 • Advancing Research 2026
Gold
Steve Baty
Discussion
2016 • Enterprise UX 2016
Gold
Ariel Kennan
Civic Design in 2022
2022 • Civic Design Community
John Maeda
Making Sense of Enterprise UX
2016 • Enterprise UX 2016
Gold
Saara Kamppari-Miller
"Prototype" vs "Prototype"--Breaking Down and Rebuilding Our Understanding of What We Do
2019 • DesignOps Summit 2019
Gold
Saara Kamppari-Miller
Key Metrics: Comparing Three Letter Acronym Metrics That Include the Word “Key”
2024 • DesignOps Community
Robert Fabricant
Shifting dynamics: The evolving relationship between researchers, participants, and organizational systems
2025 • Advancing Research 2025
Gold
Tina Weisser
When AI Agents Meet Reality. Service Design Lessons from a Pilot
2026 • Rosenfeld Community
Saara Kamppari-Miller
Inclusive Design is DesignOps
2021 • DesignOps Summit 2021
Gold
Dana Chisnell
The Sensemaking Business
2026 • Advancing Research 2026
Gold
Laura Schaefer
DesignOps: A Conduit for Inclusion
2022 • DesignOps Summit 2022
Gold
Joerg Beringer
Scaling User Research with AI: Continuous Discovery of User Needs in Minutes
2025 • Designing with AI 2025
Gold
Louis Rosenfeld
Opening Remarks
2023 • DesignOps Summit 2023
Gold
Daniel Korczynski
Why AI Is Bad at Research (and how to make it actually useful)
2026 • Advancing Research 2026
Gold
Nicole Aleong
What UX research can learn from other research practices [Advancing Research Community Workshop Series]
2023 • Advancing Research Community
Wendy Johansson
An Education on Design Education for Orgs
2021 • Design at Scale 2021
Gold

More Videos

Sam Proulx

"Mobile interaction with gestures and touch was revolutionary for accessibility."

Sam Proulx

Mobile Accessibility: Why Moving Accessibility Beyond the Desktop is Critical in a Mobile-first World

September 8, 2022

Erin Hauber

"Empathy applies to us too—we needed to understand how our own people were feeling about these layered changes."

Erin Hauber

Design is Not the Frosting on the Scaled Agile Layer Cake

October 24, 2019

Simon Wardley

"There is no such thing as one-size-fits-all methods; what works depends on the component’s evolutionary stage."

Simon Wardley

Maps and Topographical Intelligence

January 31, 2019

Yolanda Rankin

"Black feminist thought is not about victimization; it is a call to action and resistance against oppression."

Yolanda Rankin

Black Feminist Epistemology as a Critical Framework for Equitable Design

March 11, 2021

Renee Bouwens

"Product managers are often prioritization focused, so they can bias themselves in research decisions."

Renee Bouwens

Landing Product Impact: Aligning Research as a Foundational Driver for Delivering the World’s Best Products

December 15, 2023

Paul Pangaro, PhD

"Conversations create new language, allowing us to see possibilities that old language couldn’t reveal."

Paul Pangaro, PhD

Systems Disciplines: Table Stakes for 21st Century Organizations

June 6, 2023

Max Gadney

"Check the people on the board and the advisors because that tells you a lot about the company’s true values."

Max Gadney Andrea Petrucci Joshua Stehr Hannah Wickes

Assessing UX jobs for impact in climate

August 14, 2024

Courtney Kaplan

"We grew from two designers to 50 in four months, then over 300 in five years in just the ads design org."

Courtney Kaplan

Taking it to the next level: Career paths in DesignOps

November 8, 2018

Dan Donald

"Our job is to help others do great work, not to create perfect components for our own ego."

Dan Donald

Design Systems as a Vehicle for Systemic Change

June 1, 2023