Rosenverse
Augment the Human. Interrogate the System.

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Augment the Human. Interrogate the System.

Gold
Wednesday, June 7, 2023 • Enterprise UX 2023
Share the love for this talk
Augment the Human. Interrogate the System.
Speakers: Helen Armstrong
Link:

Summary

Designers stand at the verge of a great professional opportunity: artificial intelligence. This technology enables computers to study the world and make predictions using unstructured data. We can speak to machines—and machines can speak back. We can gesture to devices, expressing emotion and intent, and machines can respond meaningfully. We can look to computers not just for interaction, but for companionship. How can designers adapt and thrive in this evolving terrain? How might we map out new brands, platforms and experiences between human and machine? What dangers must we address? What destructive ideologies must we reveal? What possibilities for a better future might we explore and prototype?

Key Insights

  • Designers and data scientists approach problems differently, so collaboration is essential to merge human values with data capabilities.

  • Anticipatory design allows systems to predict and respond to user needs without explicit requests, enhancing relevance and convenience.

  • Humans tend to overtrust AI systems, but lose trust quickly when predictions are wrong, requiring designs that balance skepticism with recourse.

  • The pedal assist metaphor frames AI as augmenting human skill rather than replacing it, allowing users to adjust levels of automation.

  • Using AI to scaffold human memory and intuition supports cognition instead of automating it away, preserving human abilities.

  • Teaming humans with AI helps users handle complex data patterns that are otherwise difficult to perceive or verify.

  • Effective design interfaces provide users with in-moment verification tools to explore, challenge, and correct AI-generated content.

  • Ethical concerns about manipulation, surveillance, and marginalization need careful consideration in anticipatory systems.

  • Younger, digital native designers are more enthusiastic but less critical about AI, while older students bring caution and skepticism.

  • Building shared vocabulary between designers and data scientists is crucial to creating meaningful AI-driven design solutions.

Notable Quotes

"Designers need data, but data also needs designers."

"If we aren’t crafting experiences that support a thoughtful, ethical confluence of human and machine, humanity is never gonna get to enjoy that meal."

"Anticipatory design is design anticipating customer needs and serving up what they want before they request it."

"Humans tend to give too much authority to autonomous systems, which can lead to overtrust."

"Trust erodes very quickly the moment an AI prediction is a little off or wrong."

"Elizabeth Churchill framed AI as a pedal assist system, helping us go further and faster but sometimes needing to dial it back."

"Working with AI is a lot less like working with another human and more like working with some weird force of nature."

"AI has no understanding of consequences — humans are the ones to bring that understanding."

"The relationship between designers and data scientists can actually be pretty magical."

"Building skepticism into users is essential because if you’re not skeptical as a designer, it’s hard to build it into your customers."

Ask the Rosenbot
Séamus Byrne
Aligning Teams with Choreography
2024 • Enterprise Experience 2020
Gold
Jim Kalbach
Jazz Improvisation as a Model for Team Collaboration
2017 • DesignOps Summit 2017
Gold
Katy Mogal
But Do Your Insights Scale?
2021 • Advancing Research 2021
Gold
JJ Kercher
A Roadmap for Maturing Design in the Enterprise
2018 • Enterprise Experience 2018
Gold
Erin Weigel
Get Your Whole Team Testing to Design for Impact
2024 • Rosenfeld Community
Kristen Honey
"Let’s Talk About Data and Crisis”: Public Digital Service Delivery = Open Data + Human Centered Design
2021 • Civic Design Community
Anne Mamaghani
How Your Organization's Generative Workshops Are Probably Going Wrong and How to Get Them Right
2023 • Advancing Research 2023
Gold
Bria Alexander
State of DesignOps Panel
2021 • DesignOps Summit 2021
Gold
Abbey Smalley
Scaling UX Past the Size of Your Team
2024 • Enterprise Experience 2020
Gold
Briana Thomas
When Design Ops Comes in H.O.T. : A Tale of a Transformed Design Org
2021 • DesignOps Summit 2021
Gold
Feyikemi Akinwolemiwa
Play to innovate: How curiosity and experimentation transform UX
2026 • Advancing Research 2026
Gold
Melinda Belcher
Bridging the Gap: Making the Most of the Differences Between Agency and Enterprise
2024 • Enterprise Experience 2020
Gold
Kelly Dern
AI as a Design Partner: How to Get the Most Out of AI Tools to Scale Your Process
2023 • DesignOps Summit 2023
Gold
Janelle Estes
UX Research Trends
2021 • Advancing Research Community
George Aye
That Quiet Little Voice: When Design and Ethics Collide
2022 • Civic Design 2022
Gold
Ned Dwyer
The Intersection of Design and ResearchOps
2024 • DesignOps Summit 2024
Gold

More Videos

Carl Turner

"When projects are late or delayed it’s often due to organizational and cultural issues rather than conduct of the project team."

Carl Turner

You Can Do This: Understand and Solve Organizational Problems to Jumpstart a Dead Project

March 28, 2023

Karen Pascoe

"Don’t send your recruiters to spam LinkedIn. That damages your brand and turns off potential candidates."

Karen Pascoe

Developing Experience Teams and Talent in the Enterprise

June 8, 2016

Jilanna Wilson

"Nothing builds collaborative relationships better than being physically present, so we make annual off-sites a priority."

Jilanna Wilson

Distributed Design Operations Management

October 23, 2019

Shawna Hein

"We have over 30 contracting teams spread across roughly 10 vendors all working on parts of the veteran experience landscape."

Shawna Hein Kevin Hoffman

Create a Cohesive Civic Design Practice Across Agency, Vendors, and Contracts

November 17, 2022

Barb Spanton

"Site visits with users don’t just give actionable insight; they give us raw, humbling inspiration to keep going."

Barb Spanton

Doing Work That Matters: A Look Beyond The Idealistic Notion of 'Doing Meaningful Work'

June 10, 2022

Briana Thomas

"Silent leaders are people who prefer action over words and advocate in more intimate settings."

Briana Thomas

The Quiet Force: Uncovering Hidden Leadership in High-Impact Design Teams

September 24, 2024

Gina Mendolia

"Grandmas provide grounding, resilience, and long-term perspective often through rituals and storytelling."

Gina Mendolia

Therapists, Coaches, and Grandmas: Techniques for Service Design in Complex Systems

December 3, 2024

Lija Hogan

"UX researchers should learn Python or R and how to leverage AI APIs to process unstructured data."

Lija Hogan Milan Mijatovic Sam Proulx Louis Rosenfeld

Three Years Out: Perspectives on the Near-Term Future of User Research

March 15, 2024

John Calhoun

"A design ops career ladder can look like a step stool unless you create multiple tracks for growth and specialization."

John Calhoun Rachel Posman

Two Sides of the DesignOps Coin: Teams Ops and Product Ops

January 8, 2024