Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Augment the Human. Interrogate the System.
Gold
Wednesday, June 7, 2023 • Enterprise UX 2023
Share the love for this talk
Augment the Human. Interrogate the System.
Speakers: Helen Armstrong
Link:

Summary

Designers stand at the verge of a great professional opportunity: artificial intelligence. This technology enables computers to study the world and make predictions using unstructured data. We can speak to machines—and machines can speak back. We can gesture to devices, expressing emotion and intent, and machines can respond meaningfully. We can look to computers not just for interaction, but for companionship. How can designers adapt and thrive in this evolving terrain? How might we map out new brands, platforms and experiences between human and machine? What dangers must we address? What destructive ideologies must we reveal? What possibilities for a better future might we explore and prototype?

Key Insights

  • Designers and data scientists have complementary approaches that must collaborate for effective AI experiences.

  • Anticipatory design can preempt user needs, creating highly personalized experiences across industries like fast food, retail, and healthcare.

  • Users tend to overtrust autonomous AI systems, but their trust can quickly erode when predictions are inaccurate, requiring balanced design strategies.

  • Designers should build interfaces that allow users to verify AI outputs and provide feedback in the moment of use.

  • Human-AI teaming enables users to manage complex systems and discover insights unattainable alone, as seen in intelligence analysis prototypes.

  • Designers must thoughtfully decide which human skills to preserve versus which to automate, informed by metaphors like Elizabeth Churchill's pedal-assist system.

  • AI operates as an alien intelligence without understanding consequences, so humans must provide ethical context and oversight.

  • Younger designers exhibit enthusiasm but lack critical skepticism; educational programs must nurture a balanced perspective on AI.

  • Learning data science vocabulary empowers designers to collaborate effectively with technical teams and shape AI-driven products.

  • The emergent field of contestable AI UX patterns highlights the need for interfaces that support in-the-moment user challenges to AI outputs.

Notable Quotes

"Designers need data, but data also needs designers."

"If we don’t collaborate, we’ll end up with a lot of meals that nobody wants to eat and that are really bad for us."

"Anticipatory design means the system serves up what the user needs or desires before they even request it."

"Humans tend to overtrust autonomous systems, like following GPS directions into a lake."

"When the AI prediction is wrong, trust erodes very quickly; balancing skepticism and trust is critical."

"Human and AI teaming can produce insights and wisdom that would be difficult to discover alone."

"The question is not just what to automate, but what human skills do we want to preserve."

"AI is a kind of pedal assist system: sometimes you want it to push you, sometimes you want to pedal yourself."

"AI has no understanding of consequences; humans bring ethical meaning and responsibility."

"Designers must resist manipulation and marginalization inherent in automated systems to envision futures we want to live in."

Ask the Rosenbot
Brad Orego
Bringing Customer Research to More Internal Teams
2022 • Advancing Research 2022
Gold
Prayag Narula
Empowering Designers to do Good Research
2022 • Advancing Research 2022
Gold
Steve Baty
Breaking Out of Ruts: Tips for Overcoming the Fear of Change
2016 • Enterprise UX 2016
Gold
Jemma Ahmed
Theme 2 Intro
2024 • Enterprise Experience 2020
Gold
Barb Spanton
Doing Work That Matters: A Look Beyond The Idealistic Notion of 'Doing Meaningful Work'
2022 • Design at Scale 2022
Gold
Innovate with Purpose
2018 • Enterprise Experience 2018
Gold
Bria Alexander
Theme Two Intro
2023 • DesignOps Summit 2023
Gold
Michael Land
Establishing Design Operations in Government (Videoconference)
2021 • DesignOps Community
Jackie Velasquez-Ross
Talent Acquisition and Our Responsibility (Videoconference)
2020 • DesignOps Community
Jon Fukuda
Theme One Intro
2023 • DesignOps Summit 2023
Gold
Jane Reid
Self-care in User Research (Videoconference)
2020 • Advancing Research Community
Civic Design in 2022 (Videoconference)
2022 • Civic Design Community
Peter Merholz
Customer-Centered Design Organizations
2017 • Enterprise Experience 2017
Gold
Greg Petroff
Design is the Differentiator: Bringing New Design Innovations to a Very Antiquated and Very Large Industry
2021 • Design at Scale 2021
Gold
Jodi Forlizzi
Design and AI innovation
2024 • Designing with AI 2024
Gold
Michelle Bejian Lotia
Rolling Out a Repository: How Zapier Centralizes Insights from Across their Organization
2023 • Advancing Research 2023
Gold

More Videos

"People often debate internally about whether they lean more towards product, service, or design artifacts."

Shaping design, designers and teams

November 8, 2018

Sabrina Mach

"In a false start, design is perpetually fixing what development has done and is reactive, not proactive."

Sabrina Mach Nina Wainwright

How to Design Your Design Operating Model

September 29, 2021

Samuel Proulx

"When you design for the edges, you get the middle for free."

Samuel Proulx

Invisible barriers: Why accessible service design can’t be an afterthought

December 3, 2024

Saara Kamppari-Miller

"Design, product, engineering, legal, and leadership all need to be involved; it should never be just one group’s responsibility."

Saara Kamppari-Miller

DesignOps for Inclusive Design and Accessibility (Videoconference)

May 26, 2022

Briana Thomas

"We didn’t chase shiny objects; we gave creatives access to tools to inspire the future of creativity."

Briana Thomas

The Quiet Force: Uncovering Hidden Leadership in High-Impact Design Teams

September 24, 2024

Adam Cutler

"I have to triangulate socially because Yorkshire folks are quite reserved; they won't openly admit issues."

Adam Cutler Karen Pascoe Ian Swinson Susan Worthman

Discussion

June 8, 2016

"There’s a lot of tools that can do everything, but they can’t do one thing really, really well."

Operationalizing DesignOps

November 7, 2018

Leah Buley

"Executives see research value when they’ve lost money on bad bets and want to mitigate risk for future decisions."

Leah Buley Joe Natoli

Ask Me Anything with Leah Buley and Joe Natoli, co-authors of The User Experience Team of One (2nd edition)

October 8, 2024

Nathan Shedroff

"Living personas refreshed constantly with new research allow others to connect with real customer behaviors."

Nathan Shedroff

Double Your Mileage: Use Your Research Strategically

March 31, 2020