Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Augment the Human. Interrogate the System.
Gold
Wednesday, June 7, 2023 • Enterprise UX 2023
Share the love for this talk
Augment the Human. Interrogate the System.
Speakers: Helen Armstrong
Link:

Summary

Designers stand at the verge of a great professional opportunity: artificial intelligence. This technology enables computers to study the world and make predictions using unstructured data. We can speak to machines—and machines can speak back. We can gesture to devices, expressing emotion and intent, and machines can respond meaningfully. We can look to computers not just for interaction, but for companionship. How can designers adapt and thrive in this evolving terrain? How might we map out new brands, platforms and experiences between human and machine? What dangers must we address? What destructive ideologies must we reveal? What possibilities for a better future might we explore and prototype?

Key Insights

  • Designers and data scientists have complementary approaches that must collaborate for effective AI experiences.

  • Anticipatory design can preempt user needs, creating highly personalized experiences across industries like fast food, retail, and healthcare.

  • Users tend to overtrust autonomous AI systems, but their trust can quickly erode when predictions are inaccurate, requiring balanced design strategies.

  • Designers should build interfaces that allow users to verify AI outputs and provide feedback in the moment of use.

  • Human-AI teaming enables users to manage complex systems and discover insights unattainable alone, as seen in intelligence analysis prototypes.

  • Designers must thoughtfully decide which human skills to preserve versus which to automate, informed by metaphors like Elizabeth Churchill's pedal-assist system.

  • AI operates as an alien intelligence without understanding consequences, so humans must provide ethical context and oversight.

  • Younger designers exhibit enthusiasm but lack critical skepticism; educational programs must nurture a balanced perspective on AI.

  • Learning data science vocabulary empowers designers to collaborate effectively with technical teams and shape AI-driven products.

  • The emergent field of contestable AI UX patterns highlights the need for interfaces that support in-the-moment user challenges to AI outputs.

Notable Quotes

"Designers need data, but data also needs designers."

"If we don’t collaborate, we’ll end up with a lot of meals that nobody wants to eat and that are really bad for us."

"Anticipatory design means the system serves up what the user needs or desires before they even request it."

"Humans tend to overtrust autonomous systems, like following GPS directions into a lake."

"When the AI prediction is wrong, trust erodes very quickly; balancing skepticism and trust is critical."

"Human and AI teaming can produce insights and wisdom that would be difficult to discover alone."

"The question is not just what to automate, but what human skills do we want to preserve."

"AI is a kind of pedal assist system: sometimes you want it to push you, sometimes you want to pedal yourself."

"AI has no understanding of consequences; humans bring ethical meaning and responsibility."

"Designers must resist manipulation and marginalization inherent in automated systems to envision futures we want to live in."

Ask the Rosenbot
Sara Asche Anderson
Not Your Ordinary Re-Brand: Design's Path to Driving Customer Obsession at Best Buy
2024 • Enterprise Experience 2020
Gold
Tim Parmee
Changing Our Design Pressure Points
2023 • DesignOps Summit 2023
Gold
Rima Campbell
Increase Productivity and Drive Business Impact
2024 • DesignOps 2024
Gold
Marjorie Stainback
What Research Ops Professionals Have Learned from COVID-19 (Videoconference)
2020 • Advancing Research Community
Alissa Briggs
How to Coach Enterprise Experimentation
2015 • Enterprise UX 2015
Gold
Tamara Hale
War Stories LIVE! Tamara Hale
2020 • Advancing Research 2020
Gold
Angelos Arnis
State of DesignOps: Learnings from the 2021 Global Report
2021 • DesignOps Summit 2021
Gold
Peter Van Dijck
Building the Rosenbot
2024 • Designing with AI 2024
Gold
Lavy Kumar
Future of Work
2021 • Design at Scale 2021
Gold
Louis Rosenfeld
Day 1 Welcome
2024 • DesignOps 2024
Gold
Tricia Wang
From Users to Shapers of AI: The Future of Research
2024 • Advancing Research 2024
Gold
Louis Rosenfeld
Opening Remarks
2023 • Design in Product 2023
Gold
Steve Baty
Breaking Out of Ruts: Tips for Overcoming the Fear of Change
2016 • Enterprise UX 2016
Gold
Sohit Karol
Designing Delightful Listening Experiences: Mixed Methods Research in the Age of Machine Learning
2020 • Advancing Research 2020
Gold
Christian Bason
Expand—Rethinking Design for Public Challenges (Videoconference)
2022 • Civic Design Community
Chris Hammond
Embedding sustainability into enterprise design and development: A journey towards "sustainability consciousness"
2025 • Climate UX Interest Group (Rosenfeld Community)

More Videos

Alex Hurworth

"The consequences of inaction are not hypothetical; they are happening right now."

Alex Hurworth Bonnie John Fahd Arshad Antoine Marin

Designing a Contact Tracing App for Universal Access

October 23, 2020

Laine Riley Prokay

"Time commitment for onboarding interns was close to 25%, maybe 50%, of at least two weeks, easing as they became familiar with roles."

Laine Riley Prokay Lisa Gordon

Carving a Path for Early Career DesignOps Practitioners

September 9, 2022

Eniola Oluwole

"If you come with a big idea, they’ll try to dial you back to the smallest iota you can test first."

Eniola Oluwole

Lessons From the DesignOps Journey of the World's Largest Travel Site

October 24, 2019

Nathan Shedroff

"Most strategy is done pretty poorly; it's misleading, sloppy, and often ignored after it's produced."

Nathan Shedroff

Double Your Mileage: Use Your Research Strategically

March 31, 2020

Sam Proulx

"The smaller screen makes it easier to angle the device for adequate viewing, which computers just can’t replicate."

Sam Proulx

Mobile Accessibility: Why Moving Accessibility Beyond the Desktop is Critical in a Mobile-first World

November 17, 2022

Feleesha Sterling

"Foundational research answers big, nebulous questions; rapid research focuses on specific usability questions."

Feleesha Sterling

Building a Rapid Research Program (Videoconference)

May 18, 2023

Neil Barrie

"Culturally resonant experiences can influence society in ways governments only dream of, with velocity and speed."

Neil Barrie

Widening the Aperture: The Case for Taking a Broader Lens to the Dialogue between Products and Culture

March 25, 2024

John Devanney

"Leadership roles have to evolve depending on whether you’re building awareness, influence, capacity, or measuring impact."

John Devanney

The Design Management Office

November 6, 2017

Katy Mogal

"The most important thing is producing something that gives a perspective nobody else in the organization can bring."

Katy Mogal

But Do Your Insights Scale?

March 12, 2021