Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Augment the Human. Interrogate the System.

Gold
Wednesday, June 7, 2023 • Enterprise UX 2023
Share the love for this talk
Augment the Human. Interrogate the System.
Speakers: Helen Armstrong
Link:

Summary

Designers stand at the verge of a great professional opportunity: artificial intelligence. This technology enables computers to study the world and make predictions using unstructured data. We can speak to machines—and machines can speak back. We can gesture to devices, expressing emotion and intent, and machines can respond meaningfully. We can look to computers not just for interaction, but for companionship. How can designers adapt and thrive in this evolving terrain? How might we map out new brands, platforms and experiences between human and machine? What dangers must we address? What destructive ideologies must we reveal? What possibilities for a better future might we explore and prototype?

Key Insights

  • Designers and data scientists approach problems differently, so collaboration is essential to merge human values with data capabilities.

  • Anticipatory design allows systems to predict and respond to user needs without explicit requests, enhancing relevance and convenience.

  • Humans tend to overtrust AI systems, but lose trust quickly when predictions are wrong, requiring designs that balance skepticism with recourse.

  • The pedal assist metaphor frames AI as augmenting human skill rather than replacing it, allowing users to adjust levels of automation.

  • Using AI to scaffold human memory and intuition supports cognition instead of automating it away, preserving human abilities.

  • Teaming humans with AI helps users handle complex data patterns that are otherwise difficult to perceive or verify.

  • Effective design interfaces provide users with in-moment verification tools to explore, challenge, and correct AI-generated content.

  • Ethical concerns about manipulation, surveillance, and marginalization need careful consideration in anticipatory systems.

  • Younger, digital native designers are more enthusiastic but less critical about AI, while older students bring caution and skepticism.

  • Building shared vocabulary between designers and data scientists is crucial to creating meaningful AI-driven design solutions.

Notable Quotes

"Designers need data, but data also needs designers."

"If we aren’t crafting experiences that support a thoughtful, ethical confluence of human and machine, humanity is never gonna get to enjoy that meal."

"Anticipatory design is design anticipating customer needs and serving up what they want before they request it."

"Humans tend to give too much authority to autonomous systems, which can lead to overtrust."

"Trust erodes very quickly the moment an AI prediction is a little off or wrong."

"Elizabeth Churchill framed AI as a pedal assist system, helping us go further and faster but sometimes needing to dial it back."

"Working with AI is a lot less like working with another human and more like working with some weird force of nature."

"AI has no understanding of consequences — humans are the ones to bring that understanding."

"The relationship between designers and data scientists can actually be pretty magical."

"Building skepticism into users is essential because if you’re not skeptical as a designer, it’s hard to build it into your customers."

Ask the Rosenbot
Allison Sanders
Operating with Purpose
2024 • DesignOps Summit 2020
Gold
James Rampton
The Basics of Automotive UX & Why Phones Are a Part of That Future
2024 • Rosenfeld Community
Sandra Camacho
Creating More Bias-Proof Designs
2025 • Rosenfeld Community
Joseph Williams
Unlocking impact and influence through inclusive hiring in research
2021 • Advancing Research Community
Ned Dwyer
The Intersection of Design and ResearchOps
2024 • DesignOps Summit 2024
Gold
Helen Armstrong
Augment the Human. Interrogate the System.
2023 • Enterprise UX 2023
Gold
Uday Gajendar
From AI to Zeitgeist: Theory as the design antidote to AI hype
2025 • Rosenfeld Community
Roy Opata Olende
How Zapier Uses ‘All Hands Research’ to Increase Exposure to Users
2020 • Advancing Research Community
Tricia Wang
From Users to Shapers of AI: The Future of Research
2024 • Advancing Research 2024
Gold
Theresa Slate
Why Changing Hearts & Minds Doesn’t Work When Promoting DE&I Efforts, but Checklists Do
2023 • DesignOps Summit 2023
Gold
Aras Bilgen
Who does the math: A designer’s journey in building an AI-based tutoring app
2025 • Designing with AI 2025
Gold
Peter Van Dijck
Building impactful AI products for design and product leaders, Part 3: Understand AI architectures: RAG, Agents, Oh My!
2025 • Rosenfeld Community
Melissa Schmidt
How UX Research Hit It Big in Las Vegas
2019 • Enterprise Experience 2019
Gold
Jorge Arango
AI as Thought Partner: How to Use LLMs to Transform Your Notes (3rd of 3 seminars)
2024 • Rosenfeld Community
Kristin Taylor
Building Bridges Across Organizational Silos
2022 • Civic Design 2022
Gold
Gillian Salerno-Rebic
Redefining Speed and Scale: How Accenture’s GrowthOS Uses AI-Simulated Insights to Reduce Risk and Accelerate Innovation
2025 • Designing with AI 2025
Gold

More Videos

Erin Weigel

"Color is highly subjective and culturally relevant; what works for sale in one market might not work in another."

Erin Weigel

Real-world lessons to improve your conversion rates

June 26, 2024

Daniel Korczynski

"When you ask a question, try to ask one at a time so the model doesn't get lost."

Daniel Korczynski

Why AI Is Bad at Research (and how to make it actually useful)

March 10, 2026

Kim Lenox

"Design is really a team sport, and we are investing in specialists to help with design systems, operations, research, and content strategy."

Kim Lenox

Leading Distributed Global Teams

May 20, 2019

Brendan Jarvis

"They walked. The locals were most likely right."

Brendan Jarvis

Framing Tomorrow by Questioning Today

June 8, 2022

Carol Massa

"If you come in wanting to change everything at once, you won't get the response needed to make your work meaningful."

Carol Massa

Designing Health: Integrating Service Design, Technology, and Strategy to Transform Patient and Clinician Experiences

December 3, 2024

Dr Chloe Sharp

"We used affinity mapping with stakeholders to get them really into the mindset of the users and advocate for them."

Dr Chloe Sharp

Using Evidence and Collaboration for Setting and Defending Priorities

November 29, 2023

Sarah Auslander

"My younger self had a lot of impostor syndrome, but everyone even with more experience doesn’t totally know what they’re doing."

Sarah Auslander Betsy Ramaccia Gordon Ross

Insights Panel

November 18, 2022

Susan Simon-Daniels

"My job was to find out why. Why was he frowning? Why was he sighing?"

Susan Simon-Daniels

War Stories LIVE! Susan Simon-Daniels

March 30, 2020

Farid Sabitov

"Sharing your automation scripts and articles can get four times more attention than traditional case studies."

Farid Sabitov

Automatization for Large Enterprise Teams

January 8, 2024