Rosenverse
Augment the Human. Interrogate the System.

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Augment the Human. Interrogate the System.

Gold
Wednesday, June 7, 2023 • Enterprise UX 2023
Share the love for this talk
Augment the Human. Interrogate the System.
Speakers: Helen Armstrong
Link:

Summary

Designers stand at the verge of a great professional opportunity: artificial intelligence. This technology enables computers to study the world and make predictions using unstructured data. We can speak to machines—and machines can speak back. We can gesture to devices, expressing emotion and intent, and machines can respond meaningfully. We can look to computers not just for interaction, but for companionship. How can designers adapt and thrive in this evolving terrain? How might we map out new brands, platforms and experiences between human and machine? What dangers must we address? What destructive ideologies must we reveal? What possibilities for a better future might we explore and prototype?

Key Insights

  • •

    Designers and data scientists approach problems differently, so collaboration is essential to merge human values with data capabilities.

  • •

    Anticipatory design allows systems to predict and respond to user needs without explicit requests, enhancing relevance and convenience.

  • •

    Humans tend to overtrust AI systems, but lose trust quickly when predictions are wrong, requiring designs that balance skepticism with recourse.

  • •

    The pedal assist metaphor frames AI as augmenting human skill rather than replacing it, allowing users to adjust levels of automation.

  • •

    Using AI to scaffold human memory and intuition supports cognition instead of automating it away, preserving human abilities.

  • •

    Teaming humans with AI helps users handle complex data patterns that are otherwise difficult to perceive or verify.

  • •

    Effective design interfaces provide users with in-moment verification tools to explore, challenge, and correct AI-generated content.

  • •

    Ethical concerns about manipulation, surveillance, and marginalization need careful consideration in anticipatory systems.

  • •

    Younger, digital native designers are more enthusiastic but less critical about AI, while older students bring caution and skepticism.

  • •

    Building shared vocabulary between designers and data scientists is crucial to creating meaningful AI-driven design solutions.

Notable Quotes

"Designers need data, but data also needs designers."

"If we aren’t crafting experiences that support a thoughtful, ethical confluence of human and machine, humanity is never gonna get to enjoy that meal."

"Anticipatory design is design anticipating customer needs and serving up what they want before they request it."

"Humans tend to give too much authority to autonomous systems, which can lead to overtrust."

"Trust erodes very quickly the moment an AI prediction is a little off or wrong."

"Elizabeth Churchill framed AI as a pedal assist system, helping us go further and faster but sometimes needing to dial it back."

"Working with AI is a lot less like working with another human and more like working with some weird force of nature."

"AI has no understanding of consequences — humans are the ones to bring that understanding."

"The relationship between designers and data scientists can actually be pretty magical."

"Building skepticism into users is essential because if you’re not skeptical as a designer, it’s hard to build it into your customers."

Ask the Rosenbot
Susan Weinschenk
Evaluating the Maturity of UX in Your Organization
2020 • Enterprise Community
Dane DeSutter
What co-speech gestures reveal about users’ thinking during interviews
2023 • Rosenfeld Community
Mary-Lynne Williams
Exit Interview #4: From Product Design Leadership to Sound Healing
2026 • Rosenfeld Community
Feleesha Sterling
Building a Rapid Research Program
2023 • Enterprise Community
Louis Rosenfeld
Do you want to work on climate? (Climate UX Discussion Series)
2023 • Climate UX Interest Group
Peter Van Dijck
Designing AI-first products on top of a rapidly evolving technology
2025 • Designing with AI 2025
Gold
Jemma Ahmed
Theme 2 Intro
2024 • Advancing Research 2024
Gold
Nathan Shedroff
Double Your Mileage: Use Your Research Strategically
2020 • Advancing Research 2020
Gold
Jill Fruchter
Inconvenient Insights: The Researcher's Role is to Stay Curious
2023 • Advancing Research 2023
Gold
Uday Gajendar
Day 2 Welcome
2024 • Designing with AI 2024
Gold
Ariel Kennan
Civic Design in 2022
2022 • Civic Design Community
Sabrina Mach
How to Design Your Design Operating Model
2021 • DesignOps Summit 2021
Gold
Lisa Welchman
Cleaning Up Our Mess: Digital Governance for Designers
2018 • Enterprise Experience 2018
Gold
Nalini P. Kotamraju
Two Jobs in One: Being a “Leader who is a Researcher” and a “Researcher who is a Leader"
2021 • Advancing Research 2021
Gold
Mark Interrante
Collaboration Flows in Product Development
2017 • Enterprise Experience 2017
Gold
Florence Okoye
AfroFuturism and UX Research
2023 • Advancing Research 2023
Gold

More Videos

Erin Hauber

"It’s up to designers to be the antidote, to articulate all these changes as one movement."

Erin Hauber

Design is Not the Frosting on the Scaled Agile Layer Cake

October 24, 2019

Megan Kierstead

"Thoughts cause feelings, and feelings motivate actions. Changing thoughts changes everything."

Megan Kierstead

You Are a Badass at UX: Overcoming Imposter Syndrome

March 10, 2021

Maggie Dieringer

"Not a week has gone by in my four years at Uber that something slightly shocking or jarring did not happen."

Maggie Dieringer

Creating Consistency Through Constant Change

January 8, 2024

Meaghan Waters

"Lift and shift equals timidity—it’s sticking to what you know rather than delivering real value."

Meaghan Waters Fotina Koutropoulous

Lack of Product Thinking will Doom Your Legacy Modernization

June 9, 2021

Jemma Ahmed

"User research is answering bigger questions now — not just if it works, but what we should build and who we should target."

Jemma Ahmed

Bringing together market and user research

October 17, 2019

Maria Taylor

"Activation isn’t just at the end of the journey; it must be embedded throughout the knowledge management process."

Maria Taylor

Knowledge is Power: Managing the Lifeblood of the Design Org

October 3, 2023

Sam Proulx

"Accessibility is now considered not just a moral necessity and a human right but a business good because accessible products are better and easier for everyone to use."

Sam Proulx

Understanding Screen Readers on Mobile: How And Why to Learn from Native Users

June 6, 2023

Catherine Blizzard

"The team can now tell the World Service what to do, not just what the audience thinks."

Catherine Blizzard

Using Integrated Insight to Drive Growth

March 10, 2022

Randolph Duke II

"We all walked away better for it."

Randolph Duke II

War Stories LIVE! Randy Duke II

March 30, 2020