Augment the Human. Interrogate the System.
Summary
Key Insights
-
•
Designers and data scientists approach problems differently, so collaboration is essential to merge human values with data capabilities.
-
•
Anticipatory design allows systems to predict and respond to user needs without explicit requests, enhancing relevance and convenience.
-
•
Humans tend to overtrust AI systems, but lose trust quickly when predictions are wrong, requiring designs that balance skepticism with recourse.
-
•
The pedal assist metaphor frames AI as augmenting human skill rather than replacing it, allowing users to adjust levels of automation.
-
•
Using AI to scaffold human memory and intuition supports cognition instead of automating it away, preserving human abilities.
-
•
Teaming humans with AI helps users handle complex data patterns that are otherwise difficult to perceive or verify.
-
•
Effective design interfaces provide users with in-moment verification tools to explore, challenge, and correct AI-generated content.
-
•
Ethical concerns about manipulation, surveillance, and marginalization need careful consideration in anticipatory systems.
-
•
Younger, digital native designers are more enthusiastic but less critical about AI, while older students bring caution and skepticism.
-
•
Building shared vocabulary between designers and data scientists is crucial to creating meaningful AI-driven design solutions.
Notable Quotes
"Designers need data, but data also needs designers."
"If we aren’t crafting experiences that support a thoughtful, ethical confluence of human and machine, humanity is never gonna get to enjoy that meal."
"Anticipatory design is design anticipating customer needs and serving up what they want before they request it."
"Humans tend to give too much authority to autonomous systems, which can lead to overtrust."
"Trust erodes very quickly the moment an AI prediction is a little off or wrong."
"Elizabeth Churchill framed AI as a pedal assist system, helping us go further and faster but sometimes needing to dial it back."
"Working with AI is a lot less like working with another human and more like working with some weird force of nature."
"AI has no understanding of consequences — humans are the ones to bring that understanding."
"The relationship between designers and data scientists can actually be pretty magical."
"Building skepticism into users is essential because if you’re not skeptical as a designer, it’s hard to build it into your customers."
Or choose a question:
More Videos
"It’s up to designers to be the antidote, to articulate all these changes as one movement."
Erin HauberDesign is Not the Frosting on the Scaled Agile Layer Cake
October 24, 2019
"Thoughts cause feelings, and feelings motivate actions. Changing thoughts changes everything."
Megan KiersteadYou Are a Badass at UX: Overcoming Imposter Syndrome
March 10, 2021
"Not a week has gone by in my four years at Uber that something slightly shocking or jarring did not happen."
Maggie DieringerCreating Consistency Through Constant Change
January 8, 2024
"Lift and shift equals timidity—it’s sticking to what you know rather than delivering real value."
Meaghan Waters Fotina KoutropoulousLack of Product Thinking will Doom Your Legacy Modernization
June 9, 2021
"User research is answering bigger questions now — not just if it works, but what we should build and who we should target."
Jemma AhmedBringing together market and user research
October 17, 2019
"Activation isn’t just at the end of the journey; it must be embedded throughout the knowledge management process."
Maria TaylorKnowledge is Power: Managing the Lifeblood of the Design Org
October 3, 2023
"Accessibility is now considered not just a moral necessity and a human right but a business good because accessible products are better and easier for everyone to use."
Sam ProulxUnderstanding Screen Readers on Mobile: How And Why to Learn from Native Users
June 6, 2023
"The team can now tell the World Service what to do, not just what the audience thinks."
Catherine BlizzardUsing Integrated Insight to Drive Growth
March 10, 2022
"We all walked away better for it."
Randolph Duke IIWar Stories LIVE! Randy Duke II
March 30, 2020