Research in the Automated Future
Summary
Key Insights
-
•
Design and research are tightly intertwined; it's often impossible to tell where one ends and the other begins.
-
•
Machine learning models primarily predict based on past data rather than interact dynamically with the environment.
-
•
Intelligent systems involve multi-agency contexts where both humans and machines have decision-making power.
-
•
Unlike static software, AI systems are dynamic, learning and evolving based on interactions and data.
-
•
Design research for AI must be future-focused and speculative, addressing not just usability but cultural values and trust.
-
•
Bias in AI is complex, involving mathematical, statistical, cognitive, and human biases requiring nuanced mitigation.
-
•
Researchers and designers need high AI and data literacy to influence data inputs and model fairness, not just outputs.
-
•
Explainability in AI is challenging, especially with neural networks, necessitating governance and 'glass box' approaches.
-
•
Design anthropology and participatory methods help uncover unspoken human practices important for automated systems.
-
•
Speculative prototypes (provocation prototypes) and perpetual synthesis support ongoing learning about future AI use.
Notable Quotes
"Design is the conscious and intuitive effort to impose meaningful order to chaos."
"Our role as designers and researchers will be to determine what not to design to preserve human culture and values."
"Machine learning models can see, hear, think, and act but are limited to problem-solving based on past observations."
"The relationship between a user and AI system is multi-agency; both have agency to act and influence outcomes."
"The nuance is the enemy of machine learning and AI; they struggle with ambiguity where humans thrive."
"Research for AI must go beyond single agency frameworks to consider complex ecosystems and multi-modal environments."
"It's not about looking under the hood of the model, but about what data goes into the hood that you can influence."
"There are many types of bias—mathematical, statistical, cognitive, human—and they affect AI outcomes differently."
"Explainability requires transparency at every stage with governance ensuring fairness and equity in model building."
"Speculative research requires participatory methods, putting people into future scenarios, because people often can't articulate what they will want."
Or choose a question:
More Videos
"We moved from Evernote to spreadsheets, to a giant affinity board in Mirror, then to UserVoice, and finally to idiomatic software with AI."
Shipra KayanHow we Built a VoC (Voice of the Customer) Practice at Upwork from the Ground Up
September 30, 2021
"Information architects use nodes and links to create environments for understanding."
Peter MorvilleThe Architecture of Understanding
May 13, 2015
"Having those tough conversations with C-Suite execs, delivering findings with unwavering voice because you know the customer."
Renee ReidBecoming a ResearchH.E.R (Highly Enterprise Ready)
June 3, 2019
"Our bodies profoundly influence the way that we think about ourselves, others, the world, and everything in it."
Dane DeSutterKeeping the Body in Mind: What Gestures and Embodied Actions Tell You That Users May Not
March 26, 2024
"Accessibility is a journey and a conversation—thanks for starting yours by being here today."
Sam ProulxOnline Shopping: Designing an Accessible Experience
October 3, 2023
"Aligning content to audience expectations requires understanding their intent through market research."
Andrew Custage Michael MallettThe Digital Journey: Research on Consumer Frustration and Loyalty
March 29, 2023
"Persisting conversations in Slack instead of Zoom chat means folks can revisit and join conversations asynchronously."
Shelby SwitzerMaking Space for Community Knowledge-sharing in a Distributed World
December 10, 2021
"Prompting is a specialized skill, just like statistics or in-depth interviewing; the wrong wording can bias your results."
Llewyn PaineCoexisting with AI: A practical guide for researchers to navigate tools, ethics, and integration
March 11, 2025
"The only thing any of us can control is how quickly we learn and then act based on that learning."
Robin BeersNavigating organizational systems: Rethinking researcher’s role in driving change
March 13, 2025