Summary
In this panel, Cheryl Kaba, Ethan Marotz, and Malena Previ explore the challenges and opportunities in designing responsibly with AI. Cheryl highlights the tension between augmentation and automation, urging critical thinking about long-term impacts, especially in education where AI risks de-skilling teachers. Ethan emphasizes AI's effect on labor, discussing the shift from skilled work to supervisory roles and the need for protections and unionization amid workplace transformations. Malena stresses ethical AI practices focused on transparency, equity, and power dynamics, advocating for participative design that includes marginalized communities. The panel debates transparency in AI confidence scores, sustainability concerns, and navigating hype cycles surrounding AI. Ultimately, they call for intentional conversations about power, ethics, and technology's impact on labor and society, urging practitioners to critically assess who benefits from AI and engage stakeholders in shaping its future.
Key Insights
-
•
AI currently serves mostly narrow use cases but has broader systemic implications.
-
•
Designers are shifting into supervisory roles overseeing AI output, raising concerns about de-skilling.
-
•
Augmentation and automation exist on a continuum; many AI tools initially augment but risk full automation.
-
•
Transparency around AI confidence has diminished compared to earlier systems like Watson.
-
•
Ethical AI design requires incorporating multiple stakeholders, especially marginalized groups, in feedback loops.
-
•
Sustainability is often overlooked in AI discussions despite significant environmental impacts.
-
•
Power dynamics in AI design influence who benefits and who bears risks, and must be explicitly addressed.
-
•
Content designers can evolve by focusing on AI explainability and risk mitigation roles.
-
•
Unionization and labor protections are critical to address AI’s effect on job security and work roles.
-
•
Effective ethical frameworks in AI combine principles with practical design exercises tailored to context.
Notable Quotes
"We’re in this initial stage of tinkering just to make AI behave the way we expect."
"The supervisory role that designers take over AI output signals a potential de-skilling of labor."
"We want augmentation, not automation, but the trajectory may lead us to automation anyway."
"Who gets to decide where the line is between augmentation and replacement by AI?"
"It’s important to design AI ‘with’ users, not just ‘for’ them, especially marginalized communities."
"Microsoft missed their sustainability goals because of AI’s increased carbon emissions."
"There are zero feedback loops if the people impacted by AI are not involved in its design."
"Ethics is not just about compliance; it’s about doing the right thing holistically."
"Most fears about AI are actually fears about capitalism and power."
"If you have concerns about your role with AI, have a conversation with your coworkers."
Or choose a question:
More Videos
"Telling your team’s story explains the culture of your team and how someone could fit into it."
Jennifer KanyamibwaCreating the Blueprint: Growing and Building Design Teams
November 8, 2018
"There’s a tension between immediate evaluative research and more durable insights for future use."
Brigette Metzler Dana ChrisfieldResearch Repositories: A global project by the ResearchOps Community (Videoconference)
August 27, 2020
"I like to engage my stakeholders as co-creators and co-discoverers because that makes persuasion so much easier."
Carl TurnerYou Can Do This: Understand and Solve Organizational Problems to Jumpstart a Dead Project
March 28, 2023
"Leadership is unlocking potential in people and processes and taking responsibility for doing that."
John Mortimer Milan Guenther Lucy Ellis Patrick QuattlebaumPanel Discussion
December 3, 2024
"An engaged designer is a retained designer."
Dante GuintuHow to Crush the Talent Crunch
September 8, 2022
"Marketing and strategy are part of design."
Richard BuchananCreativity and Principles in the Flourishing Enterprise
June 15, 2018
"Sharzad is going to share wisdom earned the hard way from working inside and outside."
Dan WillisTheme 3: Intro
January 8, 2024
"I may have failed, but I am not a failure."
Dan WardFailure Friday #1 with Dan Ward
February 7, 2025
"This is a weird time for research. Layoffs have torn through our field. I've been laid off too."
Chris GeisonTheme Two Intro
March 28, 2023