Summary
In this panel, Cheryl Kaba, Ethan Marotz, and Malena Previ explore the challenges and opportunities in designing responsibly with AI. Cheryl highlights the tension between augmentation and automation, urging critical thinking about long-term impacts, especially in education where AI risks de-skilling teachers. Ethan emphasizes AI's effect on labor, discussing the shift from skilled work to supervisory roles and the need for protections and unionization amid workplace transformations. Malena stresses ethical AI practices focused on transparency, equity, and power dynamics, advocating for participative design that includes marginalized communities. The panel debates transparency in AI confidence scores, sustainability concerns, and navigating hype cycles surrounding AI. Ultimately, they call for intentional conversations about power, ethics, and technology's impact on labor and society, urging practitioners to critically assess who benefits from AI and engage stakeholders in shaping its future.
Key Insights
-
•
AI currently serves mostly narrow use cases but has broader systemic implications.
-
•
Designers are shifting into supervisory roles overseeing AI output, raising concerns about de-skilling.
-
•
Augmentation and automation exist on a continuum; many AI tools initially augment but risk full automation.
-
•
Transparency around AI confidence has diminished compared to earlier systems like Watson.
-
•
Ethical AI design requires incorporating multiple stakeholders, especially marginalized groups, in feedback loops.
-
•
Sustainability is often overlooked in AI discussions despite significant environmental impacts.
-
•
Power dynamics in AI design influence who benefits and who bears risks, and must be explicitly addressed.
-
•
Content designers can evolve by focusing on AI explainability and risk mitigation roles.
-
•
Unionization and labor protections are critical to address AI’s effect on job security and work roles.
-
•
Effective ethical frameworks in AI combine principles with practical design exercises tailored to context.
Notable Quotes
"We’re in this initial stage of tinkering just to make AI behave the way we expect."
"The supervisory role that designers take over AI output signals a potential de-skilling of labor."
"We want augmentation, not automation, but the trajectory may lead us to automation anyway."
"Who gets to decide where the line is between augmentation and replacement by AI?"
"It’s important to design AI ‘with’ users, not just ‘for’ them, especially marginalized communities."
"Microsoft missed their sustainability goals because of AI’s increased carbon emissions."
"There are zero feedback loops if the people impacted by AI are not involved in its design."
"Ethics is not just about compliance; it’s about doing the right thing holistically."
"Most fears about AI are actually fears about capitalism and power."
"If you have concerns about your role with AI, have a conversation with your coworkers."
Or choose a question:
More Videos
"Don't be cool, be good—work hard at managing your teams because they need you to nail it."
Adam Cutler Karen Pascoe Ian Swinson Susan WorthmanDiscussion
June 8, 2016
"We don’t get upset when users say one thing and do another, but we freak out when our leadership behaves that way."
Peter MerholzThe Trials and Tribulations of Directors of UX (Videoconference)
July 13, 2023
"In the automotive industry, most safety standards only became mandatory after governments intervened."
Lisa WelchmanCleaning Up Our Mess: Digital Governance for Designers
June 14, 2018
"Investing in sustainability today will yield dividends for future generations."
Vincent BrathwaiteOpener: Past, Present, and Future—Closing the Racial Divide in Design Teams
October 22, 2020
"The greatest sign of success for a teacher is just to be able to say the children are now working as if I did not exist."
Brenna FallonLearning Over Outcomes
October 24, 2019
"It’s human infrastructure—community organizing, unions, activists—that saves the day when other infrastructures break down."
Tricia WangSpatial Collapse: Designing for Emergent Culture
January 8, 2024
"Diverging and converging around the business model canvas helped us test and prototype delivery methods for the value propositions."
Edgar Anzaldua MorenoUsing Research to Determine Unique Value Proposition
March 11, 2021
"Leadership buy-in is really important—having an executive who understands the value of knowledge creation, distribution, application, and evaluation."
Designing Systems at Scale
November 7, 2018
"If my experiment made front-page news tomorrow, what would the headline be? Would my mother be proud?"
Erin WeigelGet Your Whole Team Testing to Design for Impact
July 24, 2024
