Summary
In this panel, Cheryl Kaba, Ethan Marotz, and Malena Previ explore the challenges and opportunities in designing responsibly with AI. Cheryl highlights the tension between augmentation and automation, urging critical thinking about long-term impacts, especially in education where AI risks de-skilling teachers. Ethan emphasizes AI's effect on labor, discussing the shift from skilled work to supervisory roles and the need for protections and unionization amid workplace transformations. Malena stresses ethical AI practices focused on transparency, equity, and power dynamics, advocating for participative design that includes marginalized communities. The panel debates transparency in AI confidence scores, sustainability concerns, and navigating hype cycles surrounding AI. Ultimately, they call for intentional conversations about power, ethics, and technology's impact on labor and society, urging practitioners to critically assess who benefits from AI and engage stakeholders in shaping its future.
Key Insights
-
•
AI currently serves mostly narrow use cases but has broader systemic implications.
-
•
Designers are shifting into supervisory roles overseeing AI output, raising concerns about de-skilling.
-
•
Augmentation and automation exist on a continuum; many AI tools initially augment but risk full automation.
-
•
Transparency around AI confidence has diminished compared to earlier systems like Watson.
-
•
Ethical AI design requires incorporating multiple stakeholders, especially marginalized groups, in feedback loops.
-
•
Sustainability is often overlooked in AI discussions despite significant environmental impacts.
-
•
Power dynamics in AI design influence who benefits and who bears risks, and must be explicitly addressed.
-
•
Content designers can evolve by focusing on AI explainability and risk mitigation roles.
-
•
Unionization and labor protections are critical to address AI’s effect on job security and work roles.
-
•
Effective ethical frameworks in AI combine principles with practical design exercises tailored to context.
Notable Quotes
"We’re in this initial stage of tinkering just to make AI behave the way we expect."
"The supervisory role that designers take over AI output signals a potential de-skilling of labor."
"We want augmentation, not automation, but the trajectory may lead us to automation anyway."
"Who gets to decide where the line is between augmentation and replacement by AI?"
"It’s important to design AI ‘with’ users, not just ‘for’ them, especially marginalized communities."
"Microsoft missed their sustainability goals because of AI’s increased carbon emissions."
"There are zero feedback loops if the people impacted by AI are not involved in its design."
"Ethics is not just about compliance; it’s about doing the right thing holistically."
"Most fears about AI are actually fears about capitalism and power."
"If you have concerns about your role with AI, have a conversation with your coworkers."
Or choose a question:
More Videos
"Knowledge is power; empowering communities leads to better conservation outcomes."
Alex Hurworth Bonnie John Fahd Arshad Antoine MarinDesigning a Contact Tracing App for Universal Access
October 23, 2020
"Time commitment for onboarding interns was close to 25%, maybe 50%, of at least two weeks, easing as they became familiar with roles."
Laine Riley Prokay Lisa GordonCarving a Path for Early Career DesignOps Practitioners
September 9, 2022
"Once cash prizes were gone, people stopped feeling ownership of the design system."
Eniola OluwoleLessons From the DesignOps Journey of the World's Largest Travel Site
October 24, 2019
"Strategy should be continuous, circular, and evolve with every action the organization takes."
Nathan ShedroffDouble Your Mileage: Use Your Research Strategically
March 31, 2020
"Voice control on mobile goes beyond digital assistants and can fully control the device for users who cannot use touch."
Sam ProulxMobile Accessibility: Why Moving Accessibility Beyond the Desktop is Critical in a Mobile-first World
November 17, 2022
"Documentation and making findings visible even without a dedicated research librarian helps maintain program momentum."
Feleesha SterlingBuilding a Rapid Research Program (Videoconference)
May 18, 2023
"Overlaying cultural dialogue on journey maps reveals impactful insights that need to be validated but are promising."
Neil BarrieWidening the Aperture: The Case for Taking a Broader Lens to the Dialogue between Products and Culture
March 25, 2024
"Most organizations know they need to evaluate impact, but very few have effective ways to do it."
John DevanneyThe Design Management Office
November 6, 2017
"Surveys and logs tell us what users do, but qualitative tells us why."
Katy MogalBut Do Your Insights Scale?
March 12, 2021