Summary
In this panel, Cheryl Kaba, Ethan Marotz, and Malena Previ explore the challenges and opportunities in designing responsibly with AI. Cheryl highlights the tension between augmentation and automation, urging critical thinking about long-term impacts, especially in education where AI risks de-skilling teachers. Ethan emphasizes AI's effect on labor, discussing the shift from skilled work to supervisory roles and the need for protections and unionization amid workplace transformations. Malena stresses ethical AI practices focused on transparency, equity, and power dynamics, advocating for participative design that includes marginalized communities. The panel debates transparency in AI confidence scores, sustainability concerns, and navigating hype cycles surrounding AI. Ultimately, they call for intentional conversations about power, ethics, and technology's impact on labor and society, urging practitioners to critically assess who benefits from AI and engage stakeholders in shaping its future.
Key Insights
-
•
AI currently serves mostly narrow use cases but has broader systemic implications.
-
•
Designers are shifting into supervisory roles overseeing AI output, raising concerns about de-skilling.
-
•
Augmentation and automation exist on a continuum; many AI tools initially augment but risk full automation.
-
•
Transparency around AI confidence has diminished compared to earlier systems like Watson.
-
•
Ethical AI design requires incorporating multiple stakeholders, especially marginalized groups, in feedback loops.
-
•
Sustainability is often overlooked in AI discussions despite significant environmental impacts.
-
•
Power dynamics in AI design influence who benefits and who bears risks, and must be explicitly addressed.
-
•
Content designers can evolve by focusing on AI explainability and risk mitigation roles.
-
•
Unionization and labor protections are critical to address AI’s effect on job security and work roles.
-
•
Effective ethical frameworks in AI combine principles with practical design exercises tailored to context.
Notable Quotes
"We’re in this initial stage of tinkering just to make AI behave the way we expect."
"The supervisory role that designers take over AI output signals a potential de-skilling of labor."
"We want augmentation, not automation, but the trajectory may lead us to automation anyway."
"Who gets to decide where the line is between augmentation and replacement by AI?"
"It’s important to design AI ‘with’ users, not just ‘for’ them, especially marginalized communities."
"Microsoft missed their sustainability goals because of AI’s increased carbon emissions."
"There are zero feedback loops if the people impacted by AI are not involved in its design."
"Ethics is not just about compliance; it’s about doing the right thing holistically."
"Most fears about AI are actually fears about capitalism and power."
"If you have concerns about your role with AI, have a conversation with your coworkers."
Or choose a question:
More Videos
"Users’ perception predicts attrition and paid referrals — design absolutely matters when people decide to buy or go."
Standardizing Product Merits for Leaders, Designers, and Everyone
June 15, 2018
"You can mine metadata from your platform to spot emerging patterns and commoditize new components."
Simon WardleyMaps and Topographical Intelligence (Videoconference)
January 31, 2019
"White supremacy is the belief system of the superiority of whiteness that can embed itself in algorithms."
Sandra CamachoCreating More Bias-Proof Designs
January 22, 2025
"When fellow co-workers label an individual as difficult, it’s hard not to treat that person as a problem."
Darian DavisLessons from a Toxic Work Relationship
January 8, 2024
"We mitigated data privacy risks by subscribing to the corporate plan for ChatGPT, which offers enhanced security."
Fisayo Osilaja[Demo] The AI edge: From researcher to strategist
June 4, 2024
"There is a common thread in craft: dignity, purpose, utility, and beauty."
Uday GajendarThe Wicked Craft of Enterprise UX
May 13, 2015
"There is no design team responsible for the overarching experience across the entire company."
Davis Neable Guy SegalHow to Drive a Design Project When you Don’t Have a Design Team
June 10, 2021
"People felt designs were self-evident and too much explanation was a barrier to using the patterns."
Eniola OluwoleLessons From the DesignOps Journey of the World's Largest Travel Site
October 24, 2019
"The operational glue that binds strategy, execution, and measurement in design is often missing, and that’s critical for scaling."
Aurobinda Pradhan Shashank DeshpandeIntroduction to Collaborative DesignOps using Cubyts
September 9, 2022
