Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Day 2 Panel

Gold
Wednesday, June 5, 2024 • Designing with AI 2024
Share the love for this talk
Day 2 Panel
Speakers: Sheryl Cababa , Ethan Marcotte and Milena Pribic
Link:

Summary

In this panel discussion, Cheryl Kaba, Ethan Marotz, and Meena Previ reflect on the challenges and opportunities of designing with AI. Cheryl highlights the need to think beyond narrow AI use cases, stressing long-term impacts and ethical considerations, especially in education where AI might replace teachers. Ethan points to AI shifting design roles to supervisory or editorial, raising concerns about de-skilling and labor protections, drawing parallels to recent labor strikes in creative industries. Meena emphasizes ethical AI practices, co-creation with stakeholders, and transparency, cautioning against blind acceptance of AI outputs. Together, they explore the importance of intentionality, participatory design, and power dynamics in AI systems, noting capitalism’s role in shaping AI's adoption and urging designers to critically engage in shaping AI’s future. The panel also discusses transparency in AI confidence, ethical frameworks beyond compliance, and the lifecycle of AI hype. They close with calls for conversations among coworkers about AI’s role, and critical questioning of who designs AI and for whom, advocating sustained reflection on AI's social and labor impacts.

Key Insights

  • AI design is currently in an experimental stage, often focused on narrow use cases rather than broad impacts.

  • The shift to AI often changes designers' roles from creators to supervisors, potentially leading to workforce de-skilling.

  • Ethical AI practices require active inclusion of marginalized groups in the design and feedback processes.

  • Transparency about AI confidence levels has decreased in modern chatbots, complicating trust and interpretation.

  • Designers must balance augmentation and automation carefully to avoid disempowerment and job losses.

  • Power dynamics are central to AI system design; systems should promote empowerment rather than control.

  • Sustainability and AI's environmental impact are often overlooked in technology discussions.

  • Ethical frameworks vary and should be adapted to specific communities and organizational goals rather than treated as universally equal.

  • Labor movements and unionization are relevant lenses to consider protections against AI-driven labor changes.

  • Effective AI integration requires intentional conversations and collective reflection among workplace stakeholders.

Notable Quotes

"We’re in this initial stage of tinkering, just trying to make the tech behave the way we expect it to."

"AI moves the practitioner into an editorial or supervisory role, which often signals de-skilling."

"We want AI to augment human skills like an electric bike, not replace them like a robotic vacuum cleaner."

"Who is designing these AI systems, why, and for whom? Are those most impacted even involved?"

"Designers need to have critical conversations with stakeholders about the direction and impacts of AI."

"Ethics is not just about compliance; it’s about doing the right thing holistically."

"Most people’s fears about AI are actually fears about capitalism."

"Transparency of AI’s confidence has mostly disappeared because generative AI is inherently confident by design."

"AI tools today are sandwiches in search of picnics—useful, but lacking killer applications yet."

"We need to redesign capitalism, but right now we don’t have time for that."

Ask the Rosenbot
Sam Proulx
Accessibility: An Opportunity to Innovate
2022 • Advancing Research 2022
Gold
Heidi Trost
When AI Becomes the User’s Point Person—and Point of Failure
2025 • Rosenfeld Community
Daniel Gloyd
Designing From the Inside Out: How Method Acting Can Inspire Design Research
2026 • Rosenfeld Community
Theresa Marwah
How Atlassian is Operationalizing Respect in Research
2020 • Advancing Research Community
Laine Riley Prokay
Carving a Path for Early Career DesignOps Practitioners
2022 • DesignOps Summit 2022
Gold
Maria Skaaden
Panel Discussion: Methodologies and Work Environments
2018 • DesignOps Summit 2018
Gold
Chris Geison
What is Research Strategy?: A Panel of Research Leaders Discuss this Emergent Question
2021 • Advancing Research Community
Lija Hogan
Contexts of Use: A Framework for Connection
2021 • Civic Design 2021
Gold
Louis Rosenfeld
Founder’s Welcome
2022 • Design in Product 2022
Gold
Nathan Curtis
Discussion
2016 • Enterprise UX 2016
Gold
Laura Schaefer
DesignOps: A Conduit for Inclusion
2022 • DesignOps Summit 2022
Gold
Shahrzad Samadzadeh
What Is My Value? Two Takes and Some Mistakes
2024 • Enterprise Experience 2020
Gold
Gregg Bernstein
Opportunistic Research with Gregg Bernstein
2019 • Advancing Research Community
Sarah Alvarado
How to make UX research leadership more effective [Advancing Research Community Workshop Series]
2023 • Advancing Research Community
Sam Proulx
To Boldly Go: The New Frontiers of Accessibility
2022 • Civic Design 2022
Gold
Cara Maritz
The Art of Extrapolation
2023 • Advancing Research 2023
Gold

More Videos

Erin Weigel

"People connect with other people, even through screens, so employee recommendations matter digitally too."

Erin Weigel

Real-world lessons to improve your conversion rates

June 26, 2024

Daniel Korczynski

"When you ask a question, try to ask one at a time so the model doesn't get lost."

Daniel Korczynski

Why AI Is Bad at Research (and how to make it actually useful)

March 10, 2026

Kim Lenox

"We set expectations for who is owner and who is contributor in asynchronous work so decisions can move forward."

Kim Lenox

Leading Distributed Global Teams

May 20, 2019

Brendan Jarvis

"Who do you see? Who do you not see? Why do you not see them?"

Brendan Jarvis

Framing Tomorrow by Questioning Today

June 8, 2022

Carol Massa

"Safety is the number one priority in healthcare design because if the patient is not stable, nothing else matters."

Carol Massa

Designing Health: Integrating Service Design, Technology, and Strategy to Transform Patient and Clinician Experiences

December 3, 2024

Dr Chloe Sharp

"There was a lot of communication needed around roles, especially since our software developer was external and not always involved in day-to-day decisions."

Dr Chloe Sharp

Using Evidence and Collaboration for Setting and Defending Priorities

November 29, 2023

Sarah Auslander

"We are the problem we’re trying to replace — some legacy digital systems we created 20 years ago are still running."

Sarah Auslander Betsy Ramaccia Gordon Ross

Insights Panel

November 18, 2022

Susan Simon-Daniels

"My job was to find out why. Why was he frowning? Why was he sighing?"

Susan Simon-Daniels

War Stories LIVE! Susan Simon-Daniels

March 30, 2020

Farid Sabitov

"By automating deliverables analysis, we saved 12 hours per week within one design team alone."

Farid Sabitov

Automatization for Large Enterprise Teams

January 8, 2024