Summary
In this panel, Lisa Welchman, Kenneth Bowles, and Dan Rosenberg engage in a deep conversation about the evolving role of designers and UX professionals as AI increasingly impacts their work and the broader society. Kenneth stresses the dual meaning of responsibility, emphasizing that designers must consider users, society, and their profession, not just immediate clients. Dan highlights the risk of blind faith in AI tools, cautioning about ‘garbage in, garbage out’ and the importance of human judgment in design decisions. Lisa points out the commoditization of design work driven partially by the profession itself, warning of potential disintermediation and urging designers to reclaim their agency by understanding business and technology deeply. They all agree on the imperative for designers to engage with emerging technologies proactively rather than resist. Collaboration across disciplines, especially with data science, and addressing structural organizational silos are critical to responsibly guide AI’s integration. The panel also touches on designing for unpredictable AI error states, ethical mitigation strategies, and the importance of preserving human judgment and values in the face of increasing automation. The talk concludes with a call to action for designers to become technologically literate, ethically engaged, and to actively shape the trajectory of AI to benefit society.
Key Insights
-
•
Designers have a professional obligation to consider not only users but also society and their own profession when creating AI-driven products.
-
•
Human judgment remains essential in AI-assisted design, as current AI cannot reliably make complex ethical or strategic decisions.
-
•
There is a real threat of designers losing influence as companies might opt to replace human judgment with cheaper, AI-driven decision-making.
-
•
Commoditization of UX work through automation and componentization has weakened designers’ power in the industry.
-
•
Effective design leadership requires a deep understanding of business, technology, and the broader organizational ecosystem.
-
•
Collaboration between designers, data scientists, and other disciplines is crucial to address AI biases and ensure high-quality data inputs.
-
•
Designing for AI requires anticipating infinite error states and building capacity for ethical mitigation, which demands organizational space and time.
-
•
Middle management silos present a significant barrier to cross-disciplinary collaboration necessary for responsible AI integration.
-
•
The best designers move upstream, becoming product strategists rather than focusing solely on surface interaction design.
-
•
Technological literacy for designers is critical to maintaining relevance and effectively shaping future workflows with AI and beyond.
Notable Quotes
"Designers have obligations not just to users or employers but also to society and to their own profession."
"I fear some company leaders will soon cut designers out of decision loops, believing AI can do it better."
"Garbage in, garbage out risk is very real when using AI for user research synthesis."
"There’s more to being human, even in business, than quickly answering questions or summing up data."
"If you don’t understand the business, you don’t deserve a seat in the C-suite."
"We’ve done a lot of self-commoditization by componentizing our work and making it easier to automate."
"It’s not about dropping human judgment, but about augmenting it responsibly with AI."
"Error states are essentially infinite in generative AI, so we need to design and test proactively for them."
"Middle management often preserves the status quo, making collaboration difficult in large enterprises."
"Now is the time to engage, understand, and influence AI’s trajectory before it’s too late."
Or choose a question:
More Videos
"Can you show me your process, not just your portfolio? That shows me your real design thinking."
Adam Cutler Karen Pascoe Ian Swinson Susan WorthmanDiscussion
June 8, 2016
"Playing politics in UX leadership is about maximizing relationships ethically to advance your agenda, not about being underhanded."
Peter MerholzThe Trials and Tribulations of Directors of UX (Videoconference)
July 13, 2023
"If you don’t tune it properly, sometimes you just don’t get what you want."
Lisa WelchmanCleaning Up Our Mess: Digital Governance for Designers
June 14, 2018
"Policy change is the backbone of effective climate strategies in urban areas."
Vincent BrathwaiteOpener: Past, Present, and Future—Closing the Racial Divide in Design Teams
October 22, 2020
"Growth and learning is your long term change management plan."
Brenna FallonLearning Over Outcomes
October 24, 2019
"Hip hop proves that we can re-animate spaces with highly generative communities that weren't built for us."
Tricia WangSpatial Collapse: Designing for Emergent Culture
January 8, 2024
"Delivering research in small, lean increments allowed us to iterate fast and reduce bias."
Edgar Anzaldua MorenoUsing Research to Determine Unique Value Proposition
March 11, 2021
"With proper maintenance, knowledge becomes a vehicle that probes the most hidden spaces of possibility and brings the best decisions to the surface."
Designing Systems at Scale
November 7, 2018
"The conversion design process creates collective knowledge, which gets reinfused to strengthen future experiments."
Erin WeigelGet Your Whole Team Testing to Design for Impact
July 24, 2024