Day 1 Panel
Summary
In this panel discussion, Lisa Welchman, Kenneth Bowles, and Dan Rosenberg delved into the evolving role of designers in the age of AI, emphasizing ethical responsibility and the societal impact of design decisions. Kenneth Bowles highlighted the dual nature of responsibility in design—both backward-looking accountability and forward-looking duty—calling for designers to consider not just users but broader social and environmental stakeholders. Dan Rosenberg raised concerns about the ‘faith in the black box’ of AI and the upstream governance needed to prevent harm. The panelists debated the risk of AI commoditizing design roles and disintermediating human judgment. Lisa urged designers to assert agency, understand business deeply, and resist passivity, arguing for bolder engagement with tech’s ethical trajectories. They stressed that human judgment and empathy remain irreplaceable, especially in complex fields like healthcare. The importance of collaboration across silos and anticipatory design to manage AI’s unpredictable error states was also discussed. The panel concluded with encouragement to designers to deepen tech literacy, engage in ethical mitigation early, and shape AI’s future rather than passively accept it.
Key Insights
-
•
Design responsibility extends beyond users to society, environment, and the profession itself, demanding broader ethical consideration.
-
•
AI introduces a risk of commoditizing design work, particularly routine interface tasks that AI can automate within 12 to 36 months.
-
•
Human judgment remains critical and must not be ceded to AI, especially for discriminatory decisions and ethical complexities.
-
•
Understanding and linking design work to business strategy and value is essential for designers to maintain influence at the C-suite level.
-
•
Designers have significant agency but must proactively engage with AI technologies to shape their trajectory rather than resist passively.
-
•
Cross-disciplinary collaboration, especially between designers and data scientists, is necessary but challenged by entrenched organizational silos.
-
•
Designers should anticipate and design for AI error states, recognizing generative AI’s infinite unpredictability.
-
•
Techno-determinism is a pervasive risk; designers must challenge the inevitability mindset by actively influencing AI's ethical direction now.
-
•
Empathy and the embodied human experience are unique human factors that AI may fake but cannot replicate authentically.
-
•
Elevating UX roles upstream into product strategy and business leadership can help protect against devaluation due to AI automation.
Notable Quotes
"Designers have obligations not just to users but also to society and our own profession."
"We often point fingers at the person making the most money from the mess that designers put through the system."
"Faith in the black box makes me uneasy; as designers, we must care about what happens behind the scenes."
"I don’t think any designers today would hand over judgmental decisions fully to AI."
"If you don’t understand business, you don’t deserve a seat at the C-suite table."
"People remember how you made them feel, and that’s something AI can fake but not truly replicate."
"The risk is that AI will cut designers out of decision making because it’s perceived as cheaper or faster."
"Middle management often blocks collaboration despite desires from people underneath to work together."
"We need to design for the many error states generative AI can produce, however unpredictable."
"Technology does not have a mind of its own; people with power set its trajectory and we can influence that."
Or choose a question:
More Videos
"Going from 100 to 200 people, suddenly product managers started hearing from a dozen people a week with conflicting requests."
Shipra KayanHow we Built a VoC (Voice of the Customer) Practice at Upwork from the Ground Up
September 30, 2021
"Most categories are fuzzy; there’s no clear boundary between what’s in or out."
Peter MorvilleThe Architecture of Understanding
May 13, 2015
"If you make a pretty page, that’s great. But if the users can’t actually use the page or they’re frustrated, you just have a pretty page."
Renee ReidBecoming a ResearchH.E.R (Highly Enterprise Ready)
June 3, 2019
"Gestures serve as a window into the embodied mind by replaying prior embodied experiences when we communicate."
Dane DeSutterKeeping the Body in Mind: What Gestures and Embodied Actions Tell You That Users May Not
March 26, 2024
"Involving people with disabilities from the start reveals impact and usability issues that automated testing simply cannot catch."
Sam ProulxOnline Shopping: Designing an Accessible Experience
October 3, 2023
"Younger visitors are nearly twice as likely to engage with digital chat or help but are less satisfied afterward."
Andrew Custage Michael MallettThe Digital Journey: Research on Consumer Frustration and Loyalty
March 29, 2023
"Be present, put devices down, turn off Slack notifications, and really engage."
Shelby SwitzerMaking Space for Community Knowledge-sharing in a Distributed World
December 10, 2021
"If we are haphazard about AI adoption and trust marketers over rigorous testing, it looks like all our hand wringing about research accuracy was just gatekeeping."
Llewyn PaineCoexisting with AI: A practical guide for researchers to navigate tools, ethics, and integration
March 11, 2025
"The only thing any of us can control is how quickly we learn and then act based on that learning."
Robin BeersNavigating organizational systems: Rethinking researcher’s role in driving change
March 13, 2025
Latest Books All books
Dig deeper with the Rosenbot
What strategies help UX teams translate usability findings into stakeholder-relevant outcomes like cost savings or risk reduction?
How does Rosenfeld Media ensure high quality and relevance across its Rosenverse offerings?
How does including metadata like methodology, market, and date improve the quality of research repository search results?