This video is featured in the AI and UX playlist.
Summary
What we design is changing; therefore, how we design is also changing. Design innovation is being affected by emerging AI technologies. In this talk, I will set the context for the role of design in creating purposeful and pragmatic technology, both historically and today. I will talk about some of the problems with AI innovation and I will show some examples from our research showing the impact of design in creating, developing, and deploying AI systems, with the goal of creating better social systems, better economic relations, and a better world in which to live.
Key Insights
-
•
AI is transforming not only products but entire service ecologies, blending tangible and intangible elements via datafication.
-
•
A large majority of AI products fail due to poor model performance, lack of clear service value, low desirability, or ethical risks.
-
•
Designers often join AI product development too late, after data and models are already chosen, limiting innovation potential.
-
•
New design methods are needed that start with AI data sets or capabilities instead of user-centered approaches alone.
-
•
Algorithmic management in hospitality reduces worker autonomy and risks poor task assignment without contextual understanding.
-
•
Involving workers in co-design processes can increase their sense of agency, improve transparency, and lead to better AI tool adoption.
-
•
AI performance does not need to be perfect; moderately accurate AI applied wisely can create significant user value.
-
•
Privacy and ethical risk management in AI development is often unassigned but should be integral and early in product design.
-
•
There is a taxonomy of AI capabilities that can serve as design patterns to help translate technical possibilities into user interactions.
-
•
The hospitality industry’s complexity—multiple management entities and social-emotional labor—makes AI implementation especially challenging and in need of holistic design thinking.
Notable Quotes
"Data has been described as the new oil, and AI has been likened to electricity, poised to transform everything."
"We should think of AI as our ancestor encountered fire: managed well it’s a force for good, deployed recklessly it will burn us."
"You would never implement an algorithm on a doctor without consulting them, yet in hospitality, workers face algorithmic managers daily."
"AI products typically fail because teams can't achieve model performance or the data is poor or unavailable."
"Sophisticated AI isn’t always needed; sometimes what’s really needed is a better website, not a fancy chatbot."
"Moderately good AI can add real value, like voicemail transcription that doesn't have to be perfect to be useful."
"Technology is often blamed, but many issues come from uneven training, misunderstandings, and poor configurations."
"Designers are becoming managers, ethicists, and advocates as the complexity of AI products grows."
"Empowering workers in AI design can help them develop new skills and increase satisfaction."
"AI ethics teams at Facebook and small companies will look very different; there’s no one size fits all approach."
Or choose a question:
More Videos
"Democratization is not research anarchy where anybody can talk to any customer for any reason with no oversight."
Jemma Ahmed Steve Carrod Chris Geison Dr. Shadi Janansefat Christopher NashDemocratization: Working with it, not against it [Advancing Research Community Workshop Series]
July 24, 2024
"Design systems are not just UI components but people and culture working together."
Nina JurcicThe Design System Rollercoaster: From Enabler and Bottleneck to Catalyst for Change
October 3, 2023
"Design principles are guiding tools for conversation rather than strict rules with objective scores."
Nathan Curtis Nalini P. Kotamraju Jack Moffett Dawn ResselDiscussion
June 9, 2016
"If we are working on something that does not ladder up to our KSPs, then we should not be working on it."
Saara Kamppari-Miller Nicole Bergstrom Shashi JainKey Metrics: Comparing Three Letter Acronym Metrics That Include the Word “Key”
November 13, 2024
"The re-platforming journey is transformative not just for the product, but for the people and teams involved."
Malini RaoLessons Learned from a 4-year Product Re-platforming Journey
June 9, 2021
"We use a magic R studio button that, with one click, processes all the survey data automatically."
Mackenzie Cockram Sara Branco Cunha Ian FranklinIntegrating Qualitative and Quantitative Research from Discovery to Live
December 16, 2022
"Recordings and video decks will be shared on the conference site within hours of each presentation."
Bria AlexanderOpening Remarks
June 9, 2021
"Growth boards are a lean governance tool borrowed from the mindset of venture capital."
Jackie HoLead Effectively While Preserving Team Autonomy with Growth Boards
January 8, 2024
"Private cars are parked 95% of the time, making them highly inefficient in urban environments."
Dan HillDesigning for the infrastructures of everyday life
June 4, 2024