Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Operationalizing Responsible, Human-Centered AI
Gold
Wednesday, June 7, 2023 • Enterprise UX 2023

This video is featured in the AI and UX playlist.

Share the love for this talk
Operationalizing Responsible, Human-Centered AI
Speakers: Carol Smith
Link:

Summary

AI-enabled systems that are responsible and human-centered, will be powerful partners to humans. Making systems that people are willing to be responsible for, and that are trustworthy to those using them enables that partnership. Carol will share guidance for operationalizing the work of making responsible human-centered AI systems based on UX research. She will share methods for UX teams to support bias identification, prevent harm, and support human-machine teaming through design of appropriate evidence of system capabilities and integrity through interaction design. Once these dynamic systems are out in the world, critical oversight activities are needed for AI systems to continue to be effective. This session will introduce each of these complex topics and provide references for further exploration of these exciting issues.

Key Insights

  • Responsible AI must keep humans in ultimate control, ensuring accountability and trust.

  • AI systems reflect inherent human biases present in training data and algorithms, making complete objectivity impossible.

  • Speculative design and harm anticipation help prevent or mitigate unintended negative consequences in AI systems.

  • Human-machine teaming requires clear responsibilities, transparency, and trust calibration to avoid overtrust or distrust.

  • Continuous and critical oversight is essential to manage AI's dynamic, evolving nature and changing contexts over time.

  • Diverse teams with psychological safety are more likely to spot biases, innovate, and engage in ethical conversations.

  • Technical ethics frameworks like the Montreal Declaration enable teams to navigate ethical dilemmas beyond personal opinions.

  • Real-world AI systems are dynamic and can change with retraining and new data; stable expectations are unrealistic.

  • Designing for usability includes making unsafe actions difficult and safe actions easy, supporting safe human control.

  • AI systems must allow humans to override and unplug them, especially in high-stakes decisions involving life, health, and reputation.

Notable Quotes

"Responsible systems are systems that keep humans in control."

"Data is a function of our history; it is not inherently neutral and always flawed."

"We want to reduce unintended or harmful bias and make sure we are aware of that bias."

"AI will ensure appropriate human judgment, not replace it."

"Trust is personal, complex, and transient; it cannot be easily measured."

"Humans are still better at many activities and we need to prioritize for that."

"If you don’t understand how the system works, why would you use it or want it critical to your business?"

"Speculation is a key aspect of this work to keep people safe and prevent harm."

"These systems aren’t stable like the old software on a CD; they are dynamic and constantly evolving."

"Adopting technology ethics gives teams a way to talk about issues rather than just opinions."

Helen Armstrong
Augment the Human. Interrogate the System.
2023 • Enterprise UX 2023
Gold
Kim Holt
A Salesforce Panel Discussion on Values-Driven DesignOps
2022 • DesignOps Summit 2022
Gold
Aditi Ruiz
A PM State of Mind: Empathy Mapping Your Product Manager, Pt. 1
2022 • Design in Product 2022
Gold
Dalia El-Shimy
So You've Got a Seat at the Table. Now What?
2020 • Advancing Research 2020
Gold
Peter Merholz
Design at Scale is People!
2021 • Design at Scale 2021
Gold
Abbey Smalley
Scaling UX Past the Size of Your Team
2024 • Enterprise Experience 2020
Gold
Kristen Guth, Ph.D.
Out of the FOG: A Non-traditional Research Approach to Alignment
2023 • Advancing Research 2023
Gold
Deirdre Hirschtritt
Research is Only as Good as the Relationships You Build
2022 • Civic Design 2022
Gold
Dr. Jamika D. Burge
How UX researchers can partner with (and not be replaced by) AI [Advancing Research Community Workshop Series](Videoconference)
2023 • Advancing Research Community
Indi Young
Thinking styles: Mend hidden cracks in your market
2025 • Rosenfeld Community
Catt Small
Moving from Execution to Strategy as a Designer
2022 • Design in Product 2022
Gold
Neil Barrie
Widening the Aperture: The Case for Taking a Broader Lens to the Dialogue between Products and Culture
2024 • Advancing Research 2024
Gold
Ana Ferreira
Designing Distributed: Leading Doist’s Fully Remote Design Team in Six Countries
2024 • DesignOps Summit 2020
Gold
This Game is Never Done: Design Leadership Techniques from the Video Game World
2017 • DesignOps Summit 2017
Gold
Savannah Carlin
[Case Study] Don't botch the bot: Designing interactions for AI
2024 • Designing with AI 2024
Gold
Samuel Proulx
Designing beyond caricatures: Embracing real, diverse user needs
2024 • Advancing Service Design 2024
Gold

More Videos

Bria Alexander

"Dave Malouf dropped that term Design Ops on me in 2017."

Bria Alexander Louis Rosenfeld

Welcome

September 8, 2022

Mike Oren

"Pharmaceutical research is all about failing ideas as quickly and cheaply as possible."

Mike Oren

Why Pharmaceutical's Research Model Should Replace Design Thinking

March 28, 2023

Jodi Forlizzi

"You would never implement an algorithm on a doctor without consulting them, yet in hospitality, workers face algorithmic managers daily."

Jodi Forlizzi

Design and AI innovation

June 5, 2024

Bria Alexander

"If you ever feel uncomfortable or subjected to bullying, please let us know. It’s very important to keep the vibes positive."

Bria Alexander

Opening Remarks

October 3, 2023

Michael Weir

"Facial coding AI isn't smart enough to know if someone is smiling because they're happy or uncomfortable."

Michael Weir

Mixed Methods and Behavioural Science (Videoconference)

May 26, 2023

Molly Fargotstein

"We created one-pagers — lightweight, skimmable documents — to help people from all areas quickly understand research insights."

Molly Fargotstein

Multipurpose Communication & UX Research Marketing (Videoconference)

September 12, 2019

Verónica Urzúa

"Tools and practices are not neutral; they are cross-contextual and situational."

Verónica Urzúa Jorge Montiel

The B-side of the Research Impact

March 12, 2021

Husani Oakley

"I worked at an interactive information rich dynamic customer relationship management firm — it was my way of explaining what we did."

Husani Oakley

Theme Two Intro

June 6, 2023

George Abraham

"You get real coded components and layouts that developers can drag, drop, and extend immediately without rebuilding."

George Abraham Stefan Ivanov

Design Systems To-Go: Reimagining Developer Handoff, and Introducing App Builder (Part 2)

October 1, 2021