Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Operationalizing Responsible, Human-Centered AI
Gold
Wednesday, June 7, 2023 • Enterprise UX 2023

This video is featured in the AI and UX playlist.

Share the love for this talk
Operationalizing Responsible, Human-Centered AI
Speakers: Carol Smith
Link:

Summary

AI-enabled systems that are responsible and human-centered, will be powerful partners to humans. Making systems that people are willing to be responsible for, and that are trustworthy to those using them enables that partnership. Carol will share guidance for operationalizing the work of making responsible human-centered AI systems based on UX research. She will share methods for UX teams to support bias identification, prevent harm, and support human-machine teaming through design of appropriate evidence of system capabilities and integrity through interaction design. Once these dynamic systems are out in the world, critical oversight activities are needed for AI systems to continue to be effective. This session will introduce each of these complex topics and provide references for further exploration of these exciting issues.

Key Insights

  • Responsible AI must keep humans in ultimate control, ensuring accountability and trust.

  • AI systems reflect inherent human biases present in training data and algorithms, making complete objectivity impossible.

  • Speculative design and harm anticipation help prevent or mitigate unintended negative consequences in AI systems.

  • Human-machine teaming requires clear responsibilities, transparency, and trust calibration to avoid overtrust or distrust.

  • Continuous and critical oversight is essential to manage AI's dynamic, evolving nature and changing contexts over time.

  • Diverse teams with psychological safety are more likely to spot biases, innovate, and engage in ethical conversations.

  • Technical ethics frameworks like the Montreal Declaration enable teams to navigate ethical dilemmas beyond personal opinions.

  • Real-world AI systems are dynamic and can change with retraining and new data; stable expectations are unrealistic.

  • Designing for usability includes making unsafe actions difficult and safe actions easy, supporting safe human control.

  • AI systems must allow humans to override and unplug them, especially in high-stakes decisions involving life, health, and reputation.

Notable Quotes

"Responsible systems are systems that keep humans in control."

"Data is a function of our history; it is not inherently neutral and always flawed."

"We want to reduce unintended or harmful bias and make sure we are aware of that bias."

"AI will ensure appropriate human judgment, not replace it."

"Trust is personal, complex, and transient; it cannot be easily measured."

"Humans are still better at many activities and we need to prioritize for that."

"If you don’t understand how the system works, why would you use it or want it critical to your business?"

"Speculation is a key aspect of this work to keep people safe and prevent harm."

"These systems aren’t stable like the old software on a CD; they are dynamic and constantly evolving."

"Adopting technology ethics gives teams a way to talk about issues rather than just opinions."

Ask the Rosenbot
Amy Marquez
INVEST: Discussion
2018 • Enterprise Experience 2018
Gold
Jacqui Frey
Scale is Social Work (Videoconference)
2020 • DesignOps Community
Dan Ward
Failure Friday #1 with Dan Ward
2025 • Rosenfeld Community
Susan Weinschenk
Evaluating the Maturity of UX in Your Organization (Videoconference)
2020 • Enterprise Community
Jodi Forlizzi
Design and AI innovation
2024 • Designing with AI 2024
Gold
Andy Polaine
What is the role of service design in product-led organizations?
2024 • Advancing Service Design 2024
Gold
PJ Buddhari
Meet Spectrum, Adobe’s Design System
2021 • Design at Scale 2021
Gold
Johanna Kollmann
Insights-Driven Product Strategy: Get your Research to Count
2022 • Design in Product 2022
Gold
William Newton
How to Lead With Data, and Without Data
2023 • Enterprise UX 2023
Gold
Patrizia Bertini
Pushing DesignOps’ Influence into New Global Markets
2022 • DesignOps Summit 2022
Gold
Jacqui Frey
Panel Discussion: Integrating DesignOps
2018 • DesignOps Summit 2018
Gold
James Chudley
Decarbonising User Journeys: How minimising enables us to do more with less
2025 • Climate UX Interest Group (Rosenfeld Community)
Mariah Hay
BUILD: Discussion
2018 • Enterprise Experience 2018
Gold
Mohammad Hossein Jarrahi
Contextuality problem: Exploring the Benefits of Qualitative and Quantitative Research
2023 • QuantQual Interest Group (Rosenfeld Community)
Peace is waged with sticky notes: Mapping Real-World Experiences
2018 • Enterprise Experience 2018
Gold
Prayag Narula
How to Empower Your Designers to Do Good Research – And Why You Want To
2022 • Design at Scale 2022
Gold

More Videos

Jennifer Kanyamibwa

"I titled my speech a blueprint because it’s a series of lessons I’ve learned throughout my career."

Jennifer Kanyamibwa

Creating the Blueprint: Growing and Building Design Teams

November 8, 2018

Brigette Metzler

"Maintaining a repo often requires 100% manual participation from researchers and that can be hard to enforce and monitor."

Brigette Metzler Dana Chrisfield

Research Repositories: A global project by the ResearchOps Community (Videoconference)

August 27, 2020

Carl Turner

"We converted process boxes directly into user stories to create a common language for the team."

Carl Turner

You Can Do This: Understand and Solve Organizational Problems to Jumpstart a Dead Project

March 28, 2023

John Mortimer

"People appreciate when you acknowledge your limitations in blending into an organization."

John Mortimer Milan Guenther Lucy Ellis Patrick Quattlebaum

Panel Discussion

December 3, 2024

Dante Guintu

"The hardest lesson: being comfortable when you’re uncomfortable and figuring out how to create the most impact."

Dante Guintu

How to Crush the Talent Crunch

September 8, 2022

Richard Buchanan

"Design is a service profession, a humble profession, less significant than the lives of the people we serve."

Richard Buchanan

Creativity and Principles in the Flourishing Enterprise

June 15, 2018

Dan Willis

"Normally the theme leader would be talking about sleep deprivation because we’re overstimulated and excited by the talks."

Dan Willis

Theme 3: Intro

January 8, 2024

Dan Ward

"Failure cake helped us eat our feelings and provided comfort during hard moments."

Dan Ward

Failure Friday #1 with Dan Ward

February 7, 2025

Chris Geison

"We don't just need to do a better job of articulating our value. We need to become more valuable."

Chris Geison

Theme Two Intro

March 28, 2023