Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Operationalizing Responsible, Human-Centered AI
Gold
Wednesday, June 7, 2023 • Enterprise UX 2023

This video is featured in the AI and UX playlist.

Share the love for this talk
Operationalizing Responsible, Human-Centered AI
Speakers: Carol Smith
Link:

Summary

AI-enabled systems that are responsible and human-centered, will be powerful partners to humans. Making systems that people are willing to be responsible for, and that are trustworthy to those using them enables that partnership. Carol will share guidance for operationalizing the work of making responsible human-centered AI systems based on UX research. She will share methods for UX teams to support bias identification, prevent harm, and support human-machine teaming through design of appropriate evidence of system capabilities and integrity through interaction design. Once these dynamic systems are out in the world, critical oversight activities are needed for AI systems to continue to be effective. This session will introduce each of these complex topics and provide references for further exploration of these exciting issues.

Key Insights

  • Responsible AI must keep humans in ultimate control, ensuring accountability and trust.

  • AI systems reflect inherent human biases present in training data and algorithms, making complete objectivity impossible.

  • Speculative design and harm anticipation help prevent or mitigate unintended negative consequences in AI systems.

  • Human-machine teaming requires clear responsibilities, transparency, and trust calibration to avoid overtrust or distrust.

  • Continuous and critical oversight is essential to manage AI's dynamic, evolving nature and changing contexts over time.

  • Diverse teams with psychological safety are more likely to spot biases, innovate, and engage in ethical conversations.

  • Technical ethics frameworks like the Montreal Declaration enable teams to navigate ethical dilemmas beyond personal opinions.

  • Real-world AI systems are dynamic and can change with retraining and new data; stable expectations are unrealistic.

  • Designing for usability includes making unsafe actions difficult and safe actions easy, supporting safe human control.

  • AI systems must allow humans to override and unplug them, especially in high-stakes decisions involving life, health, and reputation.

Notable Quotes

"Responsible systems are systems that keep humans in control."

"Data is a function of our history; it is not inherently neutral and always flawed."

"We want to reduce unintended or harmful bias and make sure we are aware of that bias."

"AI will ensure appropriate human judgment, not replace it."

"Trust is personal, complex, and transient; it cannot be easily measured."

"Humans are still better at many activities and we need to prioritize for that."

"If you don’t understand how the system works, why would you use it or want it critical to your business?"

"Speculation is a key aspect of this work to keep people safe and prevent harm."

"These systems aren’t stable like the old software on a CD; they are dynamic and constantly evolving."

"Adopting technology ethics gives teams a way to talk about issues rather than just opinions."

Ask the Rosenbot
Feleesha Sterling
Building a Rapid Research Program (Videoconference)
2023 • Enterprise Community
Shazia Ali
Communication: Innovative techniques for making your voice heard [Advancing Research Community Workshop Series]
2024 • Advancing Research Community
Bryce Benton
[Demo] AI-powered UX enhancement: Aligning GitHub documentation with USWDS at Austin Public Library
2024 • Designing with AI 2024
Gold
Bria Alexander
Opening Remarks
2024 • Advancing Research 2021
Gold
Alnie Figueroa
Teamwork: Strategies for Effective Collaboration with Other Program Management Teams
2022 • DesignOps Summit 2022
Gold
Sarah Flamion
Complex Problem? Add Clarity by Combining Research and Systems Thinking
2020 • Advancing Research 2020
Gold
Michael Weir
Mixed Methods and Behavioural Science (Videoconference)
2023 • Rosenfeld Community
Shipra Kayan
How we Built a VoC (Voice of the Customer) Practice at Upwork from the Ground Up
2021 • DesignOps Summit 2021
Gold
Uday Gajendar
Leading through the long tail of trauma (Videoconference)
2022 • Advancing Research Community
Cheryl Platz
Demystifying Multimodal Design: The Design Practice You Didn't Know You're Doing (Videoconference)
2024 • Rosenfeld Community
World Usability Day Panel Discussion (Videoconference)
2022 • DesignOps Community
Kristin Skinner
8 Types of Measures in Design Operations (Videoconference)
2020 • DesignOps Community
Susan Weinschenk
Evaluating the Maturity of UX in Your Organization (Videoconference)
2020 • Enterprise Community
Jonathan Fairman
Integrating generative AI into enterprise products: A case study from dscout
2024 • Designing with AI 2024
Gold
Gina Mendolia
Therapists, Coaches, and Grandmas: Techniques for Service Design in Complex Systems
2024 • Advancing Service Design 2024
Gold
Lena Shenkarenko
Collaborative Wireframing for Creating Team Alignment and Shipping Better Products
2020 • DesignOps Summit 2020
Gold

More Videos

Angelos Arnis

"In a landscape focusing on efficiency and profit, we need to help design transition from production to strategic focus."

Angelos Arnis

Navigating the Rapid Shifts in Tech's Turbulent Terrain

October 2, 2023

John Calhoun

"Design ops is about operationalizing, orchestrating, and optimizing people, process, and platform."

John Calhoun Rachel Posman

Bring your DesignOps Story to Life! The Definitive DesignOps Book Jam

October 3, 2023

Alfred Kahn

"We were allowed to taste the cake, not bake the cake; this process got UX into the kitchen."

Alfred Kahn

A Seat at the Table: Making Your Team a Strategic Partner

November 29, 2023

Dan Willis

"No matter how good I think I am at my job, it doesn’t make me a good parent."

Dan Willis

Enterprise Storytelling Sessions

June 3, 2019

John Maeda

"Design ops professionals need to embrace their role as agents of change, supporting others but often facing resistance."

John Maeda Alison Rand

About Design Organizations (Videoconference)

May 13, 2019

Anat Fintzi

"Engineers now ask better questions and make more informed design and technology decisions with the context we provided."

Anat Fintzi Rachel Minnicks

Delivering at Scale: Making Traction with Resistant Partners

June 9, 2022

Uday Gajendar

"The seven-foot-wide diagram showed the product’s true complexity, sparking necessary conversations with leadership."

Uday Gajendar

The Wicked Craft of Enterprise UX

May 13, 2015

Kristin Skinner

"We were really forming a community of people who I like to call maybe design ops curious."

Kristin Skinner

Theme 1 Intro

September 29, 2021

Maish Nichani

"You might feel like one of the blind men in the story when parts of a process don’t show the whole picture. That’s why you need the full journey exposed."

Maish Nichani

Sparking a Service Excellence Mindset at a Government Agency

December 9, 2021