Operationalizing Responsible, Human-Centered AI
This video is featured in the AI and UX playlist.
Summary
AI-enabled systems that are responsible and human-centered, will be powerful partners to humans. Making systems that people are willing to be responsible for, and that are trustworthy to those using them enables that partnership. Carol will share guidance for operationalizing the work of making responsible human-centered AI systems based on UX research. She will share methods for UX teams to support bias identification, prevent harm, and support human-machine teaming through design of appropriate evidence of system capabilities and integrity through interaction design. Once these dynamic systems are out in the world, critical oversight activities are needed for AI systems to continue to be effective. This session will introduce each of these complex topics and provide references for further exploration of these exciting issues.
Key Insights
-
•
Responsible AI systems require humans to retain ultimate responsibility and control.
-
•
Bias in AI data is inevitable, but awareness and mitigation of harmful bias is crucial.
-
•
Human-machine teaming must be designed with clear responsibilities and transparency.
-
•
AI systems are dynamic and constantly evolving, making continuous oversight essential.
-
•
Speculative exercises like 'What Could Go Wrong' support anticipating harms proactively.
-
•
Calibrated trust in AI means users neither overtrust nor undertrust the system.
-
•
Ethical frameworks such as the Three Q Do No Harm help plan for impact on vulnerable groups.
-
•
Diverse teams improve innovation by being more aware of biases and ethical variation.
-
•
UX practitioners should understand AI concepts to effectively contribute without needing deep technical skills.
-
•
Designing safe AI includes making unsafe actions difficult and safe states easy to maintain.
Notable Quotes
"Responsible systems are systems that keep humans in control."
"Data is a function of our history; it reflects priorities, preferences, and prejudices."
"AI will ensure appropriate human judgment, not replace it."
"We want people to gain calibrated levels of trust, not overtrust or undertrust."
"If the system is not confident, it should transparently communicate that and hand off to humans."
"Ethical design is not superficial; if we don't ask the tough questions, who will?"
"We need to be uncomfortable and get used to asking hard questions about AI."
"Humans are still better at many activities and those strengths should be prioritized."
"Adopting technical ethics gives teams permission to question implications beyond opinions."
"These systems aren’t stable like old software; they change as data and models evolve."
Or choose a question:
More Videos
"You have to go from being able to deliver a message in three bullets and then turn around in the next moment and deliver a massive service blueprint or customer journey."
John CutlerOxbows, Rivers, and Estuaries: How to navigate the currents of change (without burning out)
December 3, 2024
"A common toxic behavior is glory seeking, like presenting work as your own when it was a team effort."
Darian DavisLessons from a Toxic Work Relationship
January 8, 2024
"Executive air cover is having someone in a senior role who protects and supports the design team from other business pressures."
Dave GrayGroup Activity: Making Sense of DesignOps
November 7, 2017
"Executives only like things in threes, but if you do a three by three, you can get away with nine boxes—that's the max executive information processing."
John CutlerThe Alignment Trap
November 29, 2023
"Diagrams are life rafts crossing the sea of volatility, helping to get everyone on the same page."
Abby CovertStuck? Diagrams Help
October 27, 2022
"Use four simple questions to find out what people really want and why — it avoids misaligned efforts."
Mark InterranteCollaboration Flows in Product Development
June 9, 2017
"The future will be struggle; we need to face that forward, not deny it."
Devon PowersImagining Better Futures
March 9, 2022
"Share your learning quickly and often—don’t wait for big reports. Your deliverable as a designer doing research is the design itself."
Prayag NarulaHow to Empower Your Designers to Do Good Research – And Why You Want To
June 10, 2022
"If you build for the next model, even if it can hardly do something now, it will probably do it well in the future."
Peter Van DijckHands on AI #3: Claude Code for UX people
October 22, 2025
Latest Books All books
Dig deeper with the Rosenbot
How can play help overcome the ‘messy middle’ between research insights and decision-making in organizations?
What are the challenges and opportunities posed by democratization of user research within organizations?
How do enterprises balance qualitative and quantitative tools while integrating AI into UX research workflows?