Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Navigating the Ethical Frontier: DesignOps Strategies for Responsible AI Innovation
Gold
Monday, October 2, 2023 • DesignOps Summit 2023

This video is featured in the AI and UX playlist.

Share the love for this talk
Navigating the Ethical Frontier: DesignOps Strategies for Responsible AI Innovation
Speakers: Jay Bustamante
Link:

Summary

In the very realistic future of an AI-driven world, the responsible and ethical implementation of technology is paramount. In this session, we will dive into the crucial role of DesignOps practitioners in driving ethical AI practices. We'll tackle the challenge of ensuring AI systems align with user values, respect privacy, and avoid biases, while unleashing their potential for innovation. As a UX strategist and DesignOps practitioner, I understand the significance of integrating ethical considerations into AI development. I bring a unique perspective on how DesignOps can shape the future of AI by fostering responsible innovation. This session challenges the status quo by highlighting the intersection of DesignOps and ethics, advancing the conversation in our field and sparking thought-provoking discussions. Attendees will gain valuable insights into the role of DesignOps in navigating the ethical landscape of AI. They will learn practical strategies and best practices for integrating ethical frameworks into their AI development processes. By exploring real-world examples and case studies, attendees will be inspired to push the boundaries of responsible AI and make a positive impact in their organizations. Join me in this exciting session to chart the course for ethical AI, challenge conventional thinking, and explore the immense potential of DesignOps in driving responsible innovation.

Key Insights

  • Rushing AI deployment creates tech debt that compounds faster and causes more brand damage than traditional software issues.

  • DataWorks Plus facial recognition software caused a wrongful felony arrest due to untested bias and accuracy problems.

  • Multidisciplinary teams including legal, UX, ML engineers, researchers, domain experts, and ethicists are essential for ethical AI development.

  • Ethical AI requires asking pointed questions about data origin, bias testing, mitigation, ongoing monitoring, and user feedback.

  • Prototyping AI behavior against varied user personas and scenarios helps identify bias and technical flaws early.

  • Ethical stress testing simulates difficult scenarios (e.g., autonomous vehicle ethics) to verify AI alignment with values.

  • AI systems continuously learn from user input and environment, so ethical iteration is needed to prevent degradation or bias amplification.

  • MidJourney’s AI image generation reflects data biases, repeatedly stereotyped CEOs as white men despite prompt adjustments.

  • Leaders failing to acknowledge AI’s risks risk organizational and reputational harm, as seen in stock impacts like Siemens vs. Nvidia.

  • Design ops leaders can use concrete examples of AI harm to build alliances and push for ethical practices across teams.

Notable Quotes

"AI tech debt has compounding interest to it — rushing to market can seriously harm your product and brand."

"Robert was arrested because an AI matched his driver's license photo to a burglary suspect, but it was a false positive."

"DataWorks Plus does not formally measure their system for accuracy or bias — that was the root of Robert's wrongful arrest."

"We’re the solution — people like you and me can ensure harmful AI mistakes don’t keep happening."

"As a party planner, your role is to ensure all the right people are invited to the AI development process."

"Machine learning engineers bring AI to life — they’re responsible for making it real."

"MidJourney’s AI showed white men consistently as CEOs and professors, revealing systemic bias in training data."

"Ethical stress testing subjects AI to hard hypothetical scenarios, like autonomous cars weighing risks between passengers and pedestrians."

"Your AI is learning from real-world input — sometimes from untrusted sources — so ethical iteration is essential."

"If you’re ensuring the right people are involved, asking the right questions, and focusing on ethics, you’re doing your part to prevent harms like Robert’s case."

Ask the Rosenbot
Saara Kamppari-Miller
Theme Three Intro
2022 • DesignOps Summit 2022
Gold
Megan Blocker
A Selectively Scrappy Approach to ResearchOps
2018 • DesignOps Summit 2018
Gold
Jennifer Bolduc
What's involved with getting people back to work?: A panel discussion (Videoconference)
2021 • DesignOps Community
Dan Hill
Strategic design, slowdown, and the infrastructures of everyday life (Videoconference)
2022 • Enterprise Community
Matt Bernius
Learnings from Applying Trauma-Informed Principles to the Research Process
2022 • Advancing Research 2022
Gold
Daniel J. Rosenberg
Designing with and for Artificial Intelligence (Videoconference)
2022 • Enterprise Community
Sam Proulx
Understanding Screen Readers on Mobile: How And Why to Learn from Native Users
2023 • DesignOps Summit 2023
Gold
Aaron Stienstra
Leveraging Civic Design to Advance Equity and Rebuild Trust in the US Federal Government
2021 • Civic Design 2021
Gold
Chris Geison
Theme Two Intro
2023 • Advancing Research 2023
Gold
Scott Jensen
Short Take #2: UX/Product Lessons from Your Industry Peers
2022 • Design in Product 2022
Gold
Jorge Arango
[Demo] How to re-categorize content at scale using LLMs
2024 • Designing with AI 2024
Gold
Eniola Oluwole
Lessons From the DesignOps Journey of the World's Largest Travel Site
2019 • DesignOps Summit 2019
Gold
Dr. Jamika D. Burge
The Future of Research: Bridging the Gaps (Videoconference)
2021 • Advancing Research Community
Julie Baher
Culture Change—My Journey
2015 • Enterprise UX 2015
Gold
Marjorie Stainback
Transforming Strategic Research Capacity through Democratization
2019 • DesignOps Summit 2019
Gold
Harry Max
Priority Zero: Some Things are More Equal than Others
2016 • Enterprise UX 2016
Gold

More Videos

Jennifer Kanyamibwa

"Transparency is building respect for what your teammates do."

Jennifer Kanyamibwa

Creating the Blueprint: Growing and Building Design Teams

November 8, 2018

Brigette Metzler

"We want to create clarity because lack of clarity is why we struggle with research repositories."

Brigette Metzler Dana Chrisfield

Research Repositories: A global project by the ResearchOps Community (Videoconference)

August 27, 2020

Carl Turner

"Hardest to uncover are the unconscious assumptions people make about how things should be done."

Carl Turner

You Can Do This: Understand and Solve Organizational Problems to Jumpstart a Dead Project

March 28, 2023

John Mortimer

"Connecting dots goes beyond just linking user experience; it’s about engagement with the organizational system."

John Mortimer Milan Guenther Lucy Ellis Patrick Quattlebaum

Panel Discussion

December 3, 2024

Dante Guintu

"Extended radio silence to candidates was unnerving and one of the unpleasant truths we heard from teammates."

Dante Guintu

How to Crush the Talent Crunch

September 8, 2022

Richard Buchanan

"Intuition is the ability to see a connection so important that you could build a system out of it."

Richard Buchanan

Creativity and Principles in the Flourishing Enterprise

June 15, 2018

Dan Willis

"Normally the theme leader would be talking about sleep deprivation because we’re overstimulated and excited by the talks."

Dan Willis

Theme 3: Intro

January 8, 2024

Dan Ward

"The Wright siblings had a sister, Catherine, who was a full participant and should also be remembered."

Dan Ward

Failure Friday #1 with Dan Ward

February 7, 2025

Chris Geison

"We don't just need to do a better job of articulating our value. We need to become more valuable."

Chris Geison

Theme Two Intro

March 28, 2023