Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Navigating the Ethical Frontier: DesignOps Strategies for Responsible AI Innovation
Gold
Monday, October 2, 2023 • DesignOps Summit 2023

This video is featured in the AI and UX playlist.

Share the love for this talk
Navigating the Ethical Frontier: DesignOps Strategies for Responsible AI Innovation
Speakers: Jay Bustamante
Link:

Summary

In the very realistic future of an AI-driven world, the responsible and ethical implementation of technology is paramount. In this session, we will dive into the crucial role of DesignOps practitioners in driving ethical AI practices. We'll tackle the challenge of ensuring AI systems align with user values, respect privacy, and avoid biases, while unleashing their potential for innovation. As a UX strategist and DesignOps practitioner, I understand the significance of integrating ethical considerations into AI development. I bring a unique perspective on how DesignOps can shape the future of AI by fostering responsible innovation. This session challenges the status quo by highlighting the intersection of DesignOps and ethics, advancing the conversation in our field and sparking thought-provoking discussions. Attendees will gain valuable insights into the role of DesignOps in navigating the ethical landscape of AI. They will learn practical strategies and best practices for integrating ethical frameworks into their AI development processes. By exploring real-world examples and case studies, attendees will be inspired to push the boundaries of responsible AI and make a positive impact in their organizations. Join me in this exciting session to chart the course for ethical AI, challenge conventional thinking, and explore the immense potential of DesignOps in driving responsible innovation.

Key Insights

  • Rushing AI deployment creates tech debt that compounds faster and causes more brand damage than traditional software issues.

  • DataWorks Plus facial recognition software caused a wrongful felony arrest due to untested bias and accuracy problems.

  • Multidisciplinary teams including legal, UX, ML engineers, researchers, domain experts, and ethicists are essential for ethical AI development.

  • Ethical AI requires asking pointed questions about data origin, bias testing, mitigation, ongoing monitoring, and user feedback.

  • Prototyping AI behavior against varied user personas and scenarios helps identify bias and technical flaws early.

  • Ethical stress testing simulates difficult scenarios (e.g., autonomous vehicle ethics) to verify AI alignment with values.

  • AI systems continuously learn from user input and environment, so ethical iteration is needed to prevent degradation or bias amplification.

  • MidJourney’s AI image generation reflects data biases, repeatedly stereotyped CEOs as white men despite prompt adjustments.

  • Leaders failing to acknowledge AI’s risks risk organizational and reputational harm, as seen in stock impacts like Siemens vs. Nvidia.

  • Design ops leaders can use concrete examples of AI harm to build alliances and push for ethical practices across teams.

Notable Quotes

"AI tech debt has compounding interest to it — rushing to market can seriously harm your product and brand."

"Robert was arrested because an AI matched his driver's license photo to a burglary suspect, but it was a false positive."

"DataWorks Plus does not formally measure their system for accuracy or bias — that was the root of Robert's wrongful arrest."

"We’re the solution — people like you and me can ensure harmful AI mistakes don’t keep happening."

"As a party planner, your role is to ensure all the right people are invited to the AI development process."

"Machine learning engineers bring AI to life — they’re responsible for making it real."

"MidJourney’s AI showed white men consistently as CEOs and professors, revealing systemic bias in training data."

"Ethical stress testing subjects AI to hard hypothetical scenarios, like autonomous cars weighing risks between passengers and pedestrians."

"Your AI is learning from real-world input — sometimes from untrusted sources — so ethical iteration is essential."

"If you’re ensuring the right people are involved, asking the right questions, and focusing on ethics, you’re doing your part to prevent harms like Robert’s case."

Ask the Rosenbot
Steve Portigal
Discussion
2015 • Enterprise UX 2015
Gold
Emily Danielson
“I mean, I can lift a shovel”: Design Skills in Disaster Response
2022 • Design at Scale 2022
Gold
Sarah Sgarlato Pierini
From Passion to Execution: A Story of Evolving Research Maturity at LinkedIn
2022 • DesignOps Summit 2022
Gold
Marjorie Stainback
What Research Ops Professionals Have Learned from COVID-19 (Videoconference)
2020 • Advancing Research Community
Joel Branch
Humanizing AI: Filling the Gaps with Multi-faceted Research
2021 • Advancing Research 2021
Gold
Indi Young
Thinking styles: Mend hidden cracks in your market
2025 • Rosenfeld Community
Bram Wessel
Enterprise Information Architecture (Videoconference)
2020 • Enterprise Community
Vincent Brathwaite
Opener: Past, Present, and Future—Closing the Racial Divide in Design Teams
2020 • DesignOps Summit 2020
Gold
Sam Ladner
Methodologies: Beyond the interview [Advancing Research Community Workshop Series]
2024 • Advancing Research Community
Mandy Drew
What Role(s) Can Research Play in Responsible Design?
2021 • Advancing Research 2021
Gold
Aurobinda Pradhan
Introduction to Collaborative DesignOps using Cubyts
2022 • DesignOps Summit 2022
Gold
Isaac Heyveld
Expand DesignOps Leadership as a Chief of Staff
2022 • DesignOps Summit 2022
Gold
Miles Orkin
Creativity and Culture
2018 • DesignOps Summit 2018
Gold
Bryce Benton
[Demo] AI-powered UX enhancement: Aligning GitHub documentation with USWDS at Austin Public Library
2024 • Designing with AI 2024
Gold
Jennifer Kong
[Case study] Journeying toward AI-assisted documentation in healthcare
2024 • Designing with AI 2024
Gold
Sarah Brooks
Fireside chat with Sarah Brooks and Jen Pahlka (Videoconference)
2021 • Civic Design Community

More Videos

Angelos Arnis

"Collaboration should include stakeholders often not traditionally represented, like marketing, sales, and customer support."

Angelos Arnis

Navigating the Rapid Shifts in Tech's Turbulent Terrain

October 2, 2023

John Calhoun

"You have to grow design ops capabilities in tandem with the design team to avoid organizational mismatches."

John Calhoun Rachel Posman

Bring your DesignOps Story to Life! The Definitive DesignOps Book Jam

October 3, 2023

Alfred Kahn

"Usability testing is the gateway drug for research; similarly, small measurements are the gateway for strategic design impact."

Alfred Kahn

A Seat at the Table: Making Your Team a Strategic Partner

November 29, 2023

Dan Willis

"It’s never all or nothing — product success must balance user needs and business constraints."

Dan Willis

Enterprise Storytelling Sessions

June 3, 2019

John Maeda

"The pain you feel in driving change is the pain of growth—you have to sign up for it and keep going."

John Maeda Alison Rand

About Design Organizations (Videoconference)

May 13, 2019

Anat Fintzi

"Engineers now ask better questions and make more informed design and technology decisions with the context we provided."

Anat Fintzi Rachel Minnicks

Delivering at Scale: Making Traction with Resistant Partners

June 9, 2022

Uday Gajendar

"Craft should evolve from making a beautiful final object to serving as a facilitative anchor in enterprise UX."

Uday Gajendar

The Wicked Craft of Enterprise UX

May 13, 2015

Kristin Skinner

"2020 was focused on resilience, collaboration challenges, burnout, and attrition during the pandemic."

Kristin Skinner

Theme 1 Intro

September 29, 2021

Maish Nichani

"Before stage in customer journey is so important—it sets customers up for success by making pages findable and clear through SEO and self-assessment tools."

Maish Nichani

Sparking a Service Excellence Mindset at a Government Agency

December 9, 2021