Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Humanizing AI: Filling the Gaps with Multi-faceted Research
Gold
Thursday, March 11, 2021 • Advancing Research 2021
Share the love for this talk
Humanizing AI: Filling the Gaps with Multi-faceted Research
Speakers: Joel Branch
Link:

Summary

Artificial intelligence (AI) has graduated from science fiction to commoditized widget form, readily able to snap into many processes of daily life. Hence, enterprises of all maturity levels are increasingly eager to explore AI’s roles in their innovation, or outright survival strategies. Concurrently, ethical and responsible development and execution of AI-based solutions will increasingly become critical for purposes of safety and fairness. Ensuring that AI proliferates along the right path will require the infusion of multi-faceted research activities along the entire AI lifecycle. We will discuss the challenges and opportunities regarding this topic in this presentation.

Key Insights

  • Despite AI hype, up to 90% of enterprise data science projects never deploy into production.

  • Humanized AI requires governance frameworks that include non-engineering roles like product researchers and AI ethicists.

  • Black-box AI decisions limit trust and adoption due to opaque, probabilistic model reasoning.

  • The Gender Shades study revealed up to a 33% error rate disparity in facial recognition accuracy by gender and skin tone.

  • ML ops extends DevOps principles to AI, ensuring governance, accountability, validation, and feedback loops in model development.

  • Visualization research is critical to exploring high-dimensional data and identifying intersectional biases within training sets.

  • Explainability must evolve from feature importance scores towards causal, natural language rationales understandable to non-technical stakeholders.

  • AI trust depends on the system’s ability to engage in human-like back-and-forth explanations that users can scrutinize.

  • No-code and low-code AI tools are lowering the barrier to AI adoption but require careful governance to avoid perpetuating biases.

  • Cross-disciplinary, multi-faceted research collaborations between industry and academia remain essential as AI ethics and policies mature.

Notable Quotes

"I observe that AI development is often uninformed and hurried, resulting in deployments that don’t operate well in the real world."

"Humanizing AI is not just about creating human-like interfaces but about governance frameworks to democratize safe, effective AI solutions."

"Almost 90% of data science projects do not make it into production—they die on the vine."

"Black box decision making means information goes in, something comes out, and we really have no clue why."

"The Gender Shades project spurred Microsoft and IBM to revisit and correct bias issues in their facial recognition products."

"ML ops borrowed from DevOps offers governance, accountability, validation, and stakeholder responsibilities for AI development."

"Visualization helps analyze multi-dimensional data so non-engineers can identify wrong or biased datasets to avoid."

"Explainability techniques aim to turn numerical AI results into causally understandable, human-readable rationales."

"AI trust comes when AI can provide convincing explanations and engage in back-and-forth like a human advisor."

"Humanizing AI is necessary for safe, enjoyable, and competitive AI solutions, especially as governmental ethics policies mature."

Ask the Rosenbot
Richard Buchanan
Creativity and Principles in the Flourishing Enterprise
2018 • Enterprise Experience 2018
Gold
Kate Towsey
The State of ResearchOps: More Than Just Theory (Videoconference)
2019 • DesignOps Community
Christian Crumlish
Introduction by our Conference Chair
2022 • Design in Product 2022
Gold
Yoel Sumitro
Actions and Reflections: Bridging the Skills Gap among Researchers
2022 • Advancing Research 2022
Gold
Sam Proulx
Designing For Screen Readers: Understanding the Mental Models and Techniques of Real Users
2021 • DesignOps Summit 2021
Gold
Megan Nipe
Human-Centered Design for Engagement: Maturing from Newsletterville to Personalized, One-to-One Messaging
2021 • Civic Design 2021
Gold
Jamie Beck Alexander
How can you find your role in climate? (Videoconference)
2024 • Climate UX Interest Group (Rosenfeld Community)
Etienne Fang
The Power of Care: From Human-Centered Research to Humanity-Centered Leadership
2021 • Advancing Research 2021
Gold
Michal Anne Rogondino
Saving Outer Space: The First UX Design System for Our Nation’s Satellites
2024 • Enterprise Experience 2020
Gold
Josh Clark
Sentient Design: New Design Patterns for New Experiences (3rd of 3 seminars)
2025 • Rosenfeld Community
Gordon Ross
12 Months of COVID-19 Design and Digital Response with the British Columbia Government
2021 • Civic Design 2021
Gold
Christian Crumlish
AMA with Christian Crumlish, author of Product Management for UX People (Videoconference)
2022 • Enterprise Community
Marissa Cui
Climate Design Product Showcase (Videoconference)
2024 • Climate UX Interest Group (Rosenfeld Community)
Dan Hill
Designing for the infrastructures of everyday life
2024 • Designing with AI 2024
Gold
Ariel Kennan
Theme 2 Intro
2021 • Civic Design 2021
Gold
Lori Muszynski
Keeping Design Weird
2023 • DesignOps Summit 2023
Gold

More Videos

"Spreadsheets for profiling people across an organization can take an awful long time to create and update."

Shaping design, designers and teams

November 8, 2018

Sabrina Mach

"The purpose of a design operating model is to place the customer at the centre of everything the whole organisation does."

Sabrina Mach Nina Wainwright

How to Design Your Design Operating Model

September 29, 2021

Samuel Proulx

"When you design for the edges, you get the middle for free."

Samuel Proulx

Invisible barriers: Why accessible service design can’t be an afterthought

December 3, 2024

Saara Kamppari-Miller

"Nothing about us without us is the mantra we are embracing when doing our inclusive design operations."

Saara Kamppari-Miller

DesignOps for Inclusive Design and Accessibility (Videoconference)

May 26, 2022

Briana Thomas

"Dana and Davis weren’t seen on stage at Adobe Max, but you felt their impact throughout the experience."

Briana Thomas

The Quiet Force: Uncovering Hidden Leadership in High-Impact Design Teams

September 24, 2024

Adam Cutler

"I wish I could tell my 22-year-old self what to stop doing and what to embrace to be a better designer."

Adam Cutler Karen Pascoe Ian Swinson Susan Worthman

Discussion

June 8, 2016

"We wanted to move fast in the right direction, not just going anywhere for the sake of going there."

Operationalizing DesignOps

November 7, 2018

Leah Buley

"Journey maps and personas often disappear into the void because they’re too dense for business folks to consume."

Leah Buley Joe Natoli

Ask Me Anything with Leah Buley and Joe Natoli, co-authors of The User Experience Team of One (2nd edition)

October 8, 2024

Nathan Shedroff

"You need to learn the vocabulary, tools, and processes your peers know and understand where they are inadequate."

Nathan Shedroff

Double Your Mileage: Use Your Research Strategically

March 31, 2020