Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Humanizing AI: Filling the Gaps with Multi-faceted Research
Gold
Thursday, March 11, 2021 • Advancing Research 2021
Share the love for this talk
Humanizing AI: Filling the Gaps with Multi-faceted Research
Speakers: Joel Branch
Link:

Summary

Artificial intelligence (AI) has graduated from science fiction to commoditized widget form, readily able to snap into many processes of daily life. Hence, enterprises of all maturity levels are increasingly eager to explore AI’s roles in their innovation, or outright survival strategies. Concurrently, ethical and responsible development and execution of AI-based solutions will increasingly become critical for purposes of safety and fairness. Ensuring that AI proliferates along the right path will require the infusion of multi-faceted research activities along the entire AI lifecycle. We will discuss the challenges and opportunities regarding this topic in this presentation.

Key Insights

  • Despite AI hype, up to 90% of enterprise data science projects never deploy into production.

  • Humanized AI requires governance frameworks that include non-engineering roles like product researchers and AI ethicists.

  • Black-box AI decisions limit trust and adoption due to opaque, probabilistic model reasoning.

  • The Gender Shades study revealed up to a 33% error rate disparity in facial recognition accuracy by gender and skin tone.

  • ML ops extends DevOps principles to AI, ensuring governance, accountability, validation, and feedback loops in model development.

  • Visualization research is critical to exploring high-dimensional data and identifying intersectional biases within training sets.

  • Explainability must evolve from feature importance scores towards causal, natural language rationales understandable to non-technical stakeholders.

  • AI trust depends on the system’s ability to engage in human-like back-and-forth explanations that users can scrutinize.

  • No-code and low-code AI tools are lowering the barrier to AI adoption but require careful governance to avoid perpetuating biases.

  • Cross-disciplinary, multi-faceted research collaborations between industry and academia remain essential as AI ethics and policies mature.

Notable Quotes

"I observe that AI development is often uninformed and hurried, resulting in deployments that don’t operate well in the real world."

"Humanizing AI is not just about creating human-like interfaces but about governance frameworks to democratize safe, effective AI solutions."

"Almost 90% of data science projects do not make it into production—they die on the vine."

"Black box decision making means information goes in, something comes out, and we really have no clue why."

"The Gender Shades project spurred Microsoft and IBM to revisit and correct bias issues in their facial recognition products."

"ML ops borrowed from DevOps offers governance, accountability, validation, and stakeholder responsibilities for AI development."

"Visualization helps analyze multi-dimensional data so non-engineers can identify wrong or biased datasets to avoid."

"Explainability techniques aim to turn numerical AI results into causally understandable, human-readable rationales."

"AI trust comes when AI can provide convincing explanations and engage in back-and-forth like a human advisor."

"Humanizing AI is necessary for safe, enjoyable, and competitive AI solutions, especially as governmental ethics policies mature."

Ask the Rosenbot
Bria Alexander
The Big Question about Resilience: A panel discussion
2024 • DesignOps 2024
Gold
Samuel Proulx
Invisible barriers: Why accessible service design can’t be an afterthought
2024 • Advancing Service Design 2024
Gold
Zen Ren
Taking Inspiration from Instructional Design for Research
2022 • Advancing Research 2022
Gold
Bria Alexander
Welcome
2022 • DesignOps Summit 2022
Gold
Dan Mall
“Ask Me Anything” with Dan Mall, Author of Upcoming Rosenfeld Title, Design that Scales
2023 • DesignOps Summit 2023
Gold
Laureen Kattan
Centering Patients and Clinicians in a Complex Government Ecosystem
2023 • Design in Product 2023
Gold
Cara Maritz
The Art of Extrapolation
2023 • Advancing Research 2023
Gold
Brendan Jarvis
It was the Best of Times. It was the Worst of Times.
2024 • DesignOps 2024
Gold
Dr. Karl Jeffries
The Science of Creativity for DesignOps
2024 • DesignOps Summit 2020
Gold
Sarah Brooks
Theme 3 Intro
2021 • Civic Design 2021
Gold
Chris Geison
What is Research Strategy?: A Panel of Research Leaders Discuss this Emergent Question (Videoconference)
2021 • Advancing Research Community
Andy Barraclough
From Costly Complexity to Efficient Insights: Why UX Teams Are Switching To Voxpopme
2024 • DesignOps 2024
Gold
Sabrina Mach
How to Design Your Design Operating Model
2021 • DesignOps Summit 2021
Gold
Jennifer Fraser
What would Emmy Noether Do? Math, Models and Mulling in UX Research
2023 • Advancing Research 2023
Gold
Briana Thomas
The Quiet Force: Uncovering Hidden Leadership in High-Impact Design Teams
2024 • DesignOps 2024
Gold
Frances Yllana
Theme 2 Intro
2024 • DesignOps 2024
Gold

More Videos

"There’s never enough attention you can give to change management in scaling design impact — don’t do it alone."

Standardizing Product Merits for Leaders, Designers, and Everyone

June 15, 2018

Simon Wardley

"Very few people in business are familiar with situational awareness unless they served in the military."

Simon Wardley

Maps and Topographical Intelligence (Videoconference)

January 31, 2019

Sandra Camacho

"White supremacy is the belief system of the superiority of whiteness that can embed itself in algorithms."

Sandra Camacho

Creating More Bias-Proof Designs

January 22, 2025

Darian Davis

"By observing Jeff’s concerns and asking questions, I was able to show empathy and focus on the problem rather than get defensive."

Darian Davis

Lessons from a Toxic Work Relationship

January 8, 2024

Fisayo Osilaja

"Providing more holistic recommendations helped us gain more trust and buy-in from stakeholders, increasing UX maturity."

Fisayo Osilaja

[Demo] The AI edge: From researcher to strategist

June 4, 2024

Uday Gajendar

"Temporary, quick, and sometimes rough artifacts have a lifespan just long enough for the conversation they enable."

Uday Gajendar

The Wicked Craft of Enterprise UX

May 13, 2015

Davis Neable

"Trust is often underestimated but is critical when designers face public critique and feedback."

Davis Neable Guy Segal

How to Drive a Design Project When you Don’t Have a Design Team

June 10, 2021

Eniola Oluwole

"Launching a design system is not a sprint, there’s no end, it’s always a continuous process."

Eniola Oluwole

Lessons From the DesignOps Journey of the World's Largest Travel Site

October 24, 2019

Aurobinda Pradhan

"Finding a single source of truth for design documents and artifacts is extremely hard because most tools operate in silos."

Aurobinda Pradhan Shashank Deshpande

Introduction to Collaborative DesignOps using Cubyts

September 9, 2022