Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Humanizing AI: Filling the Gaps with Multi-faceted Research
Gold
Thursday, March 11, 2021 • Advancing Research 2021
Share the love for this talk
Humanizing AI: Filling the Gaps with Multi-faceted Research
Speakers: Joel Branch
Link:

Summary

Artificial intelligence (AI) has graduated from science fiction to commoditized widget form, readily able to snap into many processes of daily life. Hence, enterprises of all maturity levels are increasingly eager to explore AI’s roles in their innovation, or outright survival strategies. Concurrently, ethical and responsible development and execution of AI-based solutions will increasingly become critical for purposes of safety and fairness. Ensuring that AI proliferates along the right path will require the infusion of multi-faceted research activities along the entire AI lifecycle. We will discuss the challenges and opportunities regarding this topic in this presentation.

Key Insights

  • Despite AI hype, up to 90% of enterprise data science projects never deploy into production.

  • Humanized AI requires governance frameworks that include non-engineering roles like product researchers and AI ethicists.

  • Black-box AI decisions limit trust and adoption due to opaque, probabilistic model reasoning.

  • The Gender Shades study revealed up to a 33% error rate disparity in facial recognition accuracy by gender and skin tone.

  • ML ops extends DevOps principles to AI, ensuring governance, accountability, validation, and feedback loops in model development.

  • Visualization research is critical to exploring high-dimensional data and identifying intersectional biases within training sets.

  • Explainability must evolve from feature importance scores towards causal, natural language rationales understandable to non-technical stakeholders.

  • AI trust depends on the system’s ability to engage in human-like back-and-forth explanations that users can scrutinize.

  • No-code and low-code AI tools are lowering the barrier to AI adoption but require careful governance to avoid perpetuating biases.

  • Cross-disciplinary, multi-faceted research collaborations between industry and academia remain essential as AI ethics and policies mature.

Notable Quotes

"I observe that AI development is often uninformed and hurried, resulting in deployments that don’t operate well in the real world."

"Humanizing AI is not just about creating human-like interfaces but about governance frameworks to democratize safe, effective AI solutions."

"Almost 90% of data science projects do not make it into production—they die on the vine."

"Black box decision making means information goes in, something comes out, and we really have no clue why."

"The Gender Shades project spurred Microsoft and IBM to revisit and correct bias issues in their facial recognition products."

"ML ops borrowed from DevOps offers governance, accountability, validation, and stakeholder responsibilities for AI development."

"Visualization helps analyze multi-dimensional data so non-engineers can identify wrong or biased datasets to avoid."

"Explainability techniques aim to turn numerical AI results into causally understandable, human-readable rationales."

"AI trust comes when AI can provide convincing explanations and engage in back-and-forth like a human advisor."

"Humanizing AI is necessary for safe, enjoyable, and competitive AI solutions, especially as governmental ethics policies mature."

Ask the Rosenbot
Vasileios Xanthopoulos
A Top-Down and Bottom-Up Approach to User-Centric Maturity at Scale
2024 • Enterprise Experience 2020
Gold
Jon Fukuda
The Big Question about Innovation: A Panel Discussion
2024 • DesignOps 2024
Gold
Civic Design in 2022 (Videoconference)
2022 • Civic Design Community
Ivana Ng
Level Up Your Program with ProductOps
2024 • Enterprise Experience 2020
Gold
Sofia Quintero
Beyond Tools: The Messy Business of Implementing Research Repositories
2022 • Advancing Research 2022
Gold
Charlotte Lee
Theme 1 Intro
2021 • Civic Design 2021
Gold
Dan Willis
Enterprise Storytelling Sessions
2015 • Enterprise UX 2015
Gold
Meaghan Waters
Lack of Product Thinking will Doom Your Legacy Modernization
2021 • Design at Scale 2021
Gold
Chris Engledowl
A Mixed Method Approach to Validity to Help Build Trust
2023 • QuantQual Interest Group (Rosenfeld Community)
Fatimah Richmond
The Future of ReOps as a Strategic Function: A Roadmap for Getting There
2024 • Advancing Research 2024
Gold
Daniel Orbach
Zero to One: Co-Creating Operating Models with your Team
2024 • DesignOps 2024
Gold
The Many Faces of Operations
2017 • DesignOps Summit 2017
Gold
Kristen Honey
"Let’s Talk About Data and Crisis”: Public Digital Service Delivery = Open Data + Human Centered Design (Videoconference)
2021 • Civic Design Community
Bob Baxley
Theme 4: Discussion
2024 • Enterprise Experience 2020
Gold
Aditi Ruiz
A PM State of Mind: Empathy Mapping Your Product Manager, Pt. 1
2022 • Design in Product 2022
Gold
Maria Giudice
Becoming a Changemaker by Leading with Design
2023 • Advancing Research 2023
Gold

More Videos

Alex Hurworth

"Knowledge is power; empowering communities leads to better conservation outcomes."

Alex Hurworth Bonnie John Fahd Arshad Antoine Marin

Designing a Contact Tracing App for Universal Access

October 23, 2020

Laine Riley Prokay

"It’s really okay if this new position on your team is short-term only; we can provide the initial opportunity to get started on their career paths."

Laine Riley Prokay Lisa Gordon

Carving a Path for Early Career DesignOps Practitioners

September 9, 2022

Eniola Oluwole

"Launching a design system is not a sprint, there’s no end, it’s always a continuous process."

Eniola Oluwole

Lessons From the DesignOps Journey of the World's Largest Travel Site

October 24, 2019

Nathan Shedroff

"Strategy should be continuous, circular, and evolve with every action the organization takes."

Nathan Shedroff

Double Your Mileage: Use Your Research Strategically

March 31, 2020

Sam Proulx

"You can just pick up your phone and start testing accessibility instantly without procurement or licensing hurdles."

Sam Proulx

Mobile Accessibility: Why Moving Accessibility Beyond the Desktop is Critical in a Mobile-first World

November 17, 2022

Feleesha Sterling

"If your design team cannot act quickly on findings, rapid research is not the method for you."

Feleesha Sterling

Building a Rapid Research Program (Videoconference)

May 18, 2023

Neil Barrie

"Culture is the most influential factor impacting people's perceptions and values today."

Neil Barrie

Widening the Aperture: The Case for Taking a Broader Lens to the Dialogue between Products and Culture

March 25, 2024

John Devanney

"Most organizations know they need to evaluate impact, but very few have effective ways to do it."

John Devanney

The Design Management Office

November 6, 2017

Katy Mogal

"Find the curious partners who will do some of the evangelizing for you to their peers."

Katy Mogal

But Do Your Insights Scale?

March 12, 2021