Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Humanizing AI: Filling the Gaps with Multi-faceted Research
Gold
Thursday, March 11, 2021 • Advancing Research 2021
Share the love for this talk
Humanizing AI: Filling the Gaps with Multi-faceted Research
Speakers: Joel Branch
Link:

Summary

Artificial intelligence (AI) has graduated from science fiction to commoditized widget form, readily able to snap into many processes of daily life. Hence, enterprises of all maturity levels are increasingly eager to explore AI’s roles in their innovation, or outright survival strategies. Concurrently, ethical and responsible development and execution of AI-based solutions will increasingly become critical for purposes of safety and fairness. Ensuring that AI proliferates along the right path will require the infusion of multi-faceted research activities along the entire AI lifecycle. We will discuss the challenges and opportunities regarding this topic in this presentation.

Key Insights

  • Despite AI hype, up to 90% of enterprise data science projects never deploy into production.

  • Humanized AI requires governance frameworks that include non-engineering roles like product researchers and AI ethicists.

  • Black-box AI decisions limit trust and adoption due to opaque, probabilistic model reasoning.

  • The Gender Shades study revealed up to a 33% error rate disparity in facial recognition accuracy by gender and skin tone.

  • ML ops extends DevOps principles to AI, ensuring governance, accountability, validation, and feedback loops in model development.

  • Visualization research is critical to exploring high-dimensional data and identifying intersectional biases within training sets.

  • Explainability must evolve from feature importance scores towards causal, natural language rationales understandable to non-technical stakeholders.

  • AI trust depends on the system’s ability to engage in human-like back-and-forth explanations that users can scrutinize.

  • No-code and low-code AI tools are lowering the barrier to AI adoption but require careful governance to avoid perpetuating biases.

  • Cross-disciplinary, multi-faceted research collaborations between industry and academia remain essential as AI ethics and policies mature.

Notable Quotes

"I observe that AI development is often uninformed and hurried, resulting in deployments that don’t operate well in the real world."

"Humanizing AI is not just about creating human-like interfaces but about governance frameworks to democratize safe, effective AI solutions."

"Almost 90% of data science projects do not make it into production—they die on the vine."

"Black box decision making means information goes in, something comes out, and we really have no clue why."

"The Gender Shades project spurred Microsoft and IBM to revisit and correct bias issues in their facial recognition products."

"ML ops borrowed from DevOps offers governance, accountability, validation, and stakeholder responsibilities for AI development."

"Visualization helps analyze multi-dimensional data so non-engineers can identify wrong or biased datasets to avoid."

"Explainability techniques aim to turn numerical AI results into causally understandable, human-readable rationales."

"AI trust comes when AI can provide convincing explanations and engage in back-and-forth like a human advisor."

"Humanizing AI is necessary for safe, enjoyable, and competitive AI solutions, especially as governmental ethics policies mature."

Ask the Rosenbot
Kristin Skinner
8 Types of Measures in Design Operations (Videoconference)
2020 • DesignOps Community
Courtney Maya George
Scale Your Organization and Grow Your Designers
2022 • DesignOps Summit 2022
Gold
Shaping design, designers and teams
2018 • DesignOps Summit 2018
Gold
Angy Peterson
More Than Technology: Personalized Public Sector Experiences
2021 • Civic Design 2021
Gold
Justin Entzminger
Risk and Reward: How to Diversify the Field of Civic Innovators and Designers
2022 • Civic Design 2022
Gold
Malini Rao
Lessons Learned from a 4-year Product Re-platforming Journey
2021 • Design at Scale 2021
Gold
Sam Ladner
Data Exhaust and Personal Data: Learning from Consumer Products to Enhance Enterprise UX
2016 • Enterprise UX 2016
Gold
Russell Blair
[Case study] Killing the blank page
2024 • Designing with AI 2024
Gold
Dan Willis
Enterprise Storytelling Sessions
2015 • Enterprise UX 2015
Gold
Alnie Figueroa
Teamwork: Strategies for Effective Collaboration with Other Program Management Teams
2022 • DesignOps Summit 2022
Gold
Wendy Johansson
Be a Product Boss!
2022 • Design in Product 2022
Gold
Helen Armstrong
Augment the Human. Interrogate the System.
2023 • Enterprise UX 2023
Gold
Ben Davies
Expert Panel: The Principles of Research Repository Design
2022 • Advancing Research 2022
Gold
Sara Asche Anderson
Not Your Ordinary Re-Brand: Design's Path to Driving Customer Obsession at Best Buy
2024 • Enterprise Experience 2020
Gold
Carla Casariego
DesignOps in Wonderland
2019 • DesignOps Summit 2019
Gold
Victor Udoewa
Radical Participatory Research: Decolonizing Participatory Processes
2022 • Advancing Research 2022
Gold

More Videos

Catt Small

"You have to be proactive in identifying opportunities and influence through solid communication and relationships."

Catt Small Micah Bennett Brian Carr Jessica Harllee

What's Next for ICs: Exploring Staff and Principal Designer Roles (Videoconference)

February 22, 2024

Jennifer Kong

"We released several incremental but imperfect pilot solutions to inform usability and strategy rather than relying on typical prototyping."

Jennifer Kong

[Case study] Journeying toward AI-assisted documentation in healthcare

June 5, 2024

Sara Logel

"Findings are often observations with a short shelf life, while insights get deep into the why and the consequences."

Sara Logel

Your Colleagues are Your Users Too

March 29, 2023

Veevi Rosenstein

"When I started at Zendesk in 2018, there was a single UX researcher serving 28 product designers around the globe."

Veevi Rosenstein

Building for Scale: Creating the Zendesk UX Research Practice

January 8, 2024

Michelle Bejian Lotia

"Once we put all these insights into the repository, things we already have get so much more value."

Michelle Bejian Lotia Anne-Marie Morell

Rolling Out a Repository: How Zapier Centralizes Insights from Across their Organization

March 28, 2023

Tutti Taygerly

"Listen for the 10% truth in the difficult person’s perspective and build on that."

Tutti Taygerly

Videconference: How to Work with Difficult People with Tutti Taygerly

June 25, 2020

Patrick Commarford

"We automated our staffing records and updated our staffing score weekly, watching it grow from 44 to nearly 80."

Patrick Commarford

Design Staffing for Impact

January 8, 2024

Frances Yllana

"How might we unlock the full capabilities of our most valuable resource—our people, their skills, their knowledge, and their potential?"

Frances Yllana

Theme 2 Intro

September 24, 2024

Mujtaba Hameed

"You have to design frameworks for the busy executive in the back of the limo."

Mujtaba Hameed

Frameworks for Excellence: Using Visual Thinking and Communication to Elevate Your Research

March 26, 2024