Summary
Artificial intelligence (AI) has graduated from science fiction to commoditized widget form, readily able to snap into many processes of daily life. Hence, enterprises of all maturity levels are increasingly eager to explore AI’s roles in their innovation, or outright survival strategies. Concurrently, ethical and responsible development and execution of AI-based solutions will increasingly become critical for purposes of safety and fairness. Ensuring that AI proliferates along the right path will require the infusion of multi-faceted research activities along the entire AI lifecycle. We will discuss the challenges and opportunities regarding this topic in this presentation.
Key Insights
-
•
Despite AI hype, up to 90% of enterprise data science projects never deploy into production.
-
•
Humanized AI requires governance frameworks that include non-engineering roles like product researchers and AI ethicists.
-
•
Black-box AI decisions limit trust and adoption due to opaque, probabilistic model reasoning.
-
•
The Gender Shades study revealed up to a 33% error rate disparity in facial recognition accuracy by gender and skin tone.
-
•
ML ops extends DevOps principles to AI, ensuring governance, accountability, validation, and feedback loops in model development.
-
•
Visualization research is critical to exploring high-dimensional data and identifying intersectional biases within training sets.
-
•
Explainability must evolve from feature importance scores towards causal, natural language rationales understandable to non-technical stakeholders.
-
•
AI trust depends on the system’s ability to engage in human-like back-and-forth explanations that users can scrutinize.
-
•
No-code and low-code AI tools are lowering the barrier to AI adoption but require careful governance to avoid perpetuating biases.
-
•
Cross-disciplinary, multi-faceted research collaborations between industry and academia remain essential as AI ethics and policies mature.
Notable Quotes
"I observe that AI development is often uninformed and hurried, resulting in deployments that don’t operate well in the real world."
"Humanizing AI is not just about creating human-like interfaces but about governance frameworks to democratize safe, effective AI solutions."
"Almost 90% of data science projects do not make it into production—they die on the vine."
"Black box decision making means information goes in, something comes out, and we really have no clue why."
"The Gender Shades project spurred Microsoft and IBM to revisit and correct bias issues in their facial recognition products."
"ML ops borrowed from DevOps offers governance, accountability, validation, and stakeholder responsibilities for AI development."
"Visualization helps analyze multi-dimensional data so non-engineers can identify wrong or biased datasets to avoid."
"Explainability techniques aim to turn numerical AI results into causally understandable, human-readable rationales."
"AI trust comes when AI can provide convincing explanations and engage in back-and-forth like a human advisor."
"Humanizing AI is necessary for safe, enjoyable, and competitive AI solutions, especially as governmental ethics policies mature."
Dig deeper—ask the Rosenbot:
More Videos
"The majority of the participants last through the six-month commitment with only about 5% removed for low engagement."
Wyatt HaymanGlobal Research Panels (Videoconference)
August 8, 2020
"We use a design checklist to show the health of each component, leaving items unchecked if they don't meet standards."
PJ Buddhari Nate BaldwinMeet Spectrum, Adobe’s Design System
June 9, 2021
"We used a Wizard of Oz smoke-and-mirrors prototype to get quick buy-in from Detroit stakeholders around early childhood education access."
Sarah GallimoreInspire Progress with Artifacts from the Future
November 18, 2022
"If you’re doing a lot of work that’s not in your job description, you might actually be doing leadership."
Peter MerholzThe Trials and Tribulations of Directors of UX (Videoconference)
July 13, 2023
"If we continue to peak participants from homogenized groups, we risk perpetuating women’s everyday exclusions."
Dr. Jamika D. Burge Mansi GuptaAdvancing the Inclusion of Womxn in Research Practices (Videoconference)
September 15, 2022
"Product principles are minimal but help us say, oh, this is meeting that or not meeting that."
Amy MarquezINVEST: Discussion
June 15, 2018
"Games are not a point in time you run away from — you don’t just drop the cartridge and walk away."
Dane DeSutter Natalie Gedeon Deborah Hendersen Cheryl PlatzBeyond the Console: The rise of the Gamer Experience and how gaming will impact UX Research across industries (Videoconference)
May 17, 2024
"If you are silent about your pain, they will kill you and say you enjoyed it."
Zariah CameronReDesigning Wellbeing for Equitable Care in the Workplace
September 23, 2024
"I’m ADHD, and that’s something I’m trying to be more open about despite the stigma."
Jessica NorrisADHD: A DesignOps Superpower
September 9, 2022
