Designing inclusively with AI
Summary
We know there’s massive opportunity for AI to be used for greater speed, growth, and insights, but how can we avoid the pitfalls? Head of Accessibility Innovation at Fable Kate Kalcevich will share how to best leverage current AI tools in your day-to-day work with inclusion in mind.
Key Insights
-
•
AI-generated images of people with disabilities often show racial and representation biases, such as all-white subjects and inaccurate assistive device depictions.
-
•
Disability representation in AI images is frequently inaccurate, e.g., guide dogs shown with leashes instead of harnesses and blindfolds over eyes.
-
•
AI-generated personas for users with disabilities can contain improbable feature combinations, such as a MacBook user reliant on Windows-only assistive tech like JAWS.
-
•
Personas created by AI lack the depth and nuance gained from real user research and testing, especially for disability accessibility considerations.
-
•
AI-generated mockups can have accessibility issues like poor contrast and unlabeled UI elements, requiring human accessibility review.
-
•
AI tools like Stark Sidekick improve design accessibility through automated issue detection, though they are not yet full replacements for experts.
-
•
AI-powered task management apps can enhance productivity and accommodation for neurodivergent users by organizing schedules and reducing cognitive load.
-
•
AI can help identify potential biases in accessibility automation projects, but requires careful prompt crafting and domain expertise.
-
•
Designing AI-powered interfaces comes with inclusion challenges, as users unfamiliar with prompting may struggle to get effective results.
-
•
Combining AI output with continuous user testing, especially involving people with disabilities, is essential to ensure accessibility and inclusion.
Notable Quotes
"If you have questions, I will take questions throughout."
"AI-generated images often have no racial diversity and show inaccurate assistive device representation."
"You are either navigating with a white cane or a service dog because you are not gonna want both of your hands full."
"Personas tend to not give you those deep insights that you would get from user research and user testing."
"Automation might not be able to capture the context of an image if you're trying to describe an image."
"AI is actually a pretty good productivity hack as a starting point for accessibility reviews."
"A lot of people will try a prompt and not get what they were hoping to get and maybe miss out on all the benefits of AI."
"For people who identify as autistic, AI tools that review writing tone can be especially helpful."
"If the code doesn’t match the label on screen, voice controls might not recognize the command."
"There always has to be a human option if you’re not getting what you need from the AI."
Or choose a question:
More Videos
"The difference between the way people talk about how things are done and how they are actually done reveals unconscious assumptions."
Carl TurnerYou Can Do This: Understand and Solve Organizational Problems to Jumpstart a Dead Project
March 28, 2023
"If there’s a performance gap, don’t sit on it; it doesn’t age well and hurts the team, employee, and business."
Karen PascoeDeveloping Experience Teams and Talent in the Enterprise
June 8, 2016
"Sending small care packages to remote team members goes a long way in showing we care and building connection."
Jilanna WilsonDistributed Design Operations Management
October 23, 2019
"Our digital experience group acts like hosts and planners making sure veterans sit down to a cohesive, inclusive meal, not just disparate dishes."
Shawna Hein Kevin HoffmanCreate a Cohesive Civic Design Practice Across Agency, Vendors, and Contracts
November 17, 2022
"You need to find your own mattress—a grounding purpose or phrase—that you can rely on when progress feels hopeless."
Barb SpantonDoing Work That Matters: A Look Beyond The Idealistic Notion of 'Doing Meaningful Work'
June 10, 2022
"As the delivery driver, I connected the dots, got people briefs, and sometimes said no to lofty leadership requests."
Briana ThomasThe Quiet Force: Uncovering Hidden Leadership in High-Impact Design Teams
September 24, 2024
"Taking ugly notes together without worrying about making things pretty lowers barriers and increases engagement."
Gina MendoliaTherapists, Coaches, and Grandmas: Techniques for Service Design in Complex Systems
December 3, 2024
"Now everyone’s an edge case, so research needs to focus on those edge cases, not just the average user."
Lija Hogan Milan Mijatovic Sam Proulx Louis RosenfeldThree Years Out: Perspectives on the Near-Term Future of User Research
March 15, 2024
"Team ops goes wide to support 300-plus UX designers globally; product ops goes deep supporting 40-plus product design teams."
John Calhoun Rachel PosmanTwo Sides of the DesignOps Coin: Teams Ops and Product Ops
January 8, 2024
