Designing inclusively with AI
Summary
Key Insights
-
•
AI-generated images of people with disabilities often show racial and representation biases, such as all-white subjects and inaccurate assistive device depictions.
-
•
Disability representation in AI images is frequently inaccurate, e.g., guide dogs shown with leashes instead of harnesses and blindfolds over eyes.
-
•
AI-generated personas for users with disabilities can contain improbable feature combinations, such as a MacBook user reliant on Windows-only assistive tech like JAWS.
-
•
Personas created by AI lack the depth and nuance gained from real user research and testing, especially for disability accessibility considerations.
-
•
AI-generated mockups can have accessibility issues like poor contrast and unlabeled UI elements, requiring human accessibility review.
-
•
AI tools like Stark Sidekick improve design accessibility through automated issue detection, though they are not yet full replacements for experts.
-
•
AI-powered task management apps can enhance productivity and accommodation for neurodivergent users by organizing schedules and reducing cognitive load.
-
•
AI can help identify potential biases in accessibility automation projects, but requires careful prompt crafting and domain expertise.
-
•
Designing AI-powered interfaces comes with inclusion challenges, as users unfamiliar with prompting may struggle to get effective results.
-
•
Combining AI output with continuous user testing, especially involving people with disabilities, is essential to ensure accessibility and inclusion.
Notable Quotes
"If you have questions, I will take questions throughout."
"AI-generated images often have no racial diversity and show inaccurate assistive device representation."
"You are either navigating with a white cane or a service dog because you are not gonna want both of your hands full."
"Personas tend to not give you those deep insights that you would get from user research and user testing."
"Automation might not be able to capture the context of an image if you're trying to describe an image."
"AI is actually a pretty good productivity hack as a starting point for accessibility reviews."
"A lot of people will try a prompt and not get what they were hoping to get and maybe miss out on all the benefits of AI."
"For people who identify as autistic, AI tools that review writing tone can be especially helpful."
"If the code doesn’t match the label on screen, voice controls might not recognize the command."
"There always has to be a human option if you’re not getting what you need from the AI."
Or choose a question:
More Videos
"Change is a constant in design, but at USAA it often felt like change within change — inception-like change."
Erin HauberDesign is Not the Frosting on the Scaled Agile Layer Cake
October 24, 2019
"Thoughts cause feelings, and feelings motivate actions. Changing thoughts changes everything."
Megan KiersteadYou Are a Badass at UX: Overcoming Imposter Syndrome
March 10, 2021
"Getting designers into a cadence of reviewing work with senior stakeholders was not a muscle the team had built."
Maggie DieringerCreating Consistency Through Constant Change
January 8, 2024
"Hubris is that belief the market will wait for your big bang release—executives have lost jobs over this."
Meaghan Waters Fotina KoutropoulousLack of Product Thinking will Doom Your Legacy Modernization
June 9, 2021
"Segmentation isn’t owned by market or user research anymore; it’s becoming data-driven and integrated across disciplines."
Jemma AhmedBringing together market and user research
October 17, 2019
"Most of institutional knowledge is tacit, meaning it’s understood or implied without being stated."
Maria TaylorKnowledge is Power: Managing the Lifeblood of the Design Org
October 3, 2023
"If you falsely think you are having the same experience as a native user, you become afraid of accessibility and say it's impossible."
Sam ProulxUnderstanding Screen Readers on Mobile: How And Why to Learn from Native Users
June 6, 2023
"Project leadership can be at any level; the right discipline leads, not necessarily the most senior person."
Catherine BlizzardUsing Integrated Insight to Drive Growth
March 10, 2022
"Flat Carol was a nearly life-size cardboard cutout of Carol."
Randolph Duke IIWar Stories LIVE! Randy Duke II
March 30, 2020
