Summary
Did you know that the SUS creates biases in your research, affecting one in five people? That’s right! People with disabilities, especially those who use assistive technology, are not considered by most of the questions in the SUS. As a designer for the public sector, this could lead to you making design decisions that don’t take into account 20 percent of the visitors to your website.
Key Insights
-
•
Traditional System Usability Scale questions can be confusing or irrelevant for assistive technology users.
-
•
Assistive technology users heavily customize their tools; default configurations in research labs misrepresent real-world experiences.
-
•
Screen reader users tend to report significantly lower usability scores than low vision or alternative navigation users.
-
•
Alternative navigation users choose tools based on specific tasks and physical condition, not one tool fits all.
-
•
Research methods involving simultaneous talking and screen reader output confuse participants and researchers alike.
-
•
Environmental and technical factors in usability labs often create unfamiliar, stressful test settings for disabled users.
-
•
Breaking tasks into smaller chunks improves research session clarity for screen reader users.
-
•
Inclusive design benefits from measuring usability specifically tailored to assistive technology contexts.
-
•
Lower usability scores can reflect long-term lowered expectations among experienced assistive tech users.
-
•
Fable’s Accessible Usability Scale is freely available online and invites iteration and adoption by product teams.
Notable Quotes
"I consider myself a very technical person, but the reason I can’t use the website isn’t because I’m not technical enough; it’s because it’s not working with my screen reader."
"Taking me into an assistive technology lab means using a screen reader that probably hasn’t been configured by anyone familiar with the technology."
"Alternative navigation users pick the tool that is right for the job, depending on their physical condition and task."
"Breaking tasks into little chunks avoids the confusion of talking while the screen reader is talking."
"The system usability scale didn’t consider people relying on assistive technology, so answers were often inaccurate or misunderstood."
"Screen reader users score significantly lower on usability, often reflecting the most complex interpretation demands."
"Things that can’t be measured don’t happen, so having a tailored usability scale matters for progress."
"Issues that are minor for general users represent broader usability barriers for assistive technology users."
"We invite others to leverage, evaluate, criticize, and modify the Accessible Usability Scale to improve measurement."
"Inclusive design is the most robust way to build great products that work for everyone."
Or choose a question:
More Videos
"I wish I could tell my 22-year-old self what to stop doing and what to embrace to be a better designer."
Adam Cutler Karen Pascoe Ian Swinson Susan WorthmanDiscussion
June 8, 2016
"We don’t get upset when users say one thing and do another, but we freak out when our leadership behaves that way."
Peter MerholzThe Trials and Tribulations of Directors of UX (Videoconference)
July 13, 2023
"If you haven’t designed who your teams are and who your players are, expecting people to comply with standards won’t work."
Lisa WelchmanCleaning Up Our Mess: Digital Governance for Designers
June 14, 2018
"Sustainable practices are not just a luxury; they are a necessity for our survival."
Vincent BrathwaiteOpener: Past, Present, and Future—Closing the Racial Divide in Design Teams
October 22, 2020
"OKRs are a tool for each of us to tidy our house and focus on what’s important."
Brenna FallonLearning Over Outcomes
October 24, 2019
"Hip hop proves that we can re-animate spaces with highly generative communities that weren't built for us."
Tricia WangSpatial Collapse: Designing for Emergent Culture
January 8, 2024
"Proto personas created by cross-department participants helped us build unbiased, relevant survey questions."
Edgar Anzaldua MorenoUsing Research to Determine Unique Value Proposition
March 11, 2021
"Service lines bridge the gaps between product lines through information flows to provide the right knowledge at the right time."
Designing Systems at Scale
November 7, 2018
"The conversion design process creates collective knowledge, which gets reinfused to strengthen future experiments."
Erin WeigelGet Your Whole Team Testing to Design for Impact
July 24, 2024
