Summary
Did you know that the SUS creates biases in your research, affecting one in five people? That’s right! People with disabilities, especially those who use assistive technology, are not considered by most of the questions in the SUS. When the SUS was invented, the author encouraged people to change it to suit different needs. In this talk, Samuel Proulx and Abid Virani from Fable will discuss how Fable adapted the SUS to work for assistive technology users. Drawing from over five thousand hours of research and testing involving assistive technology users, we created the Accessible Usability Scale (AUS). This presentation will include trends in AUS responses since it was released in December of 2020.
Key Insights
-
•
Assistive technology users fall broadly into three groups: screen reader users, screen magnification users, and alternative navigation users.
-
•
Screen reader users often face the greatest usability challenges due to lack of backup navigation options.
-
•
Screen magnification tools sometimes incorporate screen reader features to reduce eye strain and aid users with partial vision loss.
-
•
Alternative navigation users leverage multiple input methods, including voice commands, head mice, and coordinate grids, to overcome interaction barriers.
-
•
Traditional usability labs are poorly suited for testing with assistive technology users because they use unfamiliar setups that aren't customized.
-
•
Remote usability testing better captures authentic user experiences by allowing assistive technology users to test in their optimized environments.
-
•
The original System Usability Scale (SUS) includes language and assumptions that are often unclear or irrelevant to assistive technology users.
-
•
Fable developed an Accessible Usability Scale (AUS), modifying SUS questions to focus on specific features and removing technical assumptions for better relevance.
-
•
Experience level with assistive technology and timing of disability onset deeply influence users’ mental models and usability perceptions.
-
•
Usability should be assessed on both accessibility and efficiency — a feature that takes much longer for assistive technology users to complete may be considered inaccessible.
Notable Quotes
"Assistive technology is a group of technologies that people with disabilities use to access computers, grouped mainly into screen readers, magnification, and alternative navigation."
"The primary customization for screen reader users is speed — expert users can listen to synthetic voices at over 300 words per minute and fully understand."
"Magnification tools may include screen reader features because users can get eye strain and prefer to have content read aloud from a specific spot."
"If a screen reader can’t activate or describe a button, the user has no backup other than getting someone with sight involved."
"Traditional usability labs force assistive technology users to use unfamiliar setups, which can drastically impact their performance."
"Remote testing helps users be in comfortable, accessible environments with fully customized assistive technology setups."
"I am a technical person and I can't use this system — sometimes you don’t need a technical person, you just need someone who can see to help with barriers."
"Accessibility is a spectrum, not a checkbox — some features might require assistance but the rest of the product can be fully accessible."
"We’ve ruled out self-reporting skill levels because novice users often overestimate their expertise and near-experts underestimate theirs."
"It’s not just user skill with the system, but also the broader ways people use technology that determines their experience and accessibility needs."
Or choose a question:
More Videos
"Risk conversations are less about risk or no risk and more about acceptable risk balanced against opportunity value."
Marc Rettig Julie Baher Phil Gilbert Nathan ShedroffDiscussion
May 14, 2015
"The Design for Delight forums were good for shared stories and vernacular, but didn’t create significant impact because people were talking, not doing."
Discussion
June 9, 2017
"The masquerade is a figure that reveals ancestral social, political, and environmental powers to the community, much like design reveals insights."
Florence OkoyeAfroFuturism and UX Research
March 27, 2023
"Vasilio Sampalis’s top-down and bottom-up approach increased LEGO’s user-centric maturity and attracted Gartner’s attention."
Jemma AhmedTheme 2 Intro
January 8, 2024
"A data scientist is part stat geek, part hacker, and part entrepreneur all rolled into one."
Chris ChapoData Science and Design: A Tale of Two Tribes
May 13, 2015
"There’s a balancing act with error messages: short enough to be processed immediately, detailed enough to explore as needed."
Sam ProulxDesigning For Screen Readers: Understanding the Mental Models and Techniques of Real Users
December 10, 2021
"Knowing in action is the intuition that designers like to refer to as the core of artistry."
Yoel SumitroActions and Reflections: Bridging the Skills Gap among Researchers
March 9, 2022
"The screen curtain is a privacy feature that saves battery and prevents shoulder surfing."
Sam ProulxUnderstanding Screen Readers on Mobile: How And Why to Learn from Native Users
October 2, 2023
"I may be ruining his experience. It's his experience, not mine."
Iram ShahClosing Keynote: The View from the Top
June 4, 2019