Summary
Did you know that the SUS creates biases in your research, affecting one in five people? That’s right! People with disabilities, especially those who use assistive technology, are not considered by most of the questions in the SUS. As a designer, this could lead to you making design decisions that don’t take into account 20 percent of the visitors to your website. When the SUS was invented, the author encouraged people to change it to suit different needs. In this talk, Samuel Proulx from Fable will discuss how Fable adapted the SUS to work for assistive technology users. Drawing from over five thousand hours of research and testing involving assistive technology users, we created the Accessible Usability Scale (AUS). This presentation will include trends in AUS responses since it was released in December of 2020.
Key Insights
-
•
Screen readers require highly semantic web design to allow efficient navigation by users.
-
•
Screen reader users often speed up the voice to 400-800 words per minute to match typical reading speeds.
-
•
Alternative navigation devices like head mice pose unique interaction challenges, such as difficulty with dropdown menus.
-
•
Low vision users benefit from screen magnifiers combined with color inversion to reduce eye fatigue.
-
•
Traditional think-aloud usability research creates high cognitive load for assistive tech users, requiring task chunking.
-
•
Accessibility research labs can unintentionally exclude participants due to physical travel and assistive tech setup issues.
-
•
The System Usability Scale (SUS) includes questions that assume uniform user abilities, limiting its effectiveness for people with disabilities.
-
•
Fable adapted SUS questions to better reflect the realities and technical contexts of assistive technology users.
-
•
Preliminary AUS results show screen reader users give lower usability scores than magnification or alternative navigation users.
-
•
Inclusive research methods must be flexible and adaptable to diverse assistive technologies to gather more representative data.
Notable Quotes
"What screen readers allow us to do is jump directly to bits of content we are interested in to replicate the visual experience of skimming a web page."
"Most screen reader users prefer robotic voices so they can speed them up and read very quickly."
"Travel to usability labs can take longer than the research session itself for people with disabilities."
"Every piece of assistive technology is highly customized to meet the needs of each individual person."
"If I’m talking over my screen reader, the researcher has no idea what either of us is saying."
"The original SUS questions don’t consider the extra layer of technology that gets in the way for people with disabilities."
"One question says I would need the support of a technical person to use this system—well I am a technical user, but the system is inaccessible."
"Screen magnification just leans on the existing way most people design and interact with websites—changing size and color."
"Screen readers have to do the most work to interpret websites due to lack of visual cues, which explains lower usability scores."
"The Accessible Usability Scale is still an experiment and we welcome feedback, criticism, and modifications to improve it."
Or choose a question:
More Videos
"Can you show me your process, not just your portfolio? That shows me your real design thinking."
Adam Cutler Karen Pascoe Ian Swinson Susan WorthmanDiscussion
June 8, 2016
"Many product managers got their roles because they know the business or subject matter, but they don’t know how to manage product development."
Peter MerholzThe Trials and Tribulations of Directors of UX (Videoconference)
July 13, 2023
"Digital is a system, not a project. It’s there all the time and you have to keep iterating on it."
Lisa WelchmanCleaning Up Our Mess: Digital Governance for Designers
June 14, 2018
"Transportation must evolve to be more sustainable and accessible for all."
Vincent BrathwaiteOpener: Past, Present, and Future—Closing the Racial Divide in Design Teams
October 22, 2020
"Engineers can be our biggest allies in making really important process changes."
Brenna FallonLearning Over Outcomes
October 24, 2019
"It’s human infrastructure—community organizing, unions, activists—that saves the day when other infrastructures break down."
Tricia WangSpatial Collapse: Designing for Emergent Culture
January 8, 2024
"Proto personas created by cross-department participants helped us build unbiased, relevant survey questions."
Edgar Anzaldua MorenoUsing Research to Determine Unique Value Proposition
March 11, 2021
"Service lines bridge the gaps between product lines through information flows to provide the right knowledge at the right time."
Designing Systems at Scale
November 7, 2018
"Randomization is magic — it evenly distributes confounds so the only difference affecting results is your change."
Erin WeigelGet Your Whole Team Testing to Design for Impact
July 24, 2024
