SUS: A System Unusable for Twenty Percent of the Population
Summary
Did you know that the SUS creates biases in your research, affecting one in five people? That’s right! People with disabilities, especially those who use assistive technology, are not considered by most of the questions in the SUS. As a designer for the public sector, this could lead to you making design decisions that don’t take into account 20 percent of the visitors to your website.
Key Insights
-
•
Screen readers allow users to navigate web pages quickly by jumping through well-structured headings and content.
-
•
Low vision users often rely on system-wide screen magnification and color inversion settings to reduce eye strain.
-
•
Alternative navigation methods like head mice and voice dictation are selected based on task and user condition, not used exclusively.
-
•
Traditional lab-based usability research often prioritizes convenience over real assistive technology configurations, leading to inaccurate results.
-
•
Assistive technology users rarely use default settings; they extensively customize tools over time for optimal use.
-
•
The System Usability Scale (SUS) includes questions that confuse assistive technology users and do not capture their true experience.
-
•
Fable’s Accessible Usability Scale adapts SUS questions to better reflect the experience of assistive technology users.
-
•
Initial data shows screen reader users report significantly lower usability scores (mid-50s) compared to screen magnification users (low 60s).
-
•
Users’ lowered expectations after years of experience may mask the true severity of usability issues in assistive technology contexts.
-
•
Measuring accessibility usability accurately enables benchmarking and progress in improving digital products for all users.
Notable Quotes
"I’ve been using screen readers for 30 years and accessibility has always been a passion of mine."
"Screen readers let us jump from one heading to another, replicating the experience of skimming a page visually."
"Low vision users often invert colors and use magnification levels as high as 400 percent to reduce eye strain."
"Alternative navigation users pick different tools based on the task and how they feel at that moment, not just one technology."
"In a usability session, the biggest challenge is not to talk at the same time the screen reader is talking."
"No assistive technology user uses default settings; we spend years customizing everything to work for us."
"The System Usability Scale’s question about needing a technical person to use the system is confusing and inaccurate for screen reader users."
"Most people with my assistive technology might learn to use the system at a different pace than non-disabled users."
"Screen reader users scored significantly lower in usability tests, reflecting the most effort in interpreting content."
"If you’re doing research with people with disabilities, consider using the Accessible Usability Scale to get more accurate insights."
Or choose a question:
More Videos
"Our technical leads started attending other teams’ meetings, helping break down integration barriers."
Carl TurnerYou Can Do This: Understand and Solve Organizational Problems to Jumpstart a Dead Project
March 28, 2023
"If your leadership isn’t aligned to your agenda, it’s vital to negotiate and influence to bring them on board."
Karen PascoeDeveloping Experience Teams and Talent in the Enterprise
June 8, 2016
"Emojis and GIFs have become effective tools for remote teams to add expression and prevent miscommunication."
Jilanna WilsonDistributed Design Operations Management
October 23, 2019
"Slack channels and weekly meetings encourage cross-contract collaboration, avoiding duplication and sharing learnings across teams."
Shawna Hein Kevin HoffmanCreate a Cohesive Civic Design Practice Across Agency, Vendors, and Contracts
November 17, 2022
"You need to find your own mattress—a grounding purpose or phrase—that you can rely on when progress feels hopeless."
Barb SpantonDoing Work That Matters: A Look Beyond The Idealistic Notion of 'Doing Meaningful Work'
June 10, 2022
"If a feature didn’t align with our core UX principles, it probably didn’t belong in our application."
Briana ThomasThe Quiet Force: Uncovering Hidden Leadership in High-Impact Design Teams
September 24, 2024
"Coaches organize practices or drills to push players toward specific goals and improvement."
Gina MendoliaTherapists, Coaches, and Grandmas: Techniques for Service Design in Complex Systems
December 3, 2024
"Future UX includes designing for user discovery in conversational and augmented interfaces, not just clicks."
Lija Hogan Milan Mijatovic Sam Proulx Louis RosenfeldThree Years Out: Perspectives on the Near-Term Future of User Research
March 15, 2024
"Be human first when creating new roles; treat them with the same care as hiring new team members."
John Calhoun Rachel PosmanTwo Sides of the DesignOps Coin: Teams Ops and Product Ops
January 8, 2024
