Rosenverse
SUS: A System Unusable for Twenty Percent of the Population

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

SUS: A System Unusable for Twenty Percent of the Population

Gold
Thursday, December 9, 2021 • Civic Design 2021
Share the love for this talk
SUS: A System Unusable for Twenty Percent of the Population
Speakers: Sam Proulx
Link:

Summary

Did you know that the SUS creates biases in your research, affecting one in five people? That’s right!  People with disabilities, especially those who use assistive technology, are not considered by most of the questions in the SUS. As a designer for the public sector, this could lead to you making design decisions that don’t take into account 20 percent of the visitors to your website.

Key Insights

  • Screen readers allow users to navigate web pages quickly by jumping through well-structured headings and content.

  • Low vision users often rely on system-wide screen magnification and color inversion settings to reduce eye strain.

  • Alternative navigation methods like head mice and voice dictation are selected based on task and user condition, not used exclusively.

  • Traditional lab-based usability research often prioritizes convenience over real assistive technology configurations, leading to inaccurate results.

  • Assistive technology users rarely use default settings; they extensively customize tools over time for optimal use.

  • The System Usability Scale (SUS) includes questions that confuse assistive technology users and do not capture their true experience.

  • Fable’s Accessible Usability Scale adapts SUS questions to better reflect the experience of assistive technology users.

  • Initial data shows screen reader users report significantly lower usability scores (mid-50s) compared to screen magnification users (low 60s).

  • Users’ lowered expectations after years of experience may mask the true severity of usability issues in assistive technology contexts.

  • Measuring accessibility usability accurately enables benchmarking and progress in improving digital products for all users.

Notable Quotes

"I’ve been using screen readers for 30 years and accessibility has always been a passion of mine."

"Screen readers let us jump from one heading to another, replicating the experience of skimming a page visually."

"Low vision users often invert colors and use magnification levels as high as 400 percent to reduce eye strain."

"Alternative navigation users pick different tools based on the task and how they feel at that moment, not just one technology."

"In a usability session, the biggest challenge is not to talk at the same time the screen reader is talking."

"No assistive technology user uses default settings; we spend years customizing everything to work for us."

"The System Usability Scale’s question about needing a technical person to use the system is confusing and inaccurate for screen reader users."

"Most people with my assistive technology might learn to use the system at a different pace than non-disabled users."

"Screen reader users scored significantly lower in usability tests, reflecting the most effort in interpreting content."

"If you’re doing research with people with disabilities, consider using the Accessible Usability Scale to get more accurate insights."

Ask the Rosenbot
Bria Alexander
Opening Remarks
2023 • DesignOps Summit 2023
Gold
Sam Proulx
Prototype Reviews, People With Disabilities, and You
2021 • Civic Design 2021
Gold
Verónica Urzúa
The B-side of the Research Impact
2021 • Advancing Research 2021
Gold
Amy Brana Stuart
Rest in Peace Fly-in-fly-out Design
2022 • Design at Scale 2022
Gold
Bria Alexander
Opening Remarks
2023 • Advancing Research 2023
Gold
Catherine Blizzard
Using Integrated Insight to Drive Growth
2022 • Advancing Research 2022
Gold
Kristin Taylor
Building Bridges Across Organizational Silos
2022 • Civic Design 2022
Gold
Bria Alexander
Welcome
2024 • Enterprise Experience 2020
Gold
Himanshu Bharadwaj
If design had a heart
2026 • Rosenfeld Community
Erin Weigel
UX Lessons from running more than 1,200 A/B Tests
2024 • Rosenfeld Community
Bria Alexander
Opening Remarks
2022 • Civic Design 2022
Gold
Caroline Jarrett
Have fun with statistics?
2024 • Rosenfeld Community
Scott Jensen
Short Take #2: UX/Product Lessons from Your Industry Peers
2022 • Design in Product 2022
Gold
Catt Small
What's Next for ICs: Exploring Staff and Principal Designer Roles
2024 • Rosenfeld Community
Amy Jiménez Márquez
The Atypical UX Manager Path
2020 • Enterprise Community
Billy Carlson
Tips to Utilize Wireframes to Tell an Effective Product Story
2023 • Enterprise UX 2023
Gold

More Videos

Surya Vanka

"Embedding process knowledge directly into work surfaces helps teams unpack and collaborate effectively."

Surya Vanka

Unleashing Swarm Creativity to Solve Enterprise Challenges

June 10, 2021

Patrick Boehler

"The biggest shift is the power moving from supply side to demand side in media."

Patrick Boehler Madison Karas

The service shift: transforming media organizations to create real value through design

November 19, 2025

Andreas Huebner

"Even though Craig and I work closely every day, we haven’t met in person yet, which shows how remote collaboration works well for us."

Andreas Huebner Amy Takata Craig Brookes

What Is It Like To Be Part of The UX Team at Compass?

March 11, 2021

Patrizia Bertini

"The business value of design operations is hidden, unclear, and not even talked about."

Patrizia Bertini Alexandra Mengoni León

Pushing DesignOps’ Influence into New Global Markets

September 9, 2022

Phil Gilbert

"We decided to make it an opt-in program and that accelerated early wins and self-selected positive outcomes."

Phil Gilbert

A Consistent Culture of Design

May 14, 2015

Yulya Besplemennova

"AI can help manage cognitive overload and speed up work when you have short timeframes and no team."

Yulya Besplemennova

[Demo] Stress-testing GenAI in user research synthesis

June 4, 2024

Sarah Rink

"Don’t do remote contextual inquiry just because you can; you lose so much context."

Sarah Rink

Remote User Research: Dos and Don'ts from the Virtual Field

June 11, 2020

Mujtaba Hameed

"The core thesis is that saving time with AI and reallocating it into research itself unlocks the true potential of the field."

Mujtaba Hameed

The new horizon of ethnography: using AI to unlock the full potential of in-person research

March 11, 2026

Sheryl Cababa

"Involving stakeholders with lived experience empowers design and enriches domain knowledge."

Sheryl Cababa

Living in the Clouds: Adopting a Systems Thinking Mindset

June 6, 2023