Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

SUS: A System Unusable for Twenty Percent of the Population
Gold
Thursday, December 9, 2021 • Civic Design 2021
Share the love for this talk
SUS: A System Unusable for Twenty Percent of the Population
Speakers: Sam Proulx
Link:

Summary

Did you know that the SUS creates biases in your research, affecting one in five people? That’s right!  People with disabilities, especially those who use assistive technology, are not considered by most of the questions in the SUS. As a designer for the public sector, this could lead to you making design decisions that don’t take into account 20 percent of the visitors to your website.

Key Insights

  • Traditional System Usability Scale questions can be confusing or irrelevant for assistive technology users.

  • Assistive technology users heavily customize their tools; default configurations in research labs misrepresent real-world experiences.

  • Screen reader users tend to report significantly lower usability scores than low vision or alternative navigation users.

  • Alternative navigation users choose tools based on specific tasks and physical condition, not one tool fits all.

  • Research methods involving simultaneous talking and screen reader output confuse participants and researchers alike.

  • Environmental and technical factors in usability labs often create unfamiliar, stressful test settings for disabled users.

  • Breaking tasks into smaller chunks improves research session clarity for screen reader users.

  • Inclusive design benefits from measuring usability specifically tailored to assistive technology contexts.

  • Lower usability scores can reflect long-term lowered expectations among experienced assistive tech users.

  • Fable’s Accessible Usability Scale is freely available online and invites iteration and adoption by product teams.

Notable Quotes

"I consider myself a very technical person, but the reason I can’t use the website isn’t because I’m not technical enough; it’s because it’s not working with my screen reader."

"Taking me into an assistive technology lab means using a screen reader that probably hasn’t been configured by anyone familiar with the technology."

"Alternative navigation users pick the tool that is right for the job, depending on their physical condition and task."

"Breaking tasks into little chunks avoids the confusion of talking while the screen reader is talking."

"The system usability scale didn’t consider people relying on assistive technology, so answers were often inaccurate or misunderstood."

"Screen reader users score significantly lower on usability, often reflecting the most complex interpretation demands."

"Things that can’t be measured don’t happen, so having a tailored usability scale matters for progress."

"Issues that are minor for general users represent broader usability barriers for assistive technology users."

"We invite others to leverage, evaluate, criticize, and modify the Accessible Usability Scale to improve measurement."

"Inclusive design is the most robust way to build great products that work for everyone."

Ask the Rosenbot
Indi Young
Thinking styles: Mend hidden cracks in your market
2025 • Rosenfeld Community
Sam Proulx
Understanding Screen Readers on Mobile: How And Why to Learn from Native Users
2023 • Enterprise UX 2023
Gold
Sam Proulx
Understanding Screen Readers on Mobile: How And Why to Learn from Native Users
2023 • Advancing Research 2023
Gold
Kit Unger
Theme 3 Intro
2022 • Design at Scale 2022
Gold
Kit Unger
Theme 1 Intro
2022 • Design at Scale 2022
Gold
Cheryl Platz
Merging Improv with Design (Videoconference)
2019 • Enterprise Community
Sam Proulx
SUS: A System Unusable for Twenty Percent of the Population
2021 • DesignOps Summit 2021
Gold
Tutti Taygerly
Videconference: How to Work with Difficult People with Tutti Taygerly
2020 • Enterprise Community
Lily Aduana
5 Reasons to Bring Your Recruiting in-House (and How To Do It)
2021 • Advancing Research 2021
Gold
Vincent Brathwaite
Opener: Past, Present, and Future—Closing the Racial Divide in Design Teams
2020 • DesignOps Summit 2020
Gold
Operationalizing DesignOps
2018 • DesignOps Summit 2018
Gold
Mike Oren
Why Pharmaceutical's Research Model Should Replace Design Thinking
2023 • Advancing Research 2023
Gold
Russell Blair
[Case study] Killing the blank page
2024 • Designing with AI 2024
Gold
Roberta Dombrowski
Making Research a Team Sport
2022 • Advancing Research 2022
Gold
Ian Swinson
Designing and Driving UX Careers
2016 • Enterprise UX 2016
Gold
Kelly Dern
AI as a Design Partner: How to Get the Most Out of AI Tools to Scale Your Process
2023 • DesignOps Summit 2023
Gold

More Videos

Jennifer Kanyamibwa

"Resiliency for me is not really a professional thing. It’s a lot more personal."

Jennifer Kanyamibwa

Creating the Blueprint: Growing and Building Design Teams

November 8, 2018

Brigette Metzler

"Research repositories and libraries are social things."

Brigette Metzler Dana Chrisfield

Research Repositories: A global project by the ResearchOps Community (Videoconference)

August 27, 2020

Carl Turner

"We assigned people to attend other teams’ meetings to help with integration and started being seen as leaders."

Carl Turner

You Can Do This: Understand and Solve Organizational Problems to Jumpstart a Dead Project

March 28, 2023

John Mortimer

"Sometimes you have to make something wrong on purpose to learn and improve it with others’ help."

John Mortimer Milan Guenther Lucy Ellis Patrick Quattlebaum

Panel Discussion

December 3, 2024

Dante Guintu

"The hardest lesson: being comfortable when you’re uncomfortable and figuring out how to create the most impact."

Dante Guintu

How to Crush the Talent Crunch

September 8, 2022

Richard Buchanan

"Design is a service profession, a humble profession, less significant than the lives of the people we serve."

Richard Buchanan

Creativity and Principles in the Flourishing Enterprise

June 15, 2018

Dan Willis

"Michelle Wong took her outside consulting experience inside at PwC to design tools for contractors."

Dan Willis

Theme 3: Intro

January 8, 2024

Dan Ward

"The Wright siblings had a sister, Catherine, who was a full participant and should also be remembered."

Dan Ward

Failure Friday #1 with Dan Ward

February 7, 2025

Chris Geison

"What got us here won’t get us where we want to go."

Chris Geison

Theme Two Intro

March 28, 2023