Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

SUS: A System Unusable for Twenty Percent of the Population
Gold
Wednesday, September 29, 2021 • DesignOps Summit 2021
Share the love for this talk
SUS: A System Unusable for Twenty Percent of the Population
Speakers: Sam Proulx
Link:

Summary

Did you know that the SUS creates biases in your research, affecting one in five people? That’s right! People with disabilities, especially those who use assistive technology, are not considered by most of the questions in the SUS. As a designer, this could lead to you making design decisions that don’t take into account 20 percent of the visitors to your website. When the SUS was invented, the author encouraged people to change it to suit different needs. In this talk, Samuel Proulx from Fable will discuss how Fable adapted the SUS to work for assistive technology users. Drawing from over five thousand hours of research and testing involving assistive technology users, we created the Accessible Usability Scale (AUS). This presentation will include trends in AUS responses since it was released in December of 2020.

Key Insights

  • Screen readers require highly semantic web design to allow efficient navigation by users.

  • Screen reader users often speed up the voice to 400-800 words per minute to match typical reading speeds.

  • Alternative navigation devices like head mice pose unique interaction challenges, such as difficulty with dropdown menus.

  • Low vision users benefit from screen magnifiers combined with color inversion to reduce eye fatigue.

  • Traditional think-aloud usability research creates high cognitive load for assistive tech users, requiring task chunking.

  • Accessibility research labs can unintentionally exclude participants due to physical travel and assistive tech setup issues.

  • The System Usability Scale (SUS) includes questions that assume uniform user abilities, limiting its effectiveness for people with disabilities.

  • Fable adapted SUS questions to better reflect the realities and technical contexts of assistive technology users.

  • Preliminary AUS results show screen reader users give lower usability scores than magnification or alternative navigation users.

  • Inclusive research methods must be flexible and adaptable to diverse assistive technologies to gather more representative data.

Notable Quotes

"What screen readers allow us to do is jump directly to bits of content we are interested in to replicate the visual experience of skimming a web page."

"Most screen reader users prefer robotic voices so they can speed them up and read very quickly."

"Travel to usability labs can take longer than the research session itself for people with disabilities."

"Every piece of assistive technology is highly customized to meet the needs of each individual person."

"If I’m talking over my screen reader, the researcher has no idea what either of us is saying."

"The original SUS questions don’t consider the extra layer of technology that gets in the way for people with disabilities."

"One question says I would need the support of a technical person to use this system—well I am a technical user, but the system is inaccessible."

"Screen magnification just leans on the existing way most people design and interact with websites—changing size and color."

"Screen readers have to do the most work to interpret websites due to lack of visual cues, which explains lower usability scores."

"The Accessible Usability Scale is still an experiment and we welcome feedback, criticism, and modifications to improve it."

Ask the Rosenbot
Susan Simon-Daniels
War Stories LIVE! Susan Simon-Daniels
2020 • Advancing Research 2020
Gold
Nicole Bergstrom
AccessibilityOps: Moving beyond “nice to have”
2024 • DesignOps Community
Emily DiLeo
Stronger Together: Lessons Learned from UX Research Ops
2024 • DesignOps 2024
Gold
Amy Thibodeau
Opening Keynote: Process and Ambiguity
2019 • DesignOps Summit 2019
Gold
Jack Moffett
SAFe or Sorry? (Videoconference)
2019 • Enterprise Community
Kathleen Asjes
Research Democratization: the Good, the Bad and the Ugly
2022 • Advancing Research 2022
Gold
Dr. Jamika D. Burge
Advancing the Inclusion of Womxn in Research Practices (Videoconference)
2022 • Advancing Research Community
Samuel Proulx
Designing beyond caricatures: Embracing real, diverse user needs
2024 • Advancing Service Design 2024
Gold
Elana Chapman
Getting started with accessibility research
2025 • Rosenfeld Community
Dave Malouf
Panel: Design Systems and Documentation
2017 • DesignOps Summit 2017
Gold
Savina Hawkins
Harnessing AI in UXR: Practical Strategies for Positive Impact
2024 • Advancing Research 2024
Gold
Sam Proulx
Prototype Reviews, People With Disabilities, and You
2021 • DesignOps Summit 2021
Gold
Jon Fukuda
Theme One Intro
2022 • DesignOps Summit 2022
Gold
Dave Hora
A Research Skills Evolution
2021 • Advancing Research 2021
Gold
Sarah Flamion
Complex Problem? Add Clarity by Combining Research and Systems Thinking
2020 • Advancing Research 2020
Gold
Laura Weiss
Turn Down the Heat: 3 Ways to Handle Conflict in the Moment
2024 • Rosenfeld Community

More Videos

Jennifer Kanyamibwa

"Sometimes you’re the leader, sometimes you’re at the end, sometimes you’re trying to get other folks to come in."

Jennifer Kanyamibwa

Creating the Blueprint: Growing and Building Design Teams

November 8, 2018

Brigette Metzler

"Research repositories and libraries are social things."

Brigette Metzler Dana Chrisfield

Research Repositories: A global project by the ResearchOps Community (Videoconference)

August 27, 2020

Carl Turner

"I like to engage my stakeholders as co-creators and co-discoverers because that makes persuasion so much easier."

Carl Turner

You Can Do This: Understand and Solve Organizational Problems to Jumpstart a Dead Project

March 28, 2023

John Mortimer

"We come in like water—hanging out, listening, figuring out where the blood flow is in the environment."

John Mortimer Milan Guenther Lucy Ellis Patrick Quattlebaum

Panel Discussion

December 3, 2024

Dante Guintu

"Information overload with checklists on top of checklists does not create a great onboarding experience."

Dante Guintu

How to Crush the Talent Crunch

September 8, 2022

Richard Buchanan

"The new marketing is about preparing users or customers for the new kinds of products that will emerge as time moves forward."

Richard Buchanan

Creativity and Principles in the Flourishing Enterprise

June 15, 2018

Dan Willis

"Michelle Wong took her outside consulting experience inside at PwC to design tools for contractors."

Dan Willis

Theme 3: Intro

January 8, 2024

Dan Ward

"The worst thing that could happen is we get cake — this encourages boldness."

Dan Ward

Failure Friday #1 with Dan Ward

February 7, 2025

Chris Geison

"We need to step out from informing decisions and into becoming changemakers."

Chris Geison

Theme Two Intro

March 28, 2023