Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

SUS: A System Unusable for Twenty Percent of the Population
Gold
Wednesday, September 29, 2021 • DesignOps Summit 2021
Share the love for this talk
SUS: A System Unusable for Twenty Percent of the Population
Speakers: Sam Proulx
Link:

Summary

Did you know that the SUS creates biases in your research, affecting one in five people? That’s right! People with disabilities, especially those who use assistive technology, are not considered by most of the questions in the SUS. As a designer, this could lead to you making design decisions that don’t take into account 20 percent of the visitors to your website. When the SUS was invented, the author encouraged people to change it to suit different needs. In this talk, Samuel Proulx from Fable will discuss how Fable adapted the SUS to work for assistive technology users. Drawing from over five thousand hours of research and testing involving assistive technology users, we created the Accessible Usability Scale (AUS). This presentation will include trends in AUS responses since it was released in December of 2020.

Key Insights

  • Screen readers require highly semantic web design to allow efficient navigation by users.

  • Screen reader users often speed up the voice to 400-800 words per minute to match typical reading speeds.

  • Alternative navigation devices like head mice pose unique interaction challenges, such as difficulty with dropdown menus.

  • Low vision users benefit from screen magnifiers combined with color inversion to reduce eye fatigue.

  • Traditional think-aloud usability research creates high cognitive load for assistive tech users, requiring task chunking.

  • Accessibility research labs can unintentionally exclude participants due to physical travel and assistive tech setup issues.

  • The System Usability Scale (SUS) includes questions that assume uniform user abilities, limiting its effectiveness for people with disabilities.

  • Fable adapted SUS questions to better reflect the realities and technical contexts of assistive technology users.

  • Preliminary AUS results show screen reader users give lower usability scores than magnification or alternative navigation users.

  • Inclusive research methods must be flexible and adaptable to diverse assistive technologies to gather more representative data.

Notable Quotes

"What screen readers allow us to do is jump directly to bits of content we are interested in to replicate the visual experience of skimming a web page."

"Most screen reader users prefer robotic voices so they can speed them up and read very quickly."

"Travel to usability labs can take longer than the research session itself for people with disabilities."

"Every piece of assistive technology is highly customized to meet the needs of each individual person."

"If I’m talking over my screen reader, the researcher has no idea what either of us is saying."

"The original SUS questions don’t consider the extra layer of technology that gets in the way for people with disabilities."

"One question says I would need the support of a technical person to use this system—well I am a technical user, but the system is inaccessible."

"Screen magnification just leans on the existing way most people design and interact with websites—changing size and color."

"Screen readers have to do the most work to interpret websites due to lack of visual cues, which explains lower usability scores."

"The Accessible Usability Scale is still an experiment and we welcome feedback, criticism, and modifications to improve it."

Bilan Hashi
The Tension Between Story Collecting and Story Telling in Research
2021 • Advancing Research 2021
Gold
Niko Laitinen
Adaptable Org Design for Resilient Times
2021 • Design at Scale 2021
Gold
Davis Neable
How to Drive a Design Project When you Don’t Have a Design Team
2021 • Design at Scale 2021
Gold
Chris Geison
Theme Two Intro
2023 • Advancing Research 2023
Gold
Nicole Bergstrom
AccessibilityOps: Moving beyond “nice to have”
2024 • DesignOps Community
Pippa Lomas
Paving the Path for Neurodiversity in Design
2023 • DesignOps Summit 2023
Gold
Jon Fukuda
Theme One Intro
2022 • DesignOps Summit 2022
Gold
Max Gadney
Assessing UX jobs for impact in climate
2024 • Climate UX Interest Group (Rosenfeld Community)
Luz Bratcher
This Is a Talk for Tired People
2022 • Design at Scale 2022
Gold
James Chudley
Decarbonising User Journeys: How minimising enables us to do more with less
2025 • Climate UX Interest Group (Rosenfeld Community)
Jemma Ahmed
Democratization: Working with it, not against it [Advancing Research Community Workshop Series]
2024 • Advancing Research Community
JP Allen
Navigating the UX Tool Landscape
2021 • Advancing Research 2021
Gold
Ariel Kennan
Theme 2 Intro
2021 • Civic Design 2021
Gold
Doug Powell
Closing Keynote: Design at Scale
2018 • DesignOps Summit 2018
Gold
Sam Proulx
Mobile Accessibility: Why Moving Accessibility Beyond the Desktop is Critical in a Mobile-first World
2022 • Civic Design 2022
Gold
April Reagan
Look, Think, Act: The Futures-Smart Design Organization
2021 • DesignOps Summit 2021
Gold

More Videos

Wyatt Hayman

"Panels enable researchers to check cultural assumptions and sensitivities before launching larger studies."

Wyatt Hayman

Global Research Panels (Videoconference)

August 8, 2020

PJ Buddhari

"Instead of choosing colors and then checking contrast, we define target contrast ratios first and generate colors accordingly."

PJ Buddhari Nate Baldwin

Meet Spectrum, Adobe’s Design System

June 9, 2021

Sarah Gallimore

"A reparations invoice artifact imagines holding largest climate change contributors accountable with multi-trillion dollar bills."

Sarah Gallimore

Inspire Progress with Artifacts from the Future

November 18, 2022

Peter Merholz

"Middle managers are responsible for the how—process, coordination, and communication—and you don’t see the value of that until it’s missing."

Peter Merholz

The Trials and Tribulations of Directors of UX (Videoconference)

July 13, 2023

Dr. Jamika D. Burge

"Intersectionality is a framework to describe compounding levels of discrimination people experience."

Dr. Jamika D. Burge Mansi Gupta

Advancing the Inclusion of Womxn in Research Practices (Videoconference)

September 15, 2022

Amy Marquez

"The person in the company most concerned about ethical stuff can often be the lawyer."

Amy Marquez

INVEST: Discussion

June 15, 2018

Dane DeSutter

"Do you play games? Cool, you’re in. Stop asking questions. It’s about behavior, not identity."

Dane DeSutter Natalie Gedeon Deborah Hendersen Cheryl Platz

Beyond the Console: The rise of the Gamer Experience and how gaming will impact UX Research across industries (Videoconference)

May 17, 2024

Zariah Cameron

"Stop saying rest is a luxury or a privilege. It is not. It is a human right."

Zariah Cameron

ReDesigning Wellbeing for Equitable Care in the Workplace

September 23, 2024

Jessica Norris

"Regular positive feedback, not just negative, is essential because many with ADHD rely on extrinsic motivation."

Jessica Norris

ADHD: A DesignOps Superpower

September 9, 2022