Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

SUS: A System Unusable for Twenty Percent of the Population
Gold
Wednesday, June 9, 2021 • Design at Scale 2021
Share the love for this talk
SUS: A System Unusable for Twenty Percent of the Population
Speakers: Sam Proulx
Link:

Summary

Did you know that the SUS creates biases in your research, affecting one in five people? That’s right! People with disabilities, especially those who use assistive technology, are not considered by most of the questions in the SUS. When the SUS was invented, the author encouraged people to change it to suit different needs. In this talk, Samuel Proulx and Abid Virani from Fable will discuss how Fable adapted the SUS to work for assistive technology users. Drawing from over five thousand hours of research and testing involving assistive technology users, we created the Accessible Usability Scale (AUS). This presentation will include trends in AUS responses since it was released in December of 2020.

Key Insights

  • Assistive technology users fall broadly into three groups: screen reader users, screen magnification users, and alternative navigation users.

  • Screen reader users often face the greatest usability challenges due to lack of backup navigation options.

  • Screen magnification tools sometimes incorporate screen reader features to reduce eye strain and aid users with partial vision loss.

  • Alternative navigation users leverage multiple input methods, including voice commands, head mice, and coordinate grids, to overcome interaction barriers.

  • Traditional usability labs are poorly suited for testing with assistive technology users because they use unfamiliar setups that aren't customized.

  • Remote usability testing better captures authentic user experiences by allowing assistive technology users to test in their optimized environments.

  • The original System Usability Scale (SUS) includes language and assumptions that are often unclear or irrelevant to assistive technology users.

  • Fable developed an Accessible Usability Scale (AUS), modifying SUS questions to focus on specific features and removing technical assumptions for better relevance.

  • Experience level with assistive technology and timing of disability onset deeply influence users’ mental models and usability perceptions.

  • Usability should be assessed on both accessibility and efficiency — a feature that takes much longer for assistive technology users to complete may be considered inaccessible.

Notable Quotes

"Assistive technology is a group of technologies that people with disabilities use to access computers, grouped mainly into screen readers, magnification, and alternative navigation."

"The primary customization for screen reader users is speed — expert users can listen to synthetic voices at over 300 words per minute and fully understand."

"Magnification tools may include screen reader features because users can get eye strain and prefer to have content read aloud from a specific spot."

"If a screen reader can’t activate or describe a button, the user has no backup other than getting someone with sight involved."

"Traditional usability labs force assistive technology users to use unfamiliar setups, which can drastically impact their performance."

"Remote testing helps users be in comfortable, accessible environments with fully customized assistive technology setups."

"I am a technical person and I can't use this system — sometimes you don’t need a technical person, you just need someone who can see to help with barriers."

"Accessibility is a spectrum, not a checkbox — some features might require assistance but the rest of the product can be fully accessible."

"We’ve ruled out self-reporting skill levels because novice users often overestimate their expertise and near-experts underestimate theirs."

"It’s not just user skill with the system, but also the broader ways people use technology that determines their experience and accessibility needs."

Bria Alexander
Opening Remarks
2021 • DesignOps Summit 2021
Gold
George Abraham
Design Systems To-Go: Indigo.Design Overview and Exploring the Developer Workflow (Part 3)
2021 • DesignOps Summit 2021
Gold
Russ Unger
Getting Out from Under Everyone: How to Escape the Paralysis of Getting Started
2016 • Enterprise UX 2016
Gold
Ashley Cortez
Shifting Toward Community-Led Innovation in Local Government
2021 • Civic Design 2021
Gold
Alla Weinberg
Healing Toxic Stress
2024 • DesignOps 2024
Gold
Dan Willis
Enterprise Storytelling Sessions
2019 • Enterprise Experience 2019
Gold
Jon Fukuda
Theme One Intro
2023 • DesignOps Summit 2023
Gold
Sam Ladner
How Research Can Drive Strategic Foresight
2022 • Advancing Research 2022
Gold
JP Allen
Navigating the UX Tool Landscape
2021 • Advancing Research 2021
Gold
Louis Rosenfeld
Welcome / Housekeeping
2023 • Enterprise UX 2023
Gold
Abby Covert
Stuck? Diagrams Help (Videoconference)
2022 • DesignOps Community
Jim Kalbach
Jazz Improvisation as a Model for Team Collaboration
2019 • Enterprise Experience 2019
Gold
Amy Gawronski Zuccaro
Advice for DesignOps Employee #1
2021 • DesignOps Summit 2021
Gold
Sarah Williams
Verizon_A Framework for CX Transformation
2024 • Design at Scale 2021
Gold
Erin Weigel
Get Your Whole Team Testing to Design for Impact
2024 • Rosenfeld Community
Nancy Douyon
We'll Figure That Out in the Next Launch: Enterprise Tech's Nobility Complex
2018 • Enterprise Experience 2018
Gold

More Videos

Wyatt Hayman

"Researchers submit questions that get combined into one survey, translated, then responses are translated back for analysis."

Wyatt Hayman

Global Research Panels (Videoconference)

August 8, 2020

PJ Buddhari

"Naming things is the hardest thing; it’s an ongoing process involving components, their parts, and properties."

PJ Buddhari Nate Baldwin

Meet Spectrum, Adobe’s Design System

June 9, 2021

Sarah Gallimore

"When we stick to just verbal descriptions, a lot of nuance about future experiences gets lost."

Sarah Gallimore

Inspire Progress with Artifacts from the Future

November 18, 2022

Peter Merholz

"UX directors often feel like this poor person in the middle here getting pulled in all these directions."

Peter Merholz

The Trials and Tribulations of Directors of UX (Videoconference)

July 13, 2023

Dr. Jamika D. Burge

"Feeling heard and seen by research practitioners is one of the best compliments a participant can give."

Dr. Jamika D. Burge Mansi Gupta

Advancing the Inclusion of Womxn in Research Practices (Videoconference)

September 15, 2022

Amy Marquez

"You have to understand how your company actually makes money."

Amy Marquez

INVEST: Discussion

June 15, 2018

Dane DeSutter

"Games are not a point in time you run away from — you don’t just drop the cartridge and walk away."

Dane DeSutter Natalie Gedeon Deborah Hendersen Cheryl Platz

Beyond the Console: The rise of the Gamer Experience and how gaming will impact UX Research across industries (Videoconference)

May 17, 2024

Zariah Cameron

"Share everything, own nothing but credit everyone."

Zariah Cameron

ReDesigning Wellbeing for Equitable Care in the Workplace

September 23, 2024

Jessica Norris

"Inclusive design is a process involving neurodivergent people at every stage, not just an outcome."

Jessica Norris

ADHD: A DesignOps Superpower

September 9, 2022