Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

SUS: A System Unusable for Twenty Percent of the Population
Gold
Wednesday, June 9, 2021 • Design at Scale 2021
Share the love for this talk
SUS: A System Unusable for Twenty Percent of the Population
Speakers: Sam Proulx
Link:

Summary

Did you know that the SUS creates biases in your research, affecting one in five people? That’s right! People with disabilities, especially those who use assistive technology, are not considered by most of the questions in the SUS. When the SUS was invented, the author encouraged people to change it to suit different needs. In this talk, Samuel Proulx and Abid Virani from Fable will discuss how Fable adapted the SUS to work for assistive technology users. Drawing from over five thousand hours of research and testing involving assistive technology users, we created the Accessible Usability Scale (AUS). This presentation will include trends in AUS responses since it was released in December of 2020.

Key Insights

  • Assistive technology users fall broadly into three groups: screen reader users, screen magnification users, and alternative navigation users.

  • Screen reader users often face the greatest usability challenges due to lack of backup navigation options.

  • Screen magnification tools sometimes incorporate screen reader features to reduce eye strain and aid users with partial vision loss.

  • Alternative navigation users leverage multiple input methods, including voice commands, head mice, and coordinate grids, to overcome interaction barriers.

  • Traditional usability labs are poorly suited for testing with assistive technology users because they use unfamiliar setups that aren't customized.

  • Remote usability testing better captures authentic user experiences by allowing assistive technology users to test in their optimized environments.

  • The original System Usability Scale (SUS) includes language and assumptions that are often unclear or irrelevant to assistive technology users.

  • Fable developed an Accessible Usability Scale (AUS), modifying SUS questions to focus on specific features and removing technical assumptions for better relevance.

  • Experience level with assistive technology and timing of disability onset deeply influence users’ mental models and usability perceptions.

  • Usability should be assessed on both accessibility and efficiency — a feature that takes much longer for assistive technology users to complete may be considered inaccessible.

Notable Quotes

"Assistive technology is a group of technologies that people with disabilities use to access computers, grouped mainly into screen readers, magnification, and alternative navigation."

"The primary customization for screen reader users is speed — expert users can listen to synthetic voices at over 300 words per minute and fully understand."

"Magnification tools may include screen reader features because users can get eye strain and prefer to have content read aloud from a specific spot."

"If a screen reader can’t activate or describe a button, the user has no backup other than getting someone with sight involved."

"Traditional usability labs force assistive technology users to use unfamiliar setups, which can drastically impact their performance."

"Remote testing helps users be in comfortable, accessible environments with fully customized assistive technology setups."

"I am a technical person and I can't use this system — sometimes you don’t need a technical person, you just need someone who can see to help with barriers."

"Accessibility is a spectrum, not a checkbox — some features might require assistance but the rest of the product can be fully accessible."

"We’ve ruled out self-reporting skill levels because novice users often overestimate their expertise and near-experts underestimate theirs."

"It’s not just user skill with the system, but also the broader ways people use technology that determines their experience and accessibility needs."

Ask the Rosenbot
Ethics in Tech Education: Designing to Provide Opportunity for All
2018 • Enterprise Experience 2018
Gold
William Newton
How to Lead With Data, and Without Data
2023 • Enterprise UX 2023
Gold
Corey Nelson
Layoffs (Videoconference)
2022 • Advancing Research Community
Dave Malouf
Closing Keynote: Amplify. Not Optimize.
2019 • DesignOps Summit 2019
Gold
Kelly Dern
AI as a Design Partner: How to Get the Most Out of AI Tools to Scale Your Process
2023 • DesignOps Summit 2023
Gold
Erin May
Distributed, Democratized, Decentralized: Finding a Research Model to Support Your Org
2022 • Advancing Research 2022
Gold
Christian Bason
Expand—Rethinking Design for Public Challenges (Videoconference)
2022 • Civic Design Community
Sharbani Dhar
Breathing Room for Delight
2024 • Enterprise Experience 2020
Gold
Matt Duignan
HITS, Microsoft's internal human insight system: From research library to living body of knowledge (Videoconference)
2019 • Advancing Research Community
Theresa Neil
Designing for Wellness: Specializing in Healthcare (Videoconference)
2024 • Rosenfeld Community
Alexandra Schmidt
Why Ethics Can't Save Tech
2022 • Civic Design 2022
Gold
Joseph Williams
Unlocking impact and influence through inclusive hiring in research (Videoconference)
2021 • Advancing Research Community
Alissa Briggs
How to Coach Enterprise Experimentation
2015 • Enterprise UX 2015
Gold
Bria Alexander
Day 3 Welcome
2024 • DesignOps 2024
Gold
Sam Proulx
Designing For Screen Readers: Understanding the Mental Models and Techniques of Real Users
2021 • Civic Design 2021
Gold
Dorelle Rabinowitz
The Magic Word is Trust
2018 • Enterprise Experience 2018
Gold

More Videos

"Scale isn’t just about quantity, it’s about the quality and impact you have on the outcomes of the organization."

Standardizing Product Merits for Leaders, Designers, and Everyone

June 15, 2018

Simon Wardley

"You can mine metadata from your platform to spot emerging patterns and commoditize new components."

Simon Wardley

Maps and Topographical Intelligence (Videoconference)

January 31, 2019

Sandra Camacho

"The Reflexive Compass helps us discern bias patterns early, take accountability, and measure impact."

Sandra Camacho

Creating More Bias-Proof Designs

January 22, 2025

Darian Davis

"Taking responsibility starts with an apology and seeking regular feedback."

Darian Davis

Lessons from a Toxic Work Relationship

January 8, 2024

Fisayo Osilaja

"Providing more holistic recommendations helped us gain more trust and buy-in from stakeholders, increasing UX maturity."

Fisayo Osilaja

[Demo] The AI edge: From researcher to strategist

June 4, 2024

Uday Gajendar

"Empowering maker culture invites everyone to be part of a collective endeavor far beyond any individual."

Uday Gajendar

The Wicked Craft of Enterprise UX

May 13, 2015

Davis Neable

"We formed a small core task force empowered to make decisions to avoid delays from formal reviews."

Davis Neable Guy Segal

How to Drive a Design Project When you Don’t Have a Design Team

June 10, 2021

Eniola Oluwole

"If you come with a big idea, they’ll try to dial you back to the smallest iota you can test first."

Eniola Oluwole

Lessons From the DesignOps Journey of the World's Largest Travel Site

October 24, 2019

Aurobinda Pradhan

"Product managers feel design is a black box; they want visibility, transparency, and accountability on timelines."

Aurobinda Pradhan Shashank Deshpande

Introduction to Collaborative DesignOps using Cubyts

September 9, 2022