Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

SUS: A System Unusable for Twenty Percent of the Population
Gold
Wednesday, September 29, 2021 • DesignOps Summit 2021
Share the love for this talk
SUS: A System Unusable for Twenty Percent of the Population
Speakers: Sam Proulx
Link:

Summary

Did you know that the SUS creates biases in your research, affecting one in five people? That’s right! People with disabilities, especially those who use assistive technology, are not considered by most of the questions in the SUS. As a designer, this could lead to you making design decisions that don’t take into account 20 percent of the visitors to your website. When the SUS was invented, the author encouraged people to change it to suit different needs. In this talk, Samuel Proulx from Fable will discuss how Fable adapted the SUS to work for assistive technology users. Drawing from over five thousand hours of research and testing involving assistive technology users, we created the Accessible Usability Scale (AUS). This presentation will include trends in AUS responses since it was released in December of 2020.

Key Insights

  • Screen readers require highly semantic web design to allow efficient navigation by users.

  • Screen reader users often speed up the voice to 400-800 words per minute to match typical reading speeds.

  • Alternative navigation devices like head mice pose unique interaction challenges, such as difficulty with dropdown menus.

  • Low vision users benefit from screen magnifiers combined with color inversion to reduce eye fatigue.

  • Traditional think-aloud usability research creates high cognitive load for assistive tech users, requiring task chunking.

  • Accessibility research labs can unintentionally exclude participants due to physical travel and assistive tech setup issues.

  • The System Usability Scale (SUS) includes questions that assume uniform user abilities, limiting its effectiveness for people with disabilities.

  • Fable adapted SUS questions to better reflect the realities and technical contexts of assistive technology users.

  • Preliminary AUS results show screen reader users give lower usability scores than magnification or alternative navigation users.

  • Inclusive research methods must be flexible and adaptable to diverse assistive technologies to gather more representative data.

Notable Quotes

"What screen readers allow us to do is jump directly to bits of content we are interested in to replicate the visual experience of skimming a web page."

"Most screen reader users prefer robotic voices so they can speed them up and read very quickly."

"Travel to usability labs can take longer than the research session itself for people with disabilities."

"Every piece of assistive technology is highly customized to meet the needs of each individual person."

"If I’m talking over my screen reader, the researcher has no idea what either of us is saying."

"The original SUS questions don’t consider the extra layer of technology that gets in the way for people with disabilities."

"One question says I would need the support of a technical person to use this system—well I am a technical user, but the system is inaccessible."

"Screen magnification just leans on the existing way most people design and interact with websites—changing size and color."

"Screen readers have to do the most work to interpret websites due to lack of visual cues, which explains lower usability scores."

"The Accessible Usability Scale is still an experiment and we welcome feedback, criticism, and modifications to improve it."

Ask the Rosenbot
Jon Fukuda
The Big Question about Innovation: A Panel Discussion
2024 • DesignOps 2024
Gold
Savina Hawkins
Harnessing AI in UXR: Practical Strategies for Positive Impact
2024 • Advancing Research 2024
Gold
Jennifer Fraser
What would Emmy Noether Do? Math, Models and Mulling in UX Research
2023 • Advancing Research 2023
Gold
Lada Gorlenko
Theme 1: Discussion
2024 • Enterprise Experience 2020
Gold
Michelle Bejian Lotia
Rolling Out a Repository: How Zapier Centralizes Insights from Across their Organization
2023 • Advancing Research 2023
Gold
Jacqui Frey
Panel Discussion: Integrating DesignOps
2018 • DesignOps Summit 2018
Gold
Alexandra Schmidt
Enterprise UX Playbook (Videoconference)
2022 • Enterprise Community
Tamara Hale
War Stories LIVE! Tamara Hale
2020 • Advancing Research 2020
Gold
George Abraham
Design Systems To-Go: Indigo.Design Overview and Exploring the Developer Workflow (Part 3)
2021 • DesignOps Summit 2021
Gold
Ned Gartside
Navigating accessibility and climate (Videoconference)
2024 • Climate UX Interest Group (Rosenfeld Community)
Emily Eagle
Can't Rewind: Radio and Retail
2019 • Enterprise Experience 2019
Gold
Alison Rand
Scaling Impact with Service Design (Videoconference)
2021 • DesignOps Community
Lily Aduana
5 Reasons to Bring Your Recruiting in-House (and How To Do It)
2021 • Advancing Research 2021
Gold
Kristin Skinner
Theme 1 Intro
2021 • DesignOps Summit 2021
Gold
Christian Crumlish
Afternoon Insights Panel
2022 • Design in Product 2022
Gold
Victor Udoewa
Radical Participatory Design: Decolonizing Participatory Design Processes
2021 • Civic Design 2021
Gold

More Videos

"Teaching product managers heuristics took 15 minutes, and now they use that shared language to articulate design."

Standardizing Product Merits for Leaders, Designers, and Everyone

June 15, 2018

Simon Wardley

"The only people who can effectively map a space are those who work and understand that space intimately."

Simon Wardley

Maps and Topographical Intelligence (Videoconference)

January 31, 2019

Sandra Camacho

"Bias is a tendency, feeling or opinion for or against something without reason or evidence."

Sandra Camacho

Creating More Bias-Proof Designs

January 22, 2025

Darian Davis

"Reviewing decision points creates a source of truth and makes it harder to forget or scrap earlier agreements."

Darian Davis

Lessons from a Toxic Work Relationship

January 8, 2024

Fisayo Osilaja

"We mitigated data privacy risks by subscribing to the corporate plan for ChatGPT, which offers enhanced security."

Fisayo Osilaja

[Demo] The AI edge: From researcher to strategist

June 4, 2024

Uday Gajendar

"How do you create a sense of craft in an environment fraught with ambiguity, complexity, and anxiety?"

Uday Gajendar

The Wicked Craft of Enterprise UX

May 13, 2015

Davis Neable

"No official kickoff was held, which meant shifting expectations and lack of alignment."

Davis Neable Guy Segal

How to Drive a Design Project When you Don’t Have a Design Team

June 10, 2021

Eniola Oluwole

"People were very adverse to changes because a small 0.5% conversion increase meant millions in revenue."

Eniola Oluwole

Lessons From the DesignOps Journey of the World's Largest Travel Site

October 24, 2019

Aurobinda Pradhan

"Design producers love their creative tools and want to keep using them without multiple manual reporting steps."

Aurobinda Pradhan Shashank Deshpande

Introduction to Collaborative DesignOps using Cubyts

September 9, 2022