Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

SUS: A System Unusable for Twenty Percent of the Population
Gold
Wednesday, September 29, 2021 • DesignOps Summit 2021
Share the love for this talk
SUS: A System Unusable for Twenty Percent of the Population
Speakers: Sam Proulx
Link:

Summary

Did you know that the SUS creates biases in your research, affecting one in five people? That’s right! People with disabilities, especially those who use assistive technology, are not considered by most of the questions in the SUS. As a designer, this could lead to you making design decisions that don’t take into account 20 percent of the visitors to your website. When the SUS was invented, the author encouraged people to change it to suit different needs. In this talk, Samuel Proulx from Fable will discuss how Fable adapted the SUS to work for assistive technology users. Drawing from over five thousand hours of research and testing involving assistive technology users, we created the Accessible Usability Scale (AUS). This presentation will include trends in AUS responses since it was released in December of 2020.

Key Insights

  • Screen readers require highly semantic web design to allow efficient navigation by users.

  • Screen reader users often speed up the voice to 400-800 words per minute to match typical reading speeds.

  • Alternative navigation devices like head mice pose unique interaction challenges, such as difficulty with dropdown menus.

  • Low vision users benefit from screen magnifiers combined with color inversion to reduce eye fatigue.

  • Traditional think-aloud usability research creates high cognitive load for assistive tech users, requiring task chunking.

  • Accessibility research labs can unintentionally exclude participants due to physical travel and assistive tech setup issues.

  • The System Usability Scale (SUS) includes questions that assume uniform user abilities, limiting its effectiveness for people with disabilities.

  • Fable adapted SUS questions to better reflect the realities and technical contexts of assistive technology users.

  • Preliminary AUS results show screen reader users give lower usability scores than magnification or alternative navigation users.

  • Inclusive research methods must be flexible and adaptable to diverse assistive technologies to gather more representative data.

Notable Quotes

"What screen readers allow us to do is jump directly to bits of content we are interested in to replicate the visual experience of skimming a web page."

"Most screen reader users prefer robotic voices so they can speed them up and read very quickly."

"Travel to usability labs can take longer than the research session itself for people with disabilities."

"Every piece of assistive technology is highly customized to meet the needs of each individual person."

"If I’m talking over my screen reader, the researcher has no idea what either of us is saying."

"The original SUS questions don’t consider the extra layer of technology that gets in the way for people with disabilities."

"One question says I would need the support of a technical person to use this system—well I am a technical user, but the system is inaccessible."

"Screen magnification just leans on the existing way most people design and interact with websites—changing size and color."

"Screen readers have to do the most work to interpret websites due to lack of visual cues, which explains lower usability scores."

"The Accessible Usability Scale is still an experiment and we welcome feedback, criticism, and modifications to improve it."

Ask the Rosenbot
Lija Hogan
Doing more with more: Lessons from the Front Lines of Democratization
2022 • Advancing Research 2022
Gold
Wendy Johansson
An Education on Design Education for Orgs
2021 • Design at Scale 2021
Gold
Amelia Cole
Data-Prompted Interviews
2021 • QuantQual Interest Group (Rosenfeld Community)
Emily DiLeo
Stronger Together: Lessons Learned from UX Research Ops
2024 • DesignOps 2024
Gold
Ned Dwyer
The Future of DesignOps is Tool Consolidation
2024 • DesignOps 2024
Gold
Bria Alexander
Reflect and Chart Forward
2021 • Civic Design 2021
Gold
Bria Alexander
Opening Remarks
2022 • Civic Design 2022
Gold
Smitha Papolu
Theme 3 Discussion
2024 • Enterprise Experience 2020
Gold
Dan Ward
Failure Friday #1 with Dan Ward
2025 • Rosenfeld Community
Marieke McCloskey
User Science: Product Analytics & User Research
2021 • Advancing Research 2021
Gold
Kavana Ramesh
Meaningful inclusion: Practicing accessibility research with confidence
2024 • DesignOps 2024
Gold
Justin Entzminger
Risk and Reward: How to Diversify the Field of Civic Innovators and Designers
2022 • Civic Design 2022
Gold
Catt Small
Moving from Execution to Strategy as a Designer
2022 • Design in Product 2022
Gold
Farid Sabitov
Automatization for Large Enterprise Teams
2024 • DesignOps Summit 2020
Gold
Jemma Ahmed
Theme Three Intro
2023 • Advancing Research 2023
Gold
Christian Crumlish
Introduction by our Conference Chair
2022 • Design in Product 2022
Gold

More Videos

Alex Hurworth

"Innovation in conservation practices is desperately needed to keep pace with environmental changes."

Alex Hurworth Bonnie John Fahd Arshad Antoine Marin

Designing a Contact Tracing App for Universal Access

October 23, 2020

Laine Riley Prokay

"Preparation is critical to ensure new employees have everything they need prior to their first day and the first few weeks."

Laine Riley Prokay Lisa Gordon

Carving a Path for Early Career DesignOps Practitioners

September 9, 2022

Eniola Oluwole

"TripAdvisor is really nine major business units each thinking like sub companies instead of one end-to-end user experience."

Eniola Oluwole

Lessons From the DesignOps Journey of the World's Largest Travel Site

October 24, 2019

Nathan Shedroff

"Design researchers know customers better than almost anyone else in the organization, yet they are rarely invited into strategy processes."

Nathan Shedroff

Double Your Mileage: Use Your Research Strategically

March 31, 2020

Sam Proulx

"You can just pick up your phone and start testing accessibility instantly without procurement or licensing hurdles."

Sam Proulx

Mobile Accessibility: Why Moving Accessibility Beyond the Desktop is Critical in a Mobile-first World

November 17, 2022

Feleesha Sterling

"At LinkedIn, rapid research uncovered trends across products that helped reduce duplicate work."

Feleesha Sterling

Building a Rapid Research Program (Videoconference)

May 18, 2023

Neil Barrie

"Bumble’s single feature of women making the first move addressed a huge cultural challenge and lifted the brand."

Neil Barrie

Widening the Aperture: The Case for Taking a Broader Lens to the Dialogue between Products and Culture

March 25, 2024

John Devanney

"Design systems help bridge the gap between design and development, but collaboration remains key."

John Devanney

The Design Management Office

November 6, 2017

Katy Mogal

"We decided to jump off the wall — it was scary but the opportunity was too big to pass up."

Katy Mogal

But Do Your Insights Scale?

March 12, 2021