Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

SUS: A System Unusable for Twenty Percent of the Population
Gold
Wednesday, September 29, 2021 • DesignOps Summit 2021
Share the love for this talk
SUS: A System Unusable for Twenty Percent of the Population
Speakers: Sam Proulx
Link:

Summary

Did you know that the SUS creates biases in your research, affecting one in five people? That’s right! People with disabilities, especially those who use assistive technology, are not considered by most of the questions in the SUS. As a designer, this could lead to you making design decisions that don’t take into account 20 percent of the visitors to your website. When the SUS was invented, the author encouraged people to change it to suit different needs. In this talk, Samuel Proulx from Fable will discuss how Fable adapted the SUS to work for assistive technology users. Drawing from over five thousand hours of research and testing involving assistive technology users, we created the Accessible Usability Scale (AUS). This presentation will include trends in AUS responses since it was released in December of 2020.

Key Insights

  • Screen readers require highly semantic web design to allow efficient navigation by users.

  • Screen reader users often speed up the voice to 400-800 words per minute to match typical reading speeds.

  • Alternative navigation devices like head mice pose unique interaction challenges, such as difficulty with dropdown menus.

  • Low vision users benefit from screen magnifiers combined with color inversion to reduce eye fatigue.

  • Traditional think-aloud usability research creates high cognitive load for assistive tech users, requiring task chunking.

  • Accessibility research labs can unintentionally exclude participants due to physical travel and assistive tech setup issues.

  • The System Usability Scale (SUS) includes questions that assume uniform user abilities, limiting its effectiveness for people with disabilities.

  • Fable adapted SUS questions to better reflect the realities and technical contexts of assistive technology users.

  • Preliminary AUS results show screen reader users give lower usability scores than magnification or alternative navigation users.

  • Inclusive research methods must be flexible and adaptable to diverse assistive technologies to gather more representative data.

Notable Quotes

"What screen readers allow us to do is jump directly to bits of content we are interested in to replicate the visual experience of skimming a web page."

"Most screen reader users prefer robotic voices so they can speed them up and read very quickly."

"Travel to usability labs can take longer than the research session itself for people with disabilities."

"Every piece of assistive technology is highly customized to meet the needs of each individual person."

"If I’m talking over my screen reader, the researcher has no idea what either of us is saying."

"The original SUS questions don’t consider the extra layer of technology that gets in the way for people with disabilities."

"One question says I would need the support of a technical person to use this system—well I am a technical user, but the system is inaccessible."

"Screen magnification just leans on the existing way most people design and interact with websites—changing size and color."

"Screen readers have to do the most work to interpret websites due to lack of visual cues, which explains lower usability scores."

"The Accessible Usability Scale is still an experiment and we welcome feedback, criticism, and modifications to improve it."

Ask the Rosenbot
Jennifer Bolduc
What's involved with getting people back to work?: A panel discussion (Videoconference)
2021 • DesignOps Community
Sara Logel
Your Colleagues are Your Users Too
2023 • Advancing Research 2023
Gold
Dr. Jamika D. Burge
Broad Strokes: Connecting Design, Research, and AI to the World Around Us
2023 • Enterprise UX 2023
Gold
Victor M. Gonzalez
Practicing Learners and Learning Practitioners
2021 • Advancing Research 2021
Gold
Greg Petroff
The Compass Mission
2021 • Advancing Research 2021
Gold
Sha Hwang
The First Fifty Years of Civic Design
2022 • Civic Design 2022
Gold
Dan Hill
Strategic design, slowdown, and the infrastructures of everyday life (Videoconference)
2022 • Enterprise Community
Ted Booth
Discussion
2016 • Enterprise UX 2016
Gold
Josh Clark
Sentient Design: New Postures for AI-Mediated Experiences (2nd of 3 seminars)
2025 • Rosenfeld Community
DesignOps Community Sensing Session (Videoconference)
2021 • DesignOps Community
Robin Beers
Panel: Excellence in Communicating Insights
2024 • Advancing Research 2024
Gold
Zariah Cameron
Streamlining an Inclusive Design Practice
2023 • DesignOps Summit 2023
Gold
Megan Campos
What Did I Miss? The Hidden Costs of Deprioritizing Diversity in User Research
2021 • Advancing Research 2021
Gold
Abbey Smalley
Today’s Design Ops and Programs Landscape & Career Paths
2023 • DesignOps Summit 2023
Gold
Lada Gorlenko
Theme 1: Discussion
2024 • Enterprise Experience 2020
Gold
Megan Blocker
Getting to the “So What?”: How Management Consulting Practices Can Transform Your Approach to Research
2024 • Advancing Research 2024
Gold

More Videos

Angelos Arnis

"In a landscape focusing on efficiency and profit, we need to help design transition from production to strategic focus."

Angelos Arnis

Navigating the Rapid Shifts in Tech's Turbulent Terrain

October 2, 2023

John Calhoun

"Interviewing for design ops needs a special toolkit that shows how to present your skills and prepare effectively."

John Calhoun Rachel Posman

Bring your DesignOps Story to Life! The Definitive DesignOps Book Jam

October 3, 2023

Alfred Kahn

"If you don’t measure, it’s like a tree falling in the forest with no one around to hear it."

Alfred Kahn

A Seat at the Table: Making Your Team a Strategic Partner

November 29, 2023

Dan Willis

"When you accept differences and adjust, you can learn what you’re capable of."

Dan Willis

Enterprise Storytelling Sessions

June 3, 2019

John Maeda

"You have to give respect to get respect—it's the foundation for connecting people across teams."

John Maeda Alison Rand

About Design Organizations (Videoconference)

May 13, 2019

Anat Fintzi

"We consolidated over 10 configurable tools into one holistic supply chain management tool this year."

Anat Fintzi Rachel Minnicks

Delivering at Scale: Making Traction with Resistant Partners

June 9, 2022

Uday Gajendar

"Craft cultivates customer satisfaction, loyalty, and even forgiveness when functional issues arise."

Uday Gajendar

The Wicked Craft of Enterprise UX

May 13, 2015

Kristin Skinner

"We were really forming a community of people who I like to call maybe design ops curious."

Kristin Skinner

Theme 1 Intro

September 29, 2021

Maish Nichani

"Singapore is a nation by design. Nothing we have today is natural or happened by itself—somebody thought about it and made it happen."

Maish Nichani

Sparking a Service Excellence Mindset at a Government Agency

December 9, 2021