Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

SUS: A System Unusable for Twenty Percent of the Population
Gold
Thursday, December 9, 2021 • Civic Design 2021
Share the love for this talk
SUS: A System Unusable for Twenty Percent of the Population
Speakers: Sam Proulx
Link:

Summary

Did you know that the SUS creates biases in your research, affecting one in five people? That’s right!  People with disabilities, especially those who use assistive technology, are not considered by most of the questions in the SUS. As a designer for the public sector, this could lead to you making design decisions that don’t take into account 20 percent of the visitors to your website.

Key Insights

  • Traditional System Usability Scale questions can be confusing or irrelevant for assistive technology users.

  • Assistive technology users heavily customize their tools; default configurations in research labs misrepresent real-world experiences.

  • Screen reader users tend to report significantly lower usability scores than low vision or alternative navigation users.

  • Alternative navigation users choose tools based on specific tasks and physical condition, not one tool fits all.

  • Research methods involving simultaneous talking and screen reader output confuse participants and researchers alike.

  • Environmental and technical factors in usability labs often create unfamiliar, stressful test settings for disabled users.

  • Breaking tasks into smaller chunks improves research session clarity for screen reader users.

  • Inclusive design benefits from measuring usability specifically tailored to assistive technology contexts.

  • Lower usability scores can reflect long-term lowered expectations among experienced assistive tech users.

  • Fable’s Accessible Usability Scale is freely available online and invites iteration and adoption by product teams.

Notable Quotes

"I consider myself a very technical person, but the reason I can’t use the website isn’t because I’m not technical enough; it’s because it’s not working with my screen reader."

"Taking me into an assistive technology lab means using a screen reader that probably hasn’t been configured by anyone familiar with the technology."

"Alternative navigation users pick the tool that is right for the job, depending on their physical condition and task."

"Breaking tasks into little chunks avoids the confusion of talking while the screen reader is talking."

"The system usability scale didn’t consider people relying on assistive technology, so answers were often inaccurate or misunderstood."

"Screen reader users score significantly lower on usability, often reflecting the most complex interpretation demands."

"Things that can’t be measured don’t happen, so having a tailored usability scale matters for progress."

"Issues that are minor for general users represent broader usability barriers for assistive technology users."

"We invite others to leverage, evaluate, criticize, and modify the Accessible Usability Scale to improve measurement."

"Inclusive design is the most robust way to build great products that work for everyone."

Ask the Rosenbot
Sam Proulx
To Boldly Go: The New Frontiers of Accessibility
2022 • Design at Scale 2022
Gold
Ana Maria Montero Barrantes
The Authentic UX Talent Show
2024 • Enterprise Experience 2020
Gold
Luz Bratcher
This Is a Talk for Tired People
2022 • Design at Scale 2022
Gold
Bria Alexander
Opening Remarks Day 1
2024 • Advancing Research 2024
Gold
Andy Warr
Under My (Research) Umbrella: The Benefits and Challenges of Building a Unified Insights Function
2024 • Advancing Research 2024
Gold
Kate Koch
Flex Your Super Powers: When a Design Ops Team Scales to Power CX
2021 • DesignOps Summit 2021
Gold
Dan Hill
Strategic design, slowdown, and the infrastructures of everyday life (Videoconference)
2022 • Enterprise Community
Steve Sanderson
Discussion
2015 • Enterprise UX 2015
Gold
Eniola Oluwole
Lessons From the DesignOps Journey of the World's Largest Travel Site
2019 • DesignOps Summit 2019
Gold
Bria Alexander
OKRs—Helpful or Harmful? (Videoconference)
2022 • DesignOps Community
Bob Baxley
Leading with Design Operations Past and Present (Videoconference)
2019 • DesignOps Community
Sarah Gallimore
Inspire Progress with Artifacts from the Future
2022 • Civic Design 2022
Gold
Lori Muszynski
Keeping Design Weird
2023 • DesignOps Summit 2023
Gold
Victor Udoewa
Beyond Methods and Diversity: The Roots of Inclusion
2024 • Advancing Research 2024
Gold
Liwei Dai
The Heart and Brain of the AI Research
2020 • Advancing Research 2020
Gold
Peter Van Dijck
Coffee with Lou #4: Taking a Peek Under the Rosenbot's Hood (Videoconference)
2024 • Rosenfeld Community

More Videos

Alex Hurworth

"The time for debate has passed; we need to act decisively and collaboratively."

Alex Hurworth Bonnie John Fahd Arshad Antoine Marin

Designing a Contact Tracing App for Universal Access

October 23, 2020

Laine Riley Prokay

"Sometimes doing working sessions together to strategize and solve problems can be really beneficial for these new practitioners."

Laine Riley Prokay Lisa Gordon

Carving a Path for Early Career DesignOps Practitioners

September 9, 2022

Eniola Oluwole

"You won’t know what success looks like until you put something out there and see how it works in practice."

Eniola Oluwole

Lessons From the DesignOps Journey of the World's Largest Travel Site

October 24, 2019

Nathan Shedroff

"If your budgets don’t connect to strategy goals, maybe those budget items shouldn’t exist."

Nathan Shedroff

Double Your Mileage: Use Your Research Strategically

March 31, 2020

Sam Proulx

"Voice control on mobile goes beyond digital assistants and can fully control the device for users who cannot use touch."

Sam Proulx

Mobile Accessibility: Why Moving Accessibility Beyond the Desktop is Critical in a Mobile-first World

November 17, 2022

Feleesha Sterling

"Rapid research is a flexible framework for quickly executing UX research for fast and often tactical or evaluative design decisions."

Feleesha Sterling

Building a Rapid Research Program (Videoconference)

May 18, 2023

Neil Barrie

"Culture is the most influential factor impacting people's perceptions and values today."

Neil Barrie

Widening the Aperture: The Case for Taking a Broader Lens to the Dialogue between Products and Culture

March 25, 2024

John Devanney

"Design systems help bridge the gap between design and development, but collaboration remains key."

John Devanney

The Design Management Office

November 6, 2017

Katy Mogal

"Find the curious partners who will do some of the evangelizing for you to their peers."

Katy Mogal

But Do Your Insights Scale?

March 12, 2021