Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

SUS: A System Unusable for Twenty Percent of the Population
Gold
Thursday, December 9, 2021 • Civic Design 2021
Share the love for this talk
SUS: A System Unusable for Twenty Percent of the Population
Speakers: Sam Proulx
Link:

Summary

Did you know that the SUS creates biases in your research, affecting one in five people? That’s right!  People with disabilities, especially those who use assistive technology, are not considered by most of the questions in the SUS. As a designer for the public sector, this could lead to you making design decisions that don’t take into account 20 percent of the visitors to your website.

Key Insights

  • Traditional System Usability Scale questions can be confusing or irrelevant for assistive technology users.

  • Assistive technology users heavily customize their tools; default configurations in research labs misrepresent real-world experiences.

  • Screen reader users tend to report significantly lower usability scores than low vision or alternative navigation users.

  • Alternative navigation users choose tools based on specific tasks and physical condition, not one tool fits all.

  • Research methods involving simultaneous talking and screen reader output confuse participants and researchers alike.

  • Environmental and technical factors in usability labs often create unfamiliar, stressful test settings for disabled users.

  • Breaking tasks into smaller chunks improves research session clarity for screen reader users.

  • Inclusive design benefits from measuring usability specifically tailored to assistive technology contexts.

  • Lower usability scores can reflect long-term lowered expectations among experienced assistive tech users.

  • Fable’s Accessible Usability Scale is freely available online and invites iteration and adoption by product teams.

Notable Quotes

"I consider myself a very technical person, but the reason I can’t use the website isn’t because I’m not technical enough; it’s because it’s not working with my screen reader."

"Taking me into an assistive technology lab means using a screen reader that probably hasn’t been configured by anyone familiar with the technology."

"Alternative navigation users pick the tool that is right for the job, depending on their physical condition and task."

"Breaking tasks into little chunks avoids the confusion of talking while the screen reader is talking."

"The system usability scale didn’t consider people relying on assistive technology, so answers were often inaccurate or misunderstood."

"Screen reader users score significantly lower on usability, often reflecting the most complex interpretation demands."

"Things that can’t be measured don’t happen, so having a tailored usability scale matters for progress."

"Issues that are minor for general users represent broader usability barriers for assistive technology users."

"We invite others to leverage, evaluate, criticize, and modify the Accessible Usability Scale to improve measurement."

"Inclusive design is the most robust way to build great products that work for everyone."

Ask the Rosenbot
Eniola Oluwole
Lessons From the DesignOps Journey of the World's Largest Travel Site
2019 • DesignOps Summit 2019
Gold
Laura Smith
Embedding Service Design and Agile Practice within UK Planning Teams to Create Services that Last
2024 • Advancing Service Design 2024
Gold
Stop Talking, Start Doing
2017 • Enterprise Experience 2017
Gold
Jose Coronado
People First - Design at JP Morgan
2021 • Design at Scale 2021
Gold
Alexia Cohen
Increasing Health Equity and Improving the Service Experience for Under-Served Latine Communities in Arizona
2024 • Advancing Service Design 2024
Gold
Samuel Proulx
Invisible barriers: Why accessible service design can’t be an afterthought
2024 • Advancing Service Design 2024
Gold
Bria Alexander
State of DesignOps Panel
2021 • DesignOps Summit 2021
Gold
Angy Peterson
More Than Technology: Personalized Public Sector Experiences
2021 • Civic Design 2021
Gold
Meaghan Waters
Lack of Product Thinking will Doom Your Legacy Modernization
2021 • Design at Scale 2021
Gold
Aurobinda Pradhan
Introduction to Collaborative DesignOps using Cubyts
2022 • DesignOps Summit 2022
Gold
Dan Willis
Enterprise Storytelling Sessions
2017 • Enterprise Experience 2017
Gold
Melissa Eggleston
Practical People Skills for Building Trust on Teams and with Partners
2021 • Civic Design 2021
Gold
Louis Rosenfeld
Opening Remarks
2023 • Advancing Research 2023
Gold
Jemma Ahmed
Theme 2 Intro
2024 • Advancing Research 2024
Gold
Sean Dolan
A Practical Look at Creating More Usable Enterprise Customer Journeys (Videoconference)
2019 • Enterprise Community
Shipra Kayan
How we Built a VoC (Voice of the Customer) Practice at Upwork from the Ground Up
2021 • DesignOps Summit 2021
Gold

More Videos

"You’re born on third base but think you hit a triple — that’s the enterprise software delusion."

Standardizing Product Merits for Leaders, Designers, and Everyone

June 15, 2018

Simon Wardley

"If I don’t have a map, I can’t see patterns or apply context-specific gameplay."

Simon Wardley

Maps and Topographical Intelligence (Videoconference)

January 31, 2019

Sandra Camacho

"Cisgender binary options in onboarding flows exclude non-binary and gender-expansive identities."

Sandra Camacho

Creating More Bias-Proof Designs

January 22, 2025

Darian Davis

"It takes at least one team member to choose to set healthy standards for collaboration."

Darian Davis

Lessons from a Toxic Work Relationship

January 8, 2024

Fisayo Osilaja

"We mitigated data privacy risks by subscribing to the corporate plan for ChatGPT, which offers enhanced security."

Fisayo Osilaja

[Demo] The AI edge: From researcher to strategist

June 4, 2024

Uday Gajendar

"Craft should evolve from making a beautiful final object to serving as a facilitative anchor in enterprise UX."

Uday Gajendar

The Wicked Craft of Enterprise UX

May 13, 2015

Davis Neable

"No official kickoff was held, which meant shifting expectations and lack of alignment."

Davis Neable Guy Segal

How to Drive a Design Project When you Don’t Have a Design Team

June 10, 2021

Eniola Oluwole

"Everyone wanted to know what was the official pattern and who was accountable for it."

Eniola Oluwole

Lessons From the DesignOps Journey of the World's Largest Travel Site

October 24, 2019

Aurobinda Pradhan

"Design producers love their creative tools and want to keep using them without multiple manual reporting steps."

Aurobinda Pradhan Shashank Deshpande

Introduction to Collaborative DesignOps using Cubyts

September 9, 2022