Summary
While usability testing is an often overlooked part of design in the frenzied race to get technology to market, it’s absence is especially problematic when it comes to civic-focused products and services. Even when designers want to test, options are often limited to "professional testers" or personal networks - far from the actual users they’re hoping to help. Testing with a diverse group of end users and stakeholders is the only surefire way to make sure what gets designed works for everyone, but the approach needs to be thoughtful, sensitive and impactful. Since launching in early 2019, GRIT has delivered more than 20 such inclusive usability testing engagements with partners in the public, private and nonprofit sectors and we’re eager to share our insights with others who endeavor to engage diverse, underrepresented communities in the design of their civic products and services. Using case studies and lessons from our trove of civic design engagements, we'll help take the guesswork out of inclusively testing your next design.
Key Insights
-
•
Inclusive usability testing reveals unique insights that would be missed with less diverse groups.
-
•
Building trust with participants through clear communication and simplified consent process is critical.
-
•
Offline recruitment through community hubs ensures a more representative and diverse participant pool than online-only methods.
-
•
Flexible scheduling that includes evenings and early mornings accommodates non-9-to-5 participants.
-
•
Compensation at $1 to $1.25 per minute plus travel reimbursement greatly improves recruitment.
-
•
Testing environments less clinical than windowless labs create more comfortable, open sessions.
-
•
Maintaining relationships with testers and updating them post-launch closes the feedback loop and builds engagement.
-
•
Testing with users who actually rely on assistive technologies ensures accessibility features function correctly.
-
•
Scrappy, low-budget inclusive testing can still produce valuable insights with thoughtful design of participant experience.
-
•
Leveraging participant referrals supports recruiting hard-to-reach or specific demographic groups.
Notable Quotes
"To the people of the city of Chicago, if it doesn’t work for you, it doesn’t work."
"When you test inclusively, you’re learning about the design and the people impacted—your users."
"Testing with the people who actually need to use your products is a no-brainer."
"Participant experience is everything and it starts with building trust."
"Have that one point of contact so participants don’t get confused with multiple emails."
"Use plain language—no jargon—and explain terms like prototype simply."
"Flexible time slots open testing up to people who don’t work nine to five."
"We recruited almost 400 people by putting posters in laundromats, coffee shops, community centres—not online."
"Offering fair compensation builds your recruitment pool much faster."
"If a tester brings kids, we just accommodate it. Snacks help with that too."
Dig deeper—ask the Rosenbot:
More Videos
"At first we considered outside research team access but decided to keep the panels limited within research for initial version."
Wyatt HaymanGlobal Research Panels (Videoconference)
August 8, 2020
"Instead of choosing colors and then checking contrast, we define target contrast ratios first and generate colors accordingly."
PJ Buddhari Nate BaldwinMeet Spectrum, Adobe’s Design System
June 9, 2021
"Evan spent less than 15 minutes on his essay because he used AI to write it for him."
Sarah GallimoreInspire Progress with Artifacts from the Future
November 18, 2022
"Many product managers got their roles because they know the business or subject matter, but they don’t know how to manage product development."
Peter MerholzThe Trials and Tribulations of Directors of UX (Videoconference)
July 13, 2023
"Intersectionality is a framework to describe compounding levels of discrimination people experience."
Dr. Jamika D. Burge Mansi GuptaAdvancing the Inclusion of Womxn in Research Practices (Videoconference)
September 15, 2022
"Find your senior executive ally who understands design, tell them what you need, then inform your boss afterward."
Amy MarquezINVEST: Discussion
June 15, 2018
"Gaming is about generating positivity in ways software like Azure can’t."
Dane DeSutter Natalie Gedeon Deborah Hendersen Cheryl PlatzBeyond the Console: The rise of the Gamer Experience and how gaming will impact UX Research across industries (Videoconference)
May 17, 2024
"Denying the body is not an antidote to the suffering of the world. When we protect our rest, we protect our dreaming."
Zariah CameronReDesigning Wellbeing for Equitable Care in the Workplace
September 23, 2024
"In design Ops, the same ADHD traits—like managing ambiguity and dynamic change—are often strengths."
Jessica NorrisADHD: A DesignOps Superpower
September 9, 2022
