It Takes GRIT: Lessons from the Small, but Mighty World of Civic Usability Testing
Summary
Since launching in early 2019, GRIT has delivered more than 20 such inclusive usability testing engagements with partners in the public, private and nonprofit sectors and we’re eager to share our insights with others who endeavor to engage diverse, underrepresented communities in the design of their civic products and services. Using case studies and lessons from our trove of civic design engagements, we'll help take the guesswork out of inclusively testing your next design.
Key Insights
-
•
Inclusive usability testing uncovers user needs that would otherwise be missed, especially for vulnerable populations.
-
•
Building a diverse participant pool requires going offline to meet people in their everyday community spaces, not just digital recruitment.
-
•
Offering flexible testing times beyond standard working hours increases participation from diverse socioeconomic backgrounds.
-
•
Creating a comfortable, informal testing environment with snacks and a non-intimidating setting improves honest feedback.
-
•
Clear, jargon-free communication and early sharing of consent forms build trust and reduce participant anxiety.
-
•
Maintaining a single point of contact for participants prevents confusion and fosters smoother coordination.
-
•
Compensation at a rate of $1 to $1.25 per minute, reimbursed travel, and prompt payments boost recruitment speed and retention.
-
•
Referrals from satisfied testers can help reach specific demographics and expand testing pools efficiently.
-
•
Longitudinal testing, involving participants multiple times, enhances insights as the product evolves.
-
•
Testing with real users who rely on assistive technologies, like screen readers or voice commands, validates accessibility effectively.
Notable Quotes
"If it doesn’t work for you, it doesn’t work."
"When you test inclusively, you’re learning about the people who will be directly impacted by your work, your users."
"Technology that includes everyone, especially those from vulnerable populations, ensures that what gets built will work for everyone."
"Participant experience is everything and it starts with building trust."
"No surprises. Tell participants everything they’ll be experiencing from who will be in the room to if the session will be recorded."
"Use plain language in all communication. No design or technology jargon."
"Build your pool, build your practice. If you provide a great testing experience, you’ve got another person to add to your group."
"Compensation is so important to thank people for their time, and you will definitely build your recruitment pool much faster if you offer it."
"We intentionally did not email listservs or go on Twitter because that would have delivered a group that is too tech-savvy."
"During testing sensitive subjects, have relevant resources at the ready, like shelter beds for participants in need."
Or choose a question:
More Videos
"Our one metric that mattered was maximizing the number of VOС-tagged tickets solved – showing customer feedback made it to the roadmap."
Shipra KayanHow we Built a VoC (Voice of the Customer) Practice at Upwork from the Ground Up
September 30, 2021
"Information architects use nodes and links to create environments for understanding."
Peter MorvilleThe Architecture of Understanding
May 13, 2015
"I want people to question why I’m not in the room if I’m not there."
Renee ReidBecoming a ResearchH.E.R (Highly Enterprise Ready)
June 3, 2019
"Language can be vague, imprecise, and even contradictory, but the body can be a bridge to understanding."
Dane DeSutterKeeping the Body in Mind: What Gestures and Embodied Actions Tell You That Users May Not
March 26, 2024
"Involving people with disabilities from the start reveals impact and usability issues that automated testing simply cannot catch."
Sam ProulxOnline Shopping: Designing an Accessible Experience
October 3, 2023
"A poor experience on a web visit isn’t out of sight, out of mind; it impacts their entire history with the brand."
Andrew Custage Michael MallettThe Digital Journey: Research on Consumer Frustration and Loyalty
March 29, 2023
"Facilitation is part setting the stage and part performing on it."
Shelby SwitzerMaking Space for Community Knowledge-sharing in a Distributed World
December 10, 2021
"We should think of AI as something that amplifies what we already are: if we think research is about impact, AI will help us understand and track it."
Llewyn PaineCoexisting with AI: A practical guide for researchers to navigate tools, ethics, and integration
March 11, 2025
"Researchers make customers visible inside the organization, but also help the organization learn about itself."
Robin BeersNavigating organizational systems: Rethinking researcher’s role in driving change
March 13, 2025
