Summary
While usability testing is an often overlooked part of design in the frenzied race to get technology to market, it’s absence is especially problematic when it comes to civic-focused products and services. Even when designers want to test, options are often limited to "professional testers" or personal networks - far from the actual users they’re hoping to help. Testing with a diverse group of end users and stakeholders is the only surefire way to make sure what gets designed works for everyone, but the approach needs to be thoughtful, sensitive and impactful. Since launching in early 2019, GRIT has delivered more than 20 such inclusive usability testing engagements with partners in the public, private and nonprofit sectors and we’re eager to share our insights with others who endeavor to engage diverse, underrepresented communities in the design of their civic products and services. Using case studies and lessons from our trove of civic design engagements, we'll help take the guesswork out of inclusively testing your next design.
Key Insights
-
•
Inclusive usability testing reveals unique insights that would be missed with less diverse groups.
-
•
Building trust with participants through clear communication and simplified consent process is critical.
-
•
Offline recruitment through community hubs ensures a more representative and diverse participant pool than online-only methods.
-
•
Flexible scheduling that includes evenings and early mornings accommodates non-9-to-5 participants.
-
•
Compensation at $1 to $1.25 per minute plus travel reimbursement greatly improves recruitment.
-
•
Testing environments less clinical than windowless labs create more comfortable, open sessions.
-
•
Maintaining relationships with testers and updating them post-launch closes the feedback loop and builds engagement.
-
•
Testing with users who actually rely on assistive technologies ensures accessibility features function correctly.
-
•
Scrappy, low-budget inclusive testing can still produce valuable insights with thoughtful design of participant experience.
-
•
Leveraging participant referrals supports recruiting hard-to-reach or specific demographic groups.
Notable Quotes
"To the people of the city of Chicago, if it doesn’t work for you, it doesn’t work."
"When you test inclusively, you’re learning about the design and the people impacted—your users."
"Testing with the people who actually need to use your products is a no-brainer."
"Participant experience is everything and it starts with building trust."
"Have that one point of contact so participants don’t get confused with multiple emails."
"Use plain language—no jargon—and explain terms like prototype simply."
"Flexible time slots open testing up to people who don’t work nine to five."
"We recruited almost 400 people by putting posters in laundromats, coffee shops, community centres—not online."
"Offering fair compensation builds your recruitment pool much faster."
"If a tester brings kids, we just accommodate it. Snacks help with that too."
Or choose a question:
More Videos
"I titled my speech a blueprint because it’s a series of lessons I’ve learned throughout my career."
Jennifer KanyamibwaCreating the Blueprint: Growing and Building Design Teams
November 8, 2018
"Maintaining a repo often requires 100% manual participation from researchers and that can be hard to enforce and monitor."
Brigette Metzler Dana ChrisfieldResearch Repositories: A global project by the ResearchOps Community (Videoconference)
August 27, 2020
"We converted process boxes directly into user stories to create a common language for the team."
Carl TurnerYou Can Do This: Understand and Solve Organizational Problems to Jumpstart a Dead Project
March 28, 2023
"Trust, facilitation, change, and complexity—if you wrap your mind around those, you’ll get reasonably far."
John Mortimer Milan Guenther Lucy Ellis Patrick QuattlebaumPanel Discussion
December 3, 2024
"Extended radio silence to candidates was unnerving and one of the unpleasant truths we heard from teammates."
Dante GuintuHow to Crush the Talent Crunch
September 8, 2022
"Marketing and strategy are part of design."
Richard BuchananCreativity and Principles in the Flourishing Enterprise
June 15, 2018
"Normally the theme leader would be talking about sleep deprivation because we’re overstimulated and excited by the talks."
Dan WillisTheme 3: Intro
January 8, 2024
"The worst thing that could happen is we get cake — this encourages boldness."
Dan WardFailure Friday #1 with Dan Ward
February 7, 2025
"Participatory research always seems like something you’re either doing or not doing—but more often than not, not doing."
Chris GeisonTheme Two Intro
March 28, 2023