Summary
While usability testing is an often overlooked part of design in the frenzied race to get technology to market, it’s absence is especially problematic when it comes to civic-focused products and services. Even when designers want to test, options are often limited to "professional testers" or personal networks - far from the actual users they’re hoping to help. Testing with a diverse group of end users and stakeholders is the only surefire way to make sure what gets designed works for everyone, but the approach needs to be thoughtful, sensitive and impactful. Since launching in early 2019, GRIT has delivered more than 20 such inclusive usability testing engagements with partners in the public, private and nonprofit sectors and we’re eager to share our insights with others who endeavor to engage diverse, underrepresented communities in the design of their civic products and services. Using case studies and lessons from our trove of civic design engagements, we'll help take the guesswork out of inclusively testing your next design.
Key Insights
-
•
Inclusive usability testing reveals unique insights that would be missed with less diverse groups.
-
•
Building trust with participants through clear communication and simplified consent process is critical.
-
•
Offline recruitment through community hubs ensures a more representative and diverse participant pool than online-only methods.
-
•
Flexible scheduling that includes evenings and early mornings accommodates non-9-to-5 participants.
-
•
Compensation at $1 to $1.25 per minute plus travel reimbursement greatly improves recruitment.
-
•
Testing environments less clinical than windowless labs create more comfortable, open sessions.
-
•
Maintaining relationships with testers and updating them post-launch closes the feedback loop and builds engagement.
-
•
Testing with users who actually rely on assistive technologies ensures accessibility features function correctly.
-
•
Scrappy, low-budget inclusive testing can still produce valuable insights with thoughtful design of participant experience.
-
•
Leveraging participant referrals supports recruiting hard-to-reach or specific demographic groups.
Notable Quotes
"To the people of the city of Chicago, if it doesn’t work for you, it doesn’t work."
"When you test inclusively, you’re learning about the design and the people impacted—your users."
"Testing with the people who actually need to use your products is a no-brainer."
"Participant experience is everything and it starts with building trust."
"Have that one point of contact so participants don’t get confused with multiple emails."
"Use plain language—no jargon—and explain terms like prototype simply."
"Flexible time slots open testing up to people who don’t work nine to five."
"We recruited almost 400 people by putting posters in laundromats, coffee shops, community centres—not online."
"Offering fair compensation builds your recruitment pool much faster."
"If a tester brings kids, we just accommodate it. Snacks help with that too."
Or choose a question:
More Videos
"We are witnessing the most rapid loss of biodiversity in human history."
Alex Hurworth Bonnie John Fahd Arshad Antoine MarinDesigning a Contact Tracing App for Universal Access
October 23, 2020
"Time commitment for onboarding interns was close to 25%, maybe 50%, of at least two weeks, easing as they became familiar with roles."
Laine Riley Prokay Lisa GordonCarving a Path for Early Career DesignOps Practitioners
September 9, 2022
"You won’t know what success looks like until you put something out there and see how it works in practice."
Eniola OluwoleLessons From the DesignOps Journey of the World's Largest Travel Site
October 24, 2019
"Traditional MBAs are confident about many things that aren’t true, and your research will often challenge their worldview."
Nathan ShedroffDouble Your Mileage: Use Your Research Strategically
March 31, 2020
"If you focus on desktop accessibility, you’re leaving out some of your most important users who may have mobile-only access."
Sam ProulxMobile Accessibility: Why Moving Accessibility Beyond the Desktop is Critical in a Mobile-first World
November 17, 2022
"Documentation and making findings visible even without a dedicated research librarian helps maintain program momentum."
Feleesha SterlingBuilding a Rapid Research Program (Videoconference)
May 18, 2023
"You have the power, like Navy Seals of user research, to influence the biggest issues of our time, one interaction at a time."
Neil BarrieWidening the Aperture: The Case for Taking a Broader Lens to the Dialogue between Products and Culture
March 25, 2024
"Design systems help bridge the gap between design and development, but collaboration remains key."
John DevanneyThe Design Management Office
November 6, 2017
"We decided to jump off the wall — it was scary but the opportunity was too big to pass up."
Katy MogalBut Do Your Insights Scale?
March 12, 2021