Summary
While usability testing is an often overlooked part of design in the frenzied race to get technology to market, it’s absence is especially problematic when it comes to civic-focused products and services. Even when designers want to test, options are often limited to "professional testers" or personal networks - far from the actual users they’re hoping to help. Testing with a diverse group of end users and stakeholders is the only surefire way to make sure what gets designed works for everyone, but the approach needs to be thoughtful, sensitive and impactful. Since launching in early 2019, GRIT has delivered more than 20 such inclusive usability testing engagements with partners in the public, private and nonprofit sectors and we’re eager to share our insights with others who endeavor to engage diverse, underrepresented communities in the design of their civic products and services. Using case studies and lessons from our trove of civic design engagements, we'll help take the guesswork out of inclusively testing your next design.
Key Insights
-
•
Inclusive usability testing reveals unique insights that would be missed with less diverse groups.
-
•
Building trust with participants through clear communication and simplified consent process is critical.
-
•
Offline recruitment through community hubs ensures a more representative and diverse participant pool than online-only methods.
-
•
Flexible scheduling that includes evenings and early mornings accommodates non-9-to-5 participants.
-
•
Compensation at $1 to $1.25 per minute plus travel reimbursement greatly improves recruitment.
-
•
Testing environments less clinical than windowless labs create more comfortable, open sessions.
-
•
Maintaining relationships with testers and updating them post-launch closes the feedback loop and builds engagement.
-
•
Testing with users who actually rely on assistive technologies ensures accessibility features function correctly.
-
•
Scrappy, low-budget inclusive testing can still produce valuable insights with thoughtful design of participant experience.
-
•
Leveraging participant referrals supports recruiting hard-to-reach or specific demographic groups.
Notable Quotes
"To the people of the city of Chicago, if it doesn’t work for you, it doesn’t work."
"When you test inclusively, you’re learning about the design and the people impacted—your users."
"Testing with the people who actually need to use your products is a no-brainer."
"Participant experience is everything and it starts with building trust."
"Have that one point of contact so participants don’t get confused with multiple emails."
"Use plain language—no jargon—and explain terms like prototype simply."
"Flexible time slots open testing up to people who don’t work nine to five."
"We recruited almost 400 people by putting posters in laundromats, coffee shops, community centres—not online."
"Offering fair compensation builds your recruitment pool much faster."
"If a tester brings kids, we just accommodate it. Snacks help with that too."
Or choose a question:
More Videos
"Can you show me your process, not just your portfolio? That shows me your real design thinking."
Adam Cutler Karen Pascoe Ian Swinson Susan WorthmanDiscussion
June 8, 2016
"If you’re doing a lot of work that’s not in your job description, you might actually be doing leadership."
Peter MerholzThe Trials and Tribulations of Directors of UX (Videoconference)
July 13, 2023
"Digital is a system, not a project. It’s there all the time and you have to keep iterating on it."
Lisa WelchmanCleaning Up Our Mess: Digital Governance for Designers
June 14, 2018
"Policy change is the backbone of effective climate strategies in urban areas."
Vincent BrathwaiteOpener: Past, Present, and Future—Closing the Racial Divide in Design Teams
October 22, 2020
"Psychological safety was far and away the key ingredient for teams being effective."
Brenna FallonLearning Over Outcomes
October 24, 2019
"Linear perspective created this myth that we can see reality from a single perspective, which is the source of all misunderstanding."
Tricia WangSpatial Collapse: Designing for Emergent Culture
January 8, 2024
"Clusters describing demographics and behaviors alone were not enough; we needed emotional personas to find value propositions."
Edgar Anzaldua MorenoUsing Research to Determine Unique Value Proposition
March 11, 2021
"We manage the environment in which knowledge distribution takes place, not the process itself."
Designing Systems at Scale
November 7, 2018
"Randomization is magic — it evenly distributes confounds so the only difference affecting results is your change."
Erin WeigelGet Your Whole Team Testing to Design for Impact
July 24, 2024
