Rosenverse
It Takes GRIT: Lessons from the Small, but Mighty World of Civic Usability Testing

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

It Takes GRIT: Lessons from the Small, but Mighty World of Civic Usability Testing

Gold
Thursday, December 9, 2021 • Civic Design 2021
Share the love for this talk
It Takes GRIT: Lessons from the Small, but Mighty World of Civic Usability Testing
Speakers: Marisa Bernstein
Link:

Summary

While usability testing is an often overlooked part of design in the frenzied race to get technology to market, it’s absence is especially problematic when it comes to civic-focused products and services. Even when designers want to test, options are often limited to "professional testers" or personal networks - far from the actual users they’re hoping to help. Testing with a diverse group of end users and stakeholders is the only surefire way to make sure what gets designed works for everyone, but the approach needs to be thoughtful, sensitive and impactful. Since launching in early 2019, GRIT has delivered more than 20 such inclusive usability testing engagements with partners in the public, private and nonprofit sectors and we’re eager to share our insights with others who endeavor to engage diverse, underrepresented communities in the design of their civic products and services. Using case studies and lessons from our trove of civic design engagements, we'll help take the guesswork out of inclusively testing your next design.

Key Insights

  • Inclusive usability testing uncovers user needs that would otherwise be missed, especially for vulnerable populations.

  • Building a diverse participant pool requires going offline to meet people in their everyday community spaces, not just digital recruitment.

  • Offering flexible testing times beyond standard working hours increases participation from diverse socioeconomic backgrounds.

  • Creating a comfortable, informal testing environment with snacks and a non-intimidating setting improves honest feedback.

  • Clear, jargon-free communication and early sharing of consent forms build trust and reduce participant anxiety.

  • Maintaining a single point of contact for participants prevents confusion and fosters smoother coordination.

  • Compensation at a rate of $1 to $1.25 per minute, reimbursed travel, and prompt payments boost recruitment speed and retention.

  • Referrals from satisfied testers can help reach specific demographics and expand testing pools efficiently.

  • Longitudinal testing, involving participants multiple times, enhances insights as the product evolves.

  • Testing with real users who rely on assistive technologies, like screen readers or voice commands, validates accessibility effectively.

Notable Quotes

"If it doesn’t work for you, it doesn’t work."

"When you test inclusively, you’re learning about the people who will be directly impacted by your work, your users."

"Technology that includes everyone, especially those from vulnerable populations, ensures that what gets built will work for everyone."

"Participant experience is everything and it starts with building trust."

"No surprises. Tell participants everything they’ll be experiencing from who will be in the room to if the session will be recorded."

"Use plain language in all communication. No design or technology jargon."

"Build your pool, build your practice. If you provide a great testing experience, you’ve got another person to add to your group."

"Compensation is so important to thank people for their time, and you will definitely build your recruitment pool much faster if you offer it."

"We intentionally did not email listservs or go on Twitter because that would have delivered a group that is too tech-savvy."

"During testing sensitive subjects, have relevant resources at the ready, like shelter beds for participants in need."

Ask the Rosenbot
Matt LeMay
You Don’t “Get” Anyone to Do Anything
2022 • Design in Product 2022
Gold
Christian Bason
Expand—Rethinking Design for Public Challenges
2022 • Civic Design Community
Emilia Åström
Unlock Your Team’s Intelligence with Collaboration Design
2022 • Design at Scale 2022
Gold
Dominique Ward
The Most Exciting Time for DesignOps is Now
2022 • DesignOps Summit 2022
Gold
Steve Baty
Breaking Out of Ruts: Tips for Overcoming the Fear of Change
2016 • Enterprise UX 2016
Gold
Jason Mesut
Unmasking Design Leadership: Navigating leadership without neglecting ourselves
2025 • Rosenfeld Community
Tristin Oldani
Turning awareness into action with Climate UX
2025 • Climate UX Interest Group
Marina Martin
Lives on the Line: The Stakes of UX at the Scale of Government
2018 • Enterprise Experience 2018
Gold
Daniel J. Rosenberg
Digital Medicine Design
2019 • Enterprise Community
Daniel Gloyd
Designing From the Inside Out: How Method Acting Can Inspire Design Research
2026 • Rosenfeld Community
Nathan Curtis
Discussion
2016 • Enterprise UX 2016
Gold
World Usability Day Panel Discussion
2022 • DesignOps Community
Etienne Fang
The Power of Care: From Human-Centered Research to Humanity-Centered Leadership
2021 • Advancing Research 2021
Gold
Gabriela Barneva
Operationalizing Inclusive Design in Service Design
2025 • Advancing Service Design 2025
Gold
Marissa Cui
Climate Design Product Showcase
2024 • Climate UX Interest Group
Alla Weinberg
Cross-Functional Relationship Design
2022 • Design in Product 2022
Gold

More Videos

Anna Avrekh

"Don’t position yourself as the research expert; you are the expert in facilitating the quest for knowledge."

Anna Avrekh Dr. John Pagonis Klara Pelcl Sina Schreiber

Expert Panel: Leading in and with Research

March 10, 2022

Taylor Klassman

"Impact of research is not always immediate or linear; it can be a long-term, complex process to measure."

Taylor Klassman

Shaping the Next Era of UX Research: Collaborative Forum

March 11, 2025

Dr. Jamika D. Burge

"We have to figure out the strategic, unique value to our clients, stakeholders, and customers."

Dr. Jamika D. Burge Steve Portigal Alba Villamil Sam Ladner

The Future of Research: Bridging the Gaps

July 29, 2021

Marisa Bernstein

"We intentionally did not email listservs or go on Twitter because that would have delivered a group that is too tech-savvy."

Marisa Bernstein

It Takes GRIT: Lessons from the Small, but Mighty World of Civic Usability Testing

December 9, 2021

Dan Mall

"Design systems should capture the reality of your organization, documenting how you work now and where you want to go."

Dan Mall

“Ask Me Anything” with Dan Mall, Author of Upcoming Rosenfeld Title, Design that Scales

October 2, 2023

Chris Geison

"To do the kind of work we aspire to do, we need to better understand the role of resilience."

Chris Geison

Theme 1 Intro

March 9, 2022

Bruce Gillespie

"If someone only reads the first few paragraphs or attends the first 10 minutes, they should still get the key takeaways."

Bruce Gillespie

Learning from journalism: Balancing impactful communication with compassionate storytelling

March 13, 2025

Nancy Douyon

"We all want to design for scale, but empathy alone is sometimes a shortcoming when thinking about scale."

Nancy Douyon

We'll Figure That Out in the Next Launch: Enterprise Tech's Nobility Complex

June 15, 2018

Liz Ebengo

"Hope is not passive. Hope is very proactive and requires facilitation that helps people dream despite their harsh realities."

Liz Ebengo

The Burden on Children: The Cost of Insufficient Post-Conflict Services and Pathways Forward

December 4, 2024