Summary
In this Q&A session, we'll hear how Liza Pemstein, Research Operations Manager at Clever, built a robust research practice at one of the fastest-growing EdTech companies. Identifying the friction in the process experienced by design, product, engineering, and marketing, Liza has streamlined and scaled research. She'll share how she got started, what she's learned and what she's excited about in 2023!
Key Insights
-
•
Clever operates research with no dedicated UX researchers, relying on designers and product managers to conduct studies supported by research operations.
-
•
Liza Pennstein’s background in customer solutions helped her spot opportunities to improve research feedback loops and participant management.
-
•
Introducing a single managed payment method for participant incentives significantly reduced complexity and increased efficiency.
-
•
Building a centralized participant database simplified recruitment and lowered barriers for anyone in the company to conduct research.
-
•
The research ops role at Clever evolved from organizing fragmented efforts toward enabling high-quality, standardized research practices.
-
•
Liza created the ROKS program (Research Ops Knowledge Share) to break down silos and share methods and templates across teams.
-
•
Fostering researcher confidence and excitement was a priority before focusing on raising research quality and best practices.
-
•
Clever balances guidance and intervention with a hands-off approach to allow teams to experiment and develop skills gradually.
-
•
There is an acknowledged limitation to not having dedicated UX researchers, with an eventual desire to hire them as research matures.
-
•
The next steps involve training, workshops, building a research repository, and experimenting with new methods like unmoderated research.
Notable Quotes
"Research is a sales role at heart—delivering value to people drives sustainable growth."
"I wasn’t an expert UX researcher; I’m an operations person who listens and solves problems and removes friction."
"Let me take the incentive management off your plate—just file a Jira ticket, and I’ll handle it."
"Everyone was doing research differently and reinventing the wheel; my job was to organize and support."
"We want to build confidence first, then focus on increasing quality and best practices."
"Research is a group project; learning is a group project—you don’t have to be an expert to contribute."
"If people aren’t catching fish, then maybe it’s time to help them learn better techniques."
"Start small and test the waters, then be decisive and lean into your hunches and decisions."
"Sometimes the most annoying small problems are the best places to start to build momentum."
"We want to get people excited about trying new methods, like unmoderated research, so they can do more with limited headcount."
Dig deeper—ask the Rosenbot:
More Videos
"Human translation is preferred for accuracy, though Google Translate is used occasionally for urgent needs."
Wyatt HaymanGlobal Research Panels (Videoconference)
August 8, 2020
"We use a design checklist to show the health of each component, leaving items unchecked if they don't meet standards."
PJ Buddhari Nate BaldwinMeet Spectrum, Adobe’s Design System
June 9, 2021
"Government often moves slowly and struggles to communicate future intent amid short-term sustainability concerns."
Sarah GallimoreInspire Progress with Artifacts from the Future
November 18, 2022
"Developing trust means showing you understand what it takes to get something shipped, that you’re reliable, and that people can be vulnerable with you."
Peter MerholzThe Trials and Tribulations of Directors of UX (Videoconference)
July 13, 2023
"More inclusive teams are more productive and effective, especially women-led teams that inspire community."
Dr. Jamika D. Burge Mansi GuptaAdvancing the Inclusion of Womxn in Research Practices (Videoconference)
September 15, 2022
"Product principles are minimal but help us say, oh, this is meeting that or not meeting that."
Amy MarquezINVEST: Discussion
June 15, 2018
"Game designers optimize good friction; UX tries to minimize bad friction."
Dane DeSutter Natalie Gedeon Deborah Hendersen Cheryl PlatzBeyond the Console: The rise of the Gamer Experience and how gaming will impact UX Research across industries (Videoconference)
May 17, 2024
"If I don’t trust you, how can I feel safe with you?"
Zariah CameronReDesigning Wellbeing for Equitable Care in the Workplace
September 23, 2024
"Ask what helps you work better—this simple question is one of the most important things for colleagues and managers."
Jessica NorrisADHD: A DesignOps Superpower
September 9, 2022
