Summary
In this Q&A session, we'll hear how Liza Pemstein, Research Operations Manager at Clever, built a robust research practice at one of the fastest-growing EdTech companies. Identifying the friction in the process experienced by design, product, engineering, and marketing, Liza has streamlined and scaled research. She'll share how she got started, what she's learned and what she's excited about in 2023!
Key Insights
-
•
Clever operates research with no dedicated UX researchers, relying on designers and product managers to conduct studies supported by research operations.
-
•
Liza Pennstein’s background in customer solutions helped her spot opportunities to improve research feedback loops and participant management.
-
•
Introducing a single managed payment method for participant incentives significantly reduced complexity and increased efficiency.
-
•
Building a centralized participant database simplified recruitment and lowered barriers for anyone in the company to conduct research.
-
•
The research ops role at Clever evolved from organizing fragmented efforts toward enabling high-quality, standardized research practices.
-
•
Liza created the ROKS program (Research Ops Knowledge Share) to break down silos and share methods and templates across teams.
-
•
Fostering researcher confidence and excitement was a priority before focusing on raising research quality and best practices.
-
•
Clever balances guidance and intervention with a hands-off approach to allow teams to experiment and develop skills gradually.
-
•
There is an acknowledged limitation to not having dedicated UX researchers, with an eventual desire to hire them as research matures.
-
•
The next steps involve training, workshops, building a research repository, and experimenting with new methods like unmoderated research.
Notable Quotes
"Research is a sales role at heart—delivering value to people drives sustainable growth."
"I wasn’t an expert UX researcher; I’m an operations person who listens and solves problems and removes friction."
"Let me take the incentive management off your plate—just file a Jira ticket, and I’ll handle it."
"Everyone was doing research differently and reinventing the wheel; my job was to organize and support."
"We want to build confidence first, then focus on increasing quality and best practices."
"Research is a group project; learning is a group project—you don’t have to be an expert to contribute."
"If people aren’t catching fish, then maybe it’s time to help them learn better techniques."
"Start small and test the waters, then be decisive and lean into your hunches and decisions."
"Sometimes the most annoying small problems are the best places to start to build momentum."
"We want to get people excited about trying new methods, like unmoderated research, so they can do more with limited headcount."
Or choose a question:
More Videos
"Telling your team’s story explains the culture of your team and how someone could fit into it."
Jennifer KanyamibwaCreating the Blueprint: Growing and Building Design Teams
November 8, 2018
"Most organizations are using a stack of tools like Google Drive, SharePoint, or Airtable, not mature repositories."
Brigette Metzler Dana ChrisfieldResearch Repositories: A global project by the ResearchOps Community (Videoconference)
August 27, 2020
"Taking meeting minutes and assigning action items with director names reduced arguing and helped move things forward."
Carl TurnerYou Can Do This: Understand and Solve Organizational Problems to Jumpstart a Dead Project
March 28, 2023
"If you want to bring dots closer together, you have to constantly notice how things change in the moment."
John Mortimer Milan Guenther Lucy Ellis Patrick QuattlebaumPanel Discussion
December 3, 2024
"Recruiters are often optimized for technical hiring and design is only one percent of the company’s population."
Dante GuintuHow to Crush the Talent Crunch
September 8, 2022
"We tend to confuse the experience of people with user experience, and I’m less interested in user experience than in the experience of people."
Richard BuchananCreativity and Principles in the Flourishing Enterprise
June 15, 2018
"The last of long time, we end up in bars late at night, exhausted but happy from all the conversations and learning."
Dan WillisTheme 3: Intro
January 8, 2024
"The worst thing that could happen is we get cake — this encourages boldness."
Dan WardFailure Friday #1 with Dan Ward
February 7, 2025
"This is a weird time for research. Layoffs have torn through our field. I've been laid off too."
Chris GeisonTheme Two Intro
March 28, 2023