Summary
In this Q&A session, we'll hear how Liza Pemstein, Research Operations Manager at Clever, built a robust research practice at one of the fastest-growing EdTech companies. Identifying the friction in the process experienced by design, product, engineering, and marketing, Liza has streamlined and scaled research. She'll share how she got started, what she's learned and what she's excited about in 2023!
Key Insights
-
•
Clever operates research with no dedicated UX researchers, relying on designers and product managers to conduct studies supported by research operations.
-
•
Liza Pennstein’s background in customer solutions helped her spot opportunities to improve research feedback loops and participant management.
-
•
Introducing a single managed payment method for participant incentives significantly reduced complexity and increased efficiency.
-
•
Building a centralized participant database simplified recruitment and lowered barriers for anyone in the company to conduct research.
-
•
The research ops role at Clever evolved from organizing fragmented efforts toward enabling high-quality, standardized research practices.
-
•
Liza created the ROKS program (Research Ops Knowledge Share) to break down silos and share methods and templates across teams.
-
•
Fostering researcher confidence and excitement was a priority before focusing on raising research quality and best practices.
-
•
Clever balances guidance and intervention with a hands-off approach to allow teams to experiment and develop skills gradually.
-
•
There is an acknowledged limitation to not having dedicated UX researchers, with an eventual desire to hire them as research matures.
-
•
The next steps involve training, workshops, building a research repository, and experimenting with new methods like unmoderated research.
Notable Quotes
"Research is a sales role at heart—delivering value to people drives sustainable growth."
"I wasn’t an expert UX researcher; I’m an operations person who listens and solves problems and removes friction."
"Let me take the incentive management off your plate—just file a Jira ticket, and I’ll handle it."
"Everyone was doing research differently and reinventing the wheel; my job was to organize and support."
"We want to build confidence first, then focus on increasing quality and best practices."
"Research is a group project; learning is a group project—you don’t have to be an expert to contribute."
"If people aren’t catching fish, then maybe it’s time to help them learn better techniques."
"Start small and test the waters, then be decisive and lean into your hunches and decisions."
"Sometimes the most annoying small problems are the best places to start to build momentum."
"We want to get people excited about trying new methods, like unmoderated research, so they can do more with limited headcount."
Or choose a question:
More Videos
"You’re born on third base but think you hit a triple — that’s the enterprise software delusion."
Standardizing Product Merits for Leaders, Designers, and Everyone
June 15, 2018
"I realized I was just making it up despite the company’s growth."
Simon WardleyMaps and Topographical Intelligence (Videoconference)
January 31, 2019
"We can’t solve systemic problems with surface-level solutions or checklists."
Sandra CamachoCreating More Bias-Proof Designs
January 22, 2025
"It takes at least one team member to choose to set healthy standards for collaboration."
Darian DavisLessons from a Toxic Work Relationship
January 8, 2024
"After each interview, I input the transcript into ChatGPT and ask for three key takeaways that I can quickly share with stakeholders."
Fisayo Osilaja[Demo] The AI edge: From researcher to strategist
June 4, 2024
"Working with CEOs like Mark Templeton is like Dancing with the Stars — an interpretive dance of translating fuzzy ideas."
Uday GajendarThe Wicked Craft of Enterprise UX
May 13, 2015
"Trust is often underestimated but is critical when designers face public critique and feedback."
Davis Neable Guy SegalHow to Drive a Design Project When you Don’t Have a Design Team
June 10, 2021
"Launching a design system is not a sprint, there’s no end, it’s always a continuous process."
Eniola OluwoleLessons From the DesignOps Journey of the World's Largest Travel Site
October 24, 2019
"Design Ops people want to standardize processes and reuse organizational knowledge for clarity and confidence."
Aurobinda Pradhan Shashank DeshpandeIntroduction to Collaborative DesignOps using Cubyts
September 9, 2022
