Summary
In this Q&A session, we'll hear how Liza Pemstein, Research Operations Manager at Clever, built a robust research practice at one of the fastest-growing EdTech companies. Identifying the friction in the process experienced by design, product, engineering, and marketing, Liza has streamlined and scaled research. She'll share how she got started, what she's learned and what she's excited about in 2023!
Key Insights
-
•
Clever operates research with no dedicated UX researchers, relying on designers and product managers to conduct studies supported by research operations.
-
•
Liza Pennstein’s background in customer solutions helped her spot opportunities to improve research feedback loops and participant management.
-
•
Introducing a single managed payment method for participant incentives significantly reduced complexity and increased efficiency.
-
•
Building a centralized participant database simplified recruitment and lowered barriers for anyone in the company to conduct research.
-
•
The research ops role at Clever evolved from organizing fragmented efforts toward enabling high-quality, standardized research practices.
-
•
Liza created the ROKS program (Research Ops Knowledge Share) to break down silos and share methods and templates across teams.
-
•
Fostering researcher confidence and excitement was a priority before focusing on raising research quality and best practices.
-
•
Clever balances guidance and intervention with a hands-off approach to allow teams to experiment and develop skills gradually.
-
•
There is an acknowledged limitation to not having dedicated UX researchers, with an eventual desire to hire them as research matures.
-
•
The next steps involve training, workshops, building a research repository, and experimenting with new methods like unmoderated research.
Notable Quotes
"Research is a sales role at heart—delivering value to people drives sustainable growth."
"I wasn’t an expert UX researcher; I’m an operations person who listens and solves problems and removes friction."
"Let me take the incentive management off your plate—just file a Jira ticket, and I’ll handle it."
"Everyone was doing research differently and reinventing the wheel; my job was to organize and support."
"We want to build confidence first, then focus on increasing quality and best practices."
"Research is a group project; learning is a group project—you don’t have to be an expert to contribute."
"If people aren’t catching fish, then maybe it’s time to help them learn better techniques."
"Start small and test the waters, then be decisive and lean into your hunches and decisions."
"Sometimes the most annoying small problems are the best places to start to build momentum."
"We want to get people excited about trying new methods, like unmoderated research, so they can do more with limited headcount."
Or choose a question:
More Videos
"There are many ways to be a good researcher; Latin researchers should create our standards and fight for them."
Verónica Urzúa Jorge MontielThe B-side of the Research Impact
March 12, 2021
"I had no idea how to work with the military, and I didn't even know what I didn't know."
Michal Anne RogondinoSaving Outer Space: The First UX Design System for Our Nation’s Satellites
January 8, 2024
"Embracing discomfort often leads to change."
Jemma AhmedTheme 2 Intro
March 10, 2022
"Today’s theme is all about reflecting on the state of Civic design and government design practice and our careers."
Kara KaneTheme One Intro
November 16, 2022
"Early career employees should express gratitude and appreciation for those who offer help as part of compassion."
Laine Riley ProkayHow DesignOps can Drive Inclusive Career Ladders for All
September 30, 2021
"The bigger the impact, the higher the title the message should come from."
Laura Gatewood Laine ProkayBeyond Buzzwords: Adding Heart to Effective Slack Communication
September 23, 2024
"Working with other product designers as stakeholders lets you get to the point really quickly."
Caitlyn Hampton Monica Lee Jina YoonCompass 101: Growing Your Career In A Startup World
June 11, 2021
"All feelings are valid when introducing new behaviors; you’re not trying to change the underlying values."
Hana NagelTurning Research Ripples into Waves
November 8, 2018
"Legacy interconnected systems mean solving one problem can create problems elsewhere."
Alexandra SchmidtEnterprise UX Playbook (Videoconference)
December 1, 2022