Scaling Research Via an Ops First Model at Clever
Summary
In this Q&A session, we'll hear how Liza Pemstein, Research Operations Manager at Clever, built a robust research practice at one of the fastest-growing EdTech companies. Identifying the friction in the process experienced by design, product, engineering, and marketing, Liza has streamlined and scaled research. She'll share how she got started, what she's learned and what she's excited about in 2023!
Key Insights
-
•
Clever operates a research operations first model with no dedicated UX researchers, relying on designers and PMs to conduct research.
-
•
Liza Pennstein’s path to research operations included customer solutions roles emphasizing empathy, listening, and problem-solving.
-
•
Centralizing participant incentives through a shared credit card and Jira ticket system eliminated confusion and improved process efficiency.
-
•
Recruiting and scheduling user research participants was a major barrier that was addressed by creating shared participant databases.
-
•
The ROCKS program at Clever (Research Ops Knowledge Share) facilitates cross-team learning and un-silos research knowledge.
-
•
Initial focus was on increasing research confidence and comfort among practitioners before emphasizing quality and best practices.
-
•
Balancing standardization with flexibility is critical; intervention happens when research quality or participant screening falters.
-
•
Without dedicated UX researchers, Clever prioritizes enabling non-experts with training, templates, and external expert speakers.
-
•
Building a lightweight repository with Great Question software supports storing and sharing research insights effectively.
-
•
Future plans include broadening methods like unmoderated research, increasing visibility, and maintaining momentum through speaker series and workshops.
Notable Quotes
"Research is a sales role at its heart, delivering value to people to drive sustainable growth."
"I had a hunger for process and efficiency once I built a feedback bot to share customer insights."
"We don’t have dedicated user researchers, but designers and PMs conduct most research here."
"People were doing incentives in different ways, using their own cards, which was confusing, so I centralized it."
"The biggest struggle was recruiting and scheduling participants, so we started a shared Google sheet."
"Research is a group project and learning is a group project—you don’t have to be an expert but find those who are."
"I want to encourage excitement about research and gradually mold people into better researchers."
"Sometimes you have to make it messy before it can be clean again — disrupt to improve."
"We have the quantity of research work; now we’re focused on building up the quality."
"Unmoderated research is exciting because it lets us gather insights while freeing people up to be in two places at once."
Or choose a question:
More Videos
"The difference between the way people talk about how things are done and how they are actually done reveals unconscious assumptions."
Carl TurnerYou Can Do This: Understand and Solve Organizational Problems to Jumpstart a Dead Project
March 28, 2023
"Consumers are clamoring for payment to be embedded in their devices because payment can be a pain point in digital commerce."
Karen PascoeDeveloping Experience Teams and Talent in the Enterprise
June 8, 2016
"We share the inconvenience of meeting times across time zones, alternating so no one team always bears it."
Jilanna WilsonDistributed Design Operations Management
October 23, 2019
"We’ve seen self-service tool usage grow from hundreds to millions of veterans served monthly after launching a unified VA platform."
Shawna Hein Kevin HoffmanCreate a Cohesive Civic Design Practice Across Agency, Vendors, and Contracts
November 17, 2022
"Don’t kill grandma is our mantra reminding us the stakes of the tiny design details we face every day."
Barb SpantonDoing Work That Matters: A Look Beyond The Idealistic Notion of 'Doing Meaningful Work'
June 10, 2022
"Michael became our farmer maintaining steady flow; Davis our forger bringing world-class UX; Dana our gardener cultivating quality work."
Briana ThomasThe Quiet Force: Uncovering Hidden Leadership in High-Impact Design Teams
September 24, 2024
"Creating and holding space is like putting bumpers up in bowling so people know they won’t fail if they engage."
Gina MendoliaTherapists, Coaches, and Grandmas: Techniques for Service Design in Complex Systems
December 3, 2024
"The era of 100-page reports is ending because we simply can’t produce them fast enough at scale."
Lija Hogan Milan Mijatovic Sam Proulx Louis RosenfeldThree Years Out: Perspectives on the Near-Term Future of User Research
March 15, 2024
"With our new operating model, partners are more confident funding UX ops because of increased clarity and focus."
John Calhoun Rachel PosmanTwo Sides of the DesignOps Coin: Teams Ops and Product Ops
January 8, 2024
