Rosenverse
Scaling Research Via an Ops First Model at Clever

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Scaling Research Via an Ops First Model at Clever

Gold
Monday, March 27, 2023 • Advancing Research 2023
Share the love for this talk
Scaling Research Via an Ops First Model at Clever
Speakers: Liza Pemstein and Jane Davis
Link:

Summary

In this Q&A session, we'll hear how Liza Pemstein, Research Operations Manager at Clever, built a robust research practice at one of the fastest-growing EdTech companies. Identifying the friction in the process experienced by design, product, engineering, and marketing, Liza has streamlined and scaled research. She'll share how she got started, what she's learned and what she's excited about in 2023!

Key Insights

  • •

    Clever operates a research operations first model with no dedicated UX researchers, relying on designers and PMs to conduct research.

  • •

    Liza Pennstein’s path to research operations included customer solutions roles emphasizing empathy, listening, and problem-solving.

  • •

    Centralizing participant incentives through a shared credit card and Jira ticket system eliminated confusion and improved process efficiency.

  • •

    Recruiting and scheduling user research participants was a major barrier that was addressed by creating shared participant databases.

  • •

    The ROCKS program at Clever (Research Ops Knowledge Share) facilitates cross-team learning and un-silos research knowledge.

  • •

    Initial focus was on increasing research confidence and comfort among practitioners before emphasizing quality and best practices.

  • •

    Balancing standardization with flexibility is critical; intervention happens when research quality or participant screening falters.

  • •

    Without dedicated UX researchers, Clever prioritizes enabling non-experts with training, templates, and external expert speakers.

  • •

    Building a lightweight repository with Great Question software supports storing and sharing research insights effectively.

  • •

    Future plans include broadening methods like unmoderated research, increasing visibility, and maintaining momentum through speaker series and workshops.

Notable Quotes

"Research is a sales role at its heart, delivering value to people to drive sustainable growth."

"I had a hunger for process and efficiency once I built a feedback bot to share customer insights."

"We don’t have dedicated user researchers, but designers and PMs conduct most research here."

"People were doing incentives in different ways, using their own cards, which was confusing, so I centralized it."

"The biggest struggle was recruiting and scheduling participants, so we started a shared Google sheet."

"Research is a group project and learning is a group project—you don’t have to be an expert but find those who are."

"I want to encourage excitement about research and gradually mold people into better researchers."

"Sometimes you have to make it messy before it can be clean again — disrupt to improve."

"We have the quantity of research work; now we’re focused on building up the quality."

"Unmoderated research is exciting because it lets us gather insights while freeing people up to be in two places at once."

Ask the Rosenbot
Jessamyn Edwards
Surviving Your UX Career in Enterprise Design
2021 • Enterprise Community
Yasmine Khan
Checking Bias and Listening to Financially Vulnerable Americans
2020 • Advancing Research 2020
Gold
Todd Healy
Driving Change with CX Metrics
2023 • Enterprise UX 2023
Gold
Sarah Sgarlato Pierini
From Passion to Execution: A Story of Evolving Research Maturity at LinkedIn
2022 • DesignOps Summit 2022
Gold
Laine Riley Prokay
Carving a Path for Early Career DesignOps Practitioners
2022 • DesignOps Summit 2022
Gold
Rachael Greene
Building a Design Ops Practice that Really Works (Most of the Time)
2025 • DesignOps Community
Peter Merholz
The 2025 State of UX/Design Organizational Health
2025 • Rosenfeld Community
Veevi Rosenstein
Building for Scale: Creating the Zendesk UX Research Practice
2024 • Enterprise Experience 2020
Gold
Chloe Amos-Edkins
A Cultural Approach: Research in the Context of Glocalisation
2023 • Advancing Research 2023
Gold
Michele Marut
Research Repositories Reconsidered
2019 • DesignOps Community
Sam Proulx
Online Shopping: Designing an Accessible Experience
2023 • Enterprise UX 2023
Gold
Victor Lombardi
Bridging Design and Climate Science
2024 • Climate UX Interest Group
Amy Bucher
Harnessing behavioral science to uncover deeper truths
2025 • Advancing Research 2025
Gold
Dave Malouf
Panel: Design Systems and Documentation
2017 • DesignOps Summit 2017
Gold
Noreen Whysel
Short Take #4: UX/Product Lessons from Your Industry Peers
2022 • Design in Product 2022
Gold
Shivanjali M.
From Fragmented to Fluent: The Linguistic Approach to Research Knowledge
2026 • Rosenfeld Community

More Videos

Shipra Kayan

"We moved from Evernote to spreadsheets, to a giant affinity board in Mirror, then to UserVoice, and finally to idiomatic software with AI."

Shipra Kayan

How we Built a VoC (Voice of the Customer) Practice at Upwork from the Ground Up

September 30, 2021

Peter Morville

"Categories are dangerous but not bad."

Peter Morville

The Architecture of Understanding

May 13, 2015

Renee Reid

"I want people to question why I’m not in the room if I’m not there."

Renee Reid

Becoming a ResearchH.E.R (Highly Enterprise Ready)

June 3, 2019

Dane DeSutter

"Our bodies profoundly influence the way that we think about ourselves, others, the world, and everything in it."

Dane DeSutter

Keeping the Body in Mind: What Gestures and Embodied Actions Tell You That Users May Not

March 26, 2024

Sam Proulx

"Avoid strictly timed interactions because they stress everyone, especially people using screen readers or with cognitive disabilities."

Sam Proulx

Online Shopping: Designing an Accessible Experience

October 3, 2023

Andrew Custage

"Digital channels now have higher standards—customers expect personalization at all times."

Andrew Custage Michael Mallett

The Digital Journey: Research on Consumer Frustration and Loyalty

March 29, 2023

Shelby Switzer

"It’s okay to be goofy and have fun—creating space for awkwardness and playfulness helps engagement."

Shelby Switzer

Making Space for Community Knowledge-sharing in a Distributed World

December 10, 2021

Llewyn Paine

"Generative AI is non-deterministic and doesn’t understand meaning, so baseline error rates exist in all tools we use."

Llewyn Paine

Coexisting with AI: A practical guide for researchers to navigate tools, ethics, and integration

March 11, 2025

Robin Beers

"Learning is the new knowing, and researchers are catalysts of organizational learning."

Robin Beers

Navigating organizational systems: Rethinking researcher’s role in driving change

March 13, 2025