Rosenverse
How we Built a VoC (Voice of the Customer) Practice at Upwork from the Ground Up

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

How we Built a VoC (Voice of the Customer) Practice at Upwork from the Ground Up

Gold
Thursday, September 30, 2021 • DesignOps Summit 2021
Share the love for this talk
How we Built a VoC (Voice of the Customer) Practice at Upwork from the Ground Up
Speakers: Shipra Kayan
Link:

Summary

Shipra Kayan, the former head of insights at Upwork, will present the origin story of Upwork's hugely successful and long-running VoC program. From the moment that triggered the formation of a VoC initiative, the ups, and downs of experimenting with its operating model, to why this program is still going strong 7 years after it was launched. She will field questions like "Who owns the VoC?", "What is its purpose?", and "Will we just create another presentation that won't have any real impact?" - 15 minutes Upwork VoC case study - 15 minutes for Q&A

Key Insights

  • Rapid company growth creates chaotic, conflicting user feedback that overwhelms product managers without a clear VOC process.

  • Crisis moments, like Upwork's NPS drop post-rebrand, can catalyze executive support to start formal VOC programs.

  • Aligning around a single, existing customer loyalty metric (NPS) helps maintain focus rather than fragmenting goals.

  • The key operational metric was the number of VOC-tagged product issues fixed, translating feedback into actionable roadmap items.

  • Manual note-taking and affinity mapping worked initially but required evolution to collaborative software and AI tools as scale grew.

  • UserVoice was adapted internally to aggregate and cluster customer issues before migrating to more automated idiomatic software.

  • Monthly prioritization meetings with cross-functional stakeholders and frequent product leadership syncs ensured transparency and action.

  • VOC ownership was best handled as a coalition with a facilitator rather than a single owner to avoid silos or turf wars.

  • VOC findings expanded impact beyond product to pricing and legal policy changes, showing broader organizational influence.

  • Attempting to change company culture too quickly or solo is less effective than focusing on incremental, visible customer-driven product improvements.

Notable Quotes

"Going from 100 to 200 people, suddenly product managers started hearing from a dozen people a week with conflicting requests."

"I tried to do everything all by myself at first and it didn’t catch on because no one else knew I was doing it."

"The rebrand caused our NPS to plummet and freaked out our executives — that was the trigger to get serious."

"We stuck with NPS because it was a pure metric with a long history we could trend, instead of muddying things with loyalty or revenue."

"Our one metric that mattered was maximizing the number of VOС-tagged tickets solved – showing customer feedback made it to the roadmap."

"We moved from Evernote to spreadsheets, to a giant affinity board in Mirror, then to UserVoice, and finally to idiomatic software with AI."

"We had to push through analysis paralysis and trust our guts as customer-facing teams that knew the business."

"Ownership of VOC is a hot potato, so we built a coalition with a facilitator to keep it collaborative and effective."

"VOC wasn’t a replacement for user research, but an enhancer that captured nuggets researchers might miss during discovery."

"I spent too much time trying to change company culture and should have focused more on just getting things done."

Ask the Rosenbot
David Cronin
Discussion
2015 • Enterprise UX 2015
Gold
Alexis Lucio
Scaling Accessibility Through Design Systems
2022 • Design at Scale 2022
Gold
Jack Moffett
SAFe or Sorry?
2019 • Enterprise Community
Michele Marut
Research Repositories Reconsidered
2019 • DesignOps Community
Sarah Williams
Verizon_A Framework for CX Transformation
2024 • Design at Scale 2021
Gold
Emily Williams
When UX Research and Institutional Racism Collide: A Case Study
2021 • Advancing Research 2021
Gold
Andrew Michael
Building a Product Insights Team
2022 • Advancing Research 2022
Gold
Sean McKay
Whole Product Thinking: Expanding beyond problem and solution space thinking
2024 • Rosenfeld Community
Stefanie Owens
Optimizing for Outcomes: Transformation Design in Systems at Scale
2024 • Advancing Service Design 2024
Gold
Taylor Klassman
Shaping the Next Era of UX Research: Collaborative Forum
2025 • Advancing Research 2025
Gold
Shipra Kayan
Emerging principles for using AI in Design: What the product design team at Miro has learned from deeply integrating AI in their workflow
2025 • Designing with AI 2025
Gold
Cheryl Platz
Merging Improv with Design
2019 • Enterprise Community
Victor M. Gonzalez
Practicing Learners and Learning Practitioners
2021 • Advancing Research 2021
Gold
Sarah Auslander
Incremental Steps to Drive Radical Innovation in Policy Design
2022 • Civic Design 2022
Gold
Joshua Noble
Casual Inference
2023 • QuantQual Interest Group
Bria Alexander
Opening Remarks
2022 • Civic Design 2022
Gold

More Videos

Surya Vanka

"There are 8 billion creative humans on planet Earth, far beyond the number of trained designers."

Surya Vanka

Unleashing Swarm Creativity to Solve Enterprise Challenges

June 10, 2021

Patrick Boehler

"People are better equipped to decide and act in their lives when we deliver relevant and useful information."

Patrick Boehler Madison Karas

The service shift: transforming media organizations to create real value through design

November 19, 2025

Andreas Huebner

"It’s really been helpful that research supports design not just in discovery but also in validating that what we build meets customer expectations."

Andreas Huebner Amy Takata Craig Brookes

What Is It Like To Be Part of The UX Team at Compass?

March 11, 2021

Patrizia Bertini

"Leaders spend a lot of time on operational work, which does not allow design strategy to mature."

Patrizia Bertini Alexandra Mengoni León

Pushing DesignOps’ Influence into New Global Markets

September 9, 2022

Phil Gilbert

"The Austin studio’s walls can be put up and taken down by a 90-pound person on a Home Depot shopping cart."

Phil Gilbert

A Consistent Culture of Design

May 14, 2015

Yulya Besplemennova

"This is a hero moment because it accelerates and simplifies exploration of clustering options."

Yulya Besplemennova

[Demo] Stress-testing GenAI in user research synthesis

June 4, 2024

Sarah Rink

"It really pays off to prepare way more for remote than for in-person research."

Sarah Rink

Remote User Research: Dos and Don'ts from the Virtual Field

June 11, 2020

Mujtaba Hameed

"We used AI tools like NotebookLM and Gemini primarily to shortcut getting up to speed and managing transcripts, without focusing on specific tools themselves."

Mujtaba Hameed

The new horizon of ethnography: using AI to unlock the full potential of in-person research

March 11, 2026

Sheryl Cababa

"If you’re working at scale, many problems that seem like 'clock' problems actually have 'cloud' elements."

Sheryl Cababa

Living in the Clouds: Adopting a Systems Thinking Mindset

June 6, 2023