Rosenverse
How we Built a VoC (Voice of the Customer) Practice at Upwork from the Ground Up

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

How we Built a VoC (Voice of the Customer) Practice at Upwork from the Ground Up

Gold
Thursday, September 30, 2021 • DesignOps Summit 2021
Share the love for this talk
How we Built a VoC (Voice of the Customer) Practice at Upwork from the Ground Up
Speakers: Shipra Kayan
Link:

Summary

Shipra Kayan, the former head of insights at Upwork, will present the origin story of Upwork's hugely successful and long-running VoC program. From the moment that triggered the formation of a VoC initiative, the ups, and downs of experimenting with its operating model, to why this program is still going strong 7 years after it was launched. She will field questions like "Who owns the VoC?", "What is its purpose?", and "Will we just create another presentation that won't have any real impact?"

- 15 minutes Upwork VoC case study

- 15 minutes for Q&A

Key Insights

  • •

    Rapid company growth creates chaotic, conflicting user feedback that overwhelms product managers without a clear VOC process.

  • •

    Crisis moments, like Upwork's NPS drop post-rebrand, can catalyze executive support to start formal VOC programs.

  • •

    Aligning around a single, existing customer loyalty metric (NPS) helps maintain focus rather than fragmenting goals.

  • •

    The key operational metric was the number of VOC-tagged product issues fixed, translating feedback into actionable roadmap items.

  • •

    Manual note-taking and affinity mapping worked initially but required evolution to collaborative software and AI tools as scale grew.

  • •

    UserVoice was adapted internally to aggregate and cluster customer issues before migrating to more automated idiomatic software.

  • •

    Monthly prioritization meetings with cross-functional stakeholders and frequent product leadership syncs ensured transparency and action.

  • •

    VOC ownership was best handled as a coalition with a facilitator rather than a single owner to avoid silos or turf wars.

  • •

    VOC findings expanded impact beyond product to pricing and legal policy changes, showing broader organizational influence.

  • •

    Attempting to change company culture too quickly or solo is less effective than focusing on incremental, visible customer-driven product improvements.

Notable Quotes

"Going from 100 to 200 people, suddenly product managers started hearing from a dozen people a week with conflicting requests."

"I tried to do everything all by myself at first and it didn’t catch on because no one else knew I was doing it."

"The rebrand caused our NPS to plummet and freaked out our executives — that was the trigger to get serious."

"We stuck with NPS because it was a pure metric with a long history we could trend, instead of muddying things with loyalty or revenue."

"Our one metric that mattered was maximizing the number of VOС-tagged tickets solved – showing customer feedback made it to the roadmap."

"We moved from Evernote to spreadsheets, to a giant affinity board in Mirror, then to UserVoice, and finally to idiomatic software with AI."

"We had to push through analysis paralysis and trust our guts as customer-facing teams that knew the business."

"Ownership of VOC is a hot potato, so we built a coalition with a facilitator to keep it collaborative and effective."

"VOC wasn’t a replacement for user research, but an enhancer that captured nuggets researchers might miss during discovery."

"I spent too much time trying to change company culture and should have focused more on just getting things done."

Ask the Rosenbot
Sarah Brooks
Fireside chat with Sarah Brooks and Jen Pahlka
2021 • Civic Design Community
Dave Gray
Liminal Thinking: Sense-making for systems in large organizations
2015 • Enterprise UX 2015
Gold
Jason Mesut
Unmasking Design Leadership: Navigating leadership without neglecting ourselves
2025 • Rosenfeld Community
Mila Kuznetsova
How Lessons Learned from Our Youngest Users Can Help Us Evolve our Practices
2022 • Advancing Research 2022
Gold
Tim Frick
The journey of building a sustainable design practice
2025 • Climate UX Interest Group
Louis Rosenfeld
The Bigger Picture: A Panel Discussion
2019 • DesignOps Summit 2019
Gold
Yulya Besplemennova
[Demo] Stress-testing GenAI in user research synthesis
2024 • Designing with AI 2024
Gold
Crystal Philcox
The Many Faces of Operations
2017 • DesignOps Summit 2017
Gold
Nicole Aleong
What UX research can learn from other research practices [Advancing Research Community Workshop Series]
2023 • Advancing Research Community
Jon Fukuda
All the Ops: Successful cross-functional collaboration
2025 • DesignOps Summit 2025
Gold
Megan Blocker
Day 2 Theme Panel
2025 • Advancing Research 2025
Gold
Louis Rosenfeld
About the Rosenverse
2026 • Rosenfeld Community
Paula Bach
Improving Legacy Software: How Much Better Does it Have to Be?
2022 • Advancing Research 2022
Gold
Alba Villamil
Stereotyped by Design: Pitfalls in Cross-Cultural User Research
2020 • Advancing Research 2020
Gold
Matteo Gratton
Can Data and Ethics Live Together?
2021 • DesignOps Summit 2021
Gold
Jemma Ahmed
Democratization: Working with it, not against it [Advancing Research Community Workshop Series]
2024 • Advancing Research Community

More Videos

Erin Hauber

"I jump out of bed every morning because an executive said for the first time, this feels like home, this is how I want to work."

Erin Hauber

Design is Not the Frosting on the Scaled Agile Layer Cake

October 24, 2019

Megan Kierstead

"Our jobs as researchers isn’t really to do research. It’s to influence people and help them make decisions."

Megan Kierstead

You Are a Badass at UX: Overcoming Imposter Syndrome

March 10, 2021

Maggie Dieringer

"We maintain structured flexibility so we can move people where the work is regardless of politics or whatever else is going on."

Maggie Dieringer

Creating Consistency Through Constant Change

January 8, 2024

Meaghan Waters

"Maps stop you from getting lost in legacy complexity and keep everyone aligned on what’s important."

Meaghan Waters Fotina Koutropoulous

Lack of Product Thinking will Doom Your Legacy Modernization

June 9, 2021

Jemma Ahmed

"The gap between market research and user research is narrowing; their methods and questions are converging."

Jemma Ahmed

Bringing together market and user research

October 17, 2019

Maria Taylor

"Building trust should absolutely be a core value for design ops teams aiming to steward knowledge effectively."

Maria Taylor

Knowledge is Power: Managing the Lifeblood of the Design Org

October 3, 2023

Sam Proulx

"Getting accessibility integrated into all company processes is essential because accessibility is a culture change."

Sam Proulx

Understanding Screen Readers on Mobile: How And Why to Learn from Native Users

June 6, 2023

Catherine Blizzard

"We introduced 'go-to' people, like account managers, responsible for particular business areas to maintain relationships."

Catherine Blizzard

Using Integrated Insight to Drive Growth

March 10, 2022

Randolph Duke II

"I put down my question guide and just talked with Carol."

Randolph Duke II

War Stories LIVE! Randy Duke II

March 30, 2020