Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

How we Built a VoC (Voice of the Customer) Practice at Upwork from the Ground Up

Gold
Thursday, September 30, 2021 • DesignOps Summit 2021
Share the love for this talk
How we Built a VoC (Voice of the Customer) Practice at Upwork from the Ground Up
Speakers: Shipra Kayan
Link:

Summary

Shipra Kayan, the former head of insights at Upwork, will present the origin story of Upwork's hugely successful and long-running VoC program. From the moment that triggered the formation of a VoC initiative, the ups, and downs of experimenting with its operating model, to why this program is still going strong 7 years after it was launched. She will field questions like "Who owns the VoC?", "What is its purpose?", and "Will we just create another presentation that won't have any real impact?" - 15 minutes Upwork VoC case study - 15 minutes for Q&A

Key Insights

  • Rapid company growth creates chaotic, conflicting user feedback that overwhelms product managers without a clear VOC process.

  • Crisis moments, like Upwork's NPS drop post-rebrand, can catalyze executive support to start formal VOC programs.

  • Aligning around a single, existing customer loyalty metric (NPS) helps maintain focus rather than fragmenting goals.

  • The key operational metric was the number of VOC-tagged product issues fixed, translating feedback into actionable roadmap items.

  • Manual note-taking and affinity mapping worked initially but required evolution to collaborative software and AI tools as scale grew.

  • UserVoice was adapted internally to aggregate and cluster customer issues before migrating to more automated idiomatic software.

  • Monthly prioritization meetings with cross-functional stakeholders and frequent product leadership syncs ensured transparency and action.

  • VOC ownership was best handled as a coalition with a facilitator rather than a single owner to avoid silos or turf wars.

  • VOC findings expanded impact beyond product to pricing and legal policy changes, showing broader organizational influence.

  • Attempting to change company culture too quickly or solo is less effective than focusing on incremental, visible customer-driven product improvements.

Notable Quotes

"Going from 100 to 200 people, suddenly product managers started hearing from a dozen people a week with conflicting requests."

"I tried to do everything all by myself at first and it didn’t catch on because no one else knew I was doing it."

"The rebrand caused our NPS to plummet and freaked out our executives — that was the trigger to get serious."

"We stuck with NPS because it was a pure metric with a long history we could trend, instead of muddying things with loyalty or revenue."

"Our one metric that mattered was maximizing the number of VOС-tagged tickets solved – showing customer feedback made it to the roadmap."

"We moved from Evernote to spreadsheets, to a giant affinity board in Mirror, then to UserVoice, and finally to idiomatic software with AI."

"We had to push through analysis paralysis and trust our guts as customer-facing teams that knew the business."

"Ownership of VOC is a hot potato, so we built a coalition with a facilitator to keep it collaborative and effective."

"VOC wasn’t a replacement for user research, but an enhancer that captured nuggets researchers might miss during discovery."

"I spent too much time trying to change company culture and should have focused more on just getting things done."

Ask the Rosenbot
Saara Kamppari-Miller
Cartography for Design Communities
2025 • DesignOps Summit 2025
Gold
Ned Dwyer
The Future of DesignOps is Tool Consolidation
2024 • DesignOps Summit 2024
Gold
Farid Sabitov
Automatization for Large Enterprise Teams
2024 • DesignOps Summit 2020
Gold
Bria Alexander
Opening Remarks
2022 • Civic Design 2022
Gold
Bria Alexander
Day 2 Welcome
2024 • DesignOps Summit 2024
Gold
Bria Alexander
Opening Remarks
2023 • Advancing Research 2023
Gold
Sheryl Cababa
Thinking in systems to address climate with Sheryl Cababa
2024 • Climate UX Interest Group
Bas Raijmakers, PhD (RCA)
What Design Research can Learn from Documentary Filmmaking
2022 • Advancing Research 2022
Gold
Sam Proulx
SUS: A System Unusable for Twenty Percent of the Population
2021 • Design at Scale 2021
Gold
Alex Hurworth
Designing a Contact Tracing App for Universal Access
2020 • DesignOps Summit 2020
Gold
Dave Malouf
The Future of DesignOps
2024 • DesignOps Summit 2020
Gold
Llewyn Paine
Coexisting with AI: A practical guide for researchers to navigate tools, ethics, and integration
2025 • Advancing Research 2025
Gold
Prerna Makanawala
Achieving Balanced Design Consistency
2021 • Design at Scale 2021
Gold
Peter Van Dijck
Hands on AI #3: Claude Code for UX people
2025 • Rosenfeld Community
Patrick Boehler
The service shift: transforming media organizations to create real value through design
2025 • Advancing Service Design 2025
Gold
Terry Buckman
Wargaming (An Introduction)
2023 • Enterprise Community

More Videos

John Cutler

"You have to go from being able to deliver a message in three bullets and then turn around in the next moment and deliver a massive service blueprint or customer journey."

John Cutler

Oxbows, Rivers, and Estuaries: How to navigate the currents of change (without burning out)

December 3, 2024

Darian Davis

"If you’re generating buy-in, don’t forget what it will mean for your difficult stakeholders—they may have external pressures you don’t know about."

Darian Davis

Lessons from a Toxic Work Relationship

January 8, 2024

Dave Gray

"You don’t have to sit through two hours a day; we’ll spend about 15 minutes on setup then you’ll pair up and do the exercise."

Dave Gray

Group Activity: Making Sense of DesignOps

November 7, 2017

John Cutler

"The subtle art of taking care of yourself and giving a f in ways that generally encourage coherent behaviors."

John Cutler

The Alignment Trap

November 29, 2023

Abby Covert

"Just because you can color code something doesn’t mean you should."

Abby Covert

Stuck? Diagrams Help

October 27, 2022

Mark Interrante

"Side-pav proposals answer what’s going on, why it matters now, what you propose, what action to take, and what benefit comes from it."

Mark Interrante

Collaboration Flows in Product Development

June 9, 2017

Devon Powers

"Too often, futures imaginaries want to erase or align difference rather than reckon with it."

Devon Powers

Imagining Better Futures

March 9, 2022

Prayag Narula

"Bring your research team as note takers and facilitators—they make excellent collaborators and help build feedback loops."

Prayag Narula

How to Empower Your Designers to Do Good Research – And Why You Want To

June 10, 2022

Peter Van Dijck

"Cloud code wasn’t programmed to do this; it’s a very lightweight system where the model does most of the work."

Peter Van Dijck

Hands on AI #3: Claude Code for UX people

October 22, 2025