Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

How we Built a VoC (Voice of the Customer) Practice at Upwork from the Ground Up
Gold
Thursday, September 30, 2021 • DesignOps Summit 2021
Share the love for this talk
How we Built a VoC (Voice of the Customer) Practice at Upwork from the Ground Up
Speakers: Shipra Kayan
Link:

Summary

Shipra Kayan, the former head of insights at Upwork, will present the origin story of Upwork's hugely successful and long-running VoC program. From the moment that triggered the formation of a VoC initiative, the ups, and downs of experimenting with its operating model, to why this program is still going strong 7 years after it was launched. She will field questions like "Who owns the VoC?", "What is its purpose?", and "Will we just create another presentation that won't have any real impact?" - 15 minutes Upwork VoC case study - 15 minutes for Q&A

Key Insights

  • Rapid company growth can overwhelm product teams with conflicting customer requests, necessitating a structured VOC program.

  • Launching a VOC program without broad consensus often fails, as happened initially when Shippra worked alone.

  • A sharp drop in NPS served as a critical trigger to rally executives and teams around customer feedback.

  • Focusing on NPS over other metrics like CSAT or revenue helps maintain focus on customer loyalty during VOC efforts.

  • Defining the core metric for success as the number of VOC-tagged product issues resolved creates clear impact measurement.

  • VOC inputs combine qualitative data from research, social media, and support, with quantitative analytics for comprehensive understanding.

  • Evolving tools—from Evernote to spreadsheets, Miro boards, UserVoice, and Idiomatic—enabled scaling VOC data management.

  • A coalition model with a dedicated facilitator ensures cross-functional alignment and shared ownership rather than conflict.

  • Monthly prioritization meetings balance data-driven analysis with trusting customer-facing team judgment to overcome analysis paralysis.

  • VOC programs can expand beyond product changes to impact pricing, legal, and other company areas, reflecting customer experience holistically.

Notable Quotes

"We went from 100 to 200 people but still had the muscle of a 50 person company—it was chaos for product managers."

"Don’t jump to a solution too fast without consensus; I tried to build a VOC system solo and it didn’t catch on."

"Our NPS plummeted after a rebrand and that freaked out executives—it was our fire moment to start VOC."

"We decided to stick with NPS because we had a long history with it and didn’t want to muddy our goals."

"The moment we felt customer feedback worked was when it got incorporated directly into the product roadmap."

"At first, VOC was just me synthesizing, but as the company grew, we needed tools like UserVoice and then Idiomatic."

"UserVoice let us merge similar requests internally, which was crucial before automation."

"We had to push through analysis paralysis and trust our guts on what to prioritize for product changes."

"Ownership of VOC is a hot potato—we decided on a coalition with a facilitator to avoid competition."

"VOC enhances but does not replace user research; it captures the nuggets that would otherwise get lost."

Mandy Drew
What Role(s) Can Research Play in Responsible Design?
2021 • Advancing Research 2021
Gold
Christian Crumlish
AMA with Christian Crumlish, author of Product Management for UX People (Videoconference)
2022 • Enterprise Community
Jemma Ahmed
Theme 2 Intro
2024 • Advancing Research 2024
Gold
Dave Malouf
Theme 3: Introduction and Provocation
2024 • DesignOps Summit 2020
Gold
Bria Alexander
Opening Remarks
2021 • Design at Scale 2021
Gold
Scaling Design through Relationship Maps
2017 • DesignOps Summit 2017
Gold
Catherine Courage
The Enterprise UX Journey: Lessons From the Voyage & The Opportunity Ahead
2015 • Enterprise UX 2015
Gold
Phil Gilbert
A Consistent Culture of Design
2015 • Enterprise UX 2015
Gold
Sarah Rink
Remote User Research: Dos and Don'ts from the Virtual Field (Videoconference)
2020 • Advancing Research Community
Emily Eagle
Can't Rewind: Radio and Retail
2019 • Enterprise Experience 2019
Gold
Andrew Webster
Scaling Design Capability: How Involved Should You Be?
2021 • DesignOps Summit 2021
Gold
Marjorie Stainback
Transforming Strategic Research Capacity through Democratization
2019 • DesignOps Summit 2019
Gold
Jackie Ho
Lead Effectively While Preserving Team Autonomy with Growth Boards
2024 • Enterprise Experience 2020
Gold
Robin Beers
How to create actionable insight in the face of politics and silos [Advancing Research Community Workshop Series] (Videoconference)
2023 • Advancing Research Community
Alba Villamil
Stereotyped by Design: Pitfalls in Cross-Cultural User Research
2020 • Advancing Research 2020
Gold
Paula Bach
Improving Legacy Software: How Much Better Does it Have to Be?
2022 • Advancing Research 2022
Gold

More Videos

Wyatt Hayman

"The majority of the participants last through the six-month commitment with only about 5% removed for low engagement."

Wyatt Hayman

Global Research Panels (Videoconference)

August 8, 2020

PJ Buddhari

"We hold quarterly town halls and office hours to keep the community informed and supported."

PJ Buddhari Nate Baldwin

Meet Spectrum, Adobe’s Design System

June 9, 2021

Sarah Gallimore

"Exploring Wi-Fi-free zones in Toronto highlights citizen-driven desires to unplug and maintain data privacy in public spaces."

Sarah Gallimore

Inspire Progress with Artifacts from the Future

November 18, 2022

Peter Merholz

"Knowing your subject matter as a UX leader is just as important as knowing your craft."

Peter Merholz

The Trials and Tribulations of Directors of UX (Videoconference)

July 13, 2023

Dr. Jamika D. Burge

"Hiring local community members as researchers in crisis zones creates safer environments and authentic stories."

Dr. Jamika D. Burge Mansi Gupta

Advancing the Inclusion of Womxn in Research Practices (Videoconference)

September 15, 2022

Amy Marquez

"There’s been a convergence over the last years because everybody’s got a mobile device now and expects a certain kind of experience."

Amy Marquez

INVEST: Discussion

June 15, 2018

Dane DeSutter

"Do you play games? Cool, you’re in. Stop asking questions. It’s about behavior, not identity."

Dane DeSutter Natalie Gedeon Deborah Hendersen Cheryl Platz

Beyond the Console: The rise of the Gamer Experience and how gaming will impact UX Research across industries (Videoconference)

May 17, 2024

Zariah Cameron

"Stop saying rest is a luxury or a privilege. It is not. It is a human right."

Zariah Cameron

ReDesigning Wellbeing for Equitable Care in the Workplace

September 23, 2024

Jessica Norris

"Regular positive feedback, not just negative, is essential because many with ADHD rely on extrinsic motivation."

Jessica Norris

ADHD: A DesignOps Superpower

September 9, 2022