Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

How we Built a VoC (Voice of the Customer) Practice at Upwork from the Ground Up
Gold
Thursday, September 30, 2021 • DesignOps Summit 2021
Share the love for this talk
How we Built a VoC (Voice of the Customer) Practice at Upwork from the Ground Up
Speakers: Shipra Kayan
Link:

Summary

Shipra Kayan, the former head of insights at Upwork, will present the origin story of Upwork's hugely successful and long-running VoC program. From the moment that triggered the formation of a VoC initiative, the ups, and downs of experimenting with its operating model, to why this program is still going strong 7 years after it was launched. She will field questions like "Who owns the VoC?", "What is its purpose?", and "Will we just create another presentation that won't have any real impact?" - 15 minutes Upwork VoC case study - 15 minutes for Q&A

Key Insights

  • Rapid company growth can overwhelm product teams with conflicting customer requests, necessitating a structured VOC program.

  • Launching a VOC program without broad consensus often fails, as happened initially when Shippra worked alone.

  • A sharp drop in NPS served as a critical trigger to rally executives and teams around customer feedback.

  • Focusing on NPS over other metrics like CSAT or revenue helps maintain focus on customer loyalty during VOC efforts.

  • Defining the core metric for success as the number of VOC-tagged product issues resolved creates clear impact measurement.

  • VOC inputs combine qualitative data from research, social media, and support, with quantitative analytics for comprehensive understanding.

  • Evolving tools—from Evernote to spreadsheets, Miro boards, UserVoice, and Idiomatic—enabled scaling VOC data management.

  • A coalition model with a dedicated facilitator ensures cross-functional alignment and shared ownership rather than conflict.

  • Monthly prioritization meetings balance data-driven analysis with trusting customer-facing team judgment to overcome analysis paralysis.

  • VOC programs can expand beyond product changes to impact pricing, legal, and other company areas, reflecting customer experience holistically.

Notable Quotes

"We went from 100 to 200 people but still had the muscle of a 50 person company—it was chaos for product managers."

"Don’t jump to a solution too fast without consensus; I tried to build a VOC system solo and it didn’t catch on."

"Our NPS plummeted after a rebrand and that freaked out executives—it was our fire moment to start VOC."

"We decided to stick with NPS because we had a long history with it and didn’t want to muddy our goals."

"The moment we felt customer feedback worked was when it got incorporated directly into the product roadmap."

"At first, VOC was just me synthesizing, but as the company grew, we needed tools like UserVoice and then Idiomatic."

"UserVoice let us merge similar requests internally, which was crucial before automation."

"We had to push through analysis paralysis and trust our guts on what to prioritize for product changes."

"Ownership of VOC is a hot potato—we decided on a coalition with a facilitator to avoid competition."

"VOC enhances but does not replace user research; it captures the nuggets that would otherwise get lost."

Ask the Rosenbot
Kit Unger
Theme 3 Intro
2022 • Design at Scale 2022
Gold
Steve Portigal
Looking Back…to Look Ahead
2024 • Advancing Research 2024
Gold
Jacqui Frey
Panel Discussion: Integrating DesignOps
2018 • DesignOps Summit 2018
Gold
Bill Scott
Lean Engineering: Engineering for Learning and Experimentation in the Enterprise
2015 • Enterprise UX 2015
Gold
Sam Proulx
SUS: A System Unusable for Twenty Percent of the Population
2021 • DesignOps Summit 2021
Gold
Harry Max
Prioritization for Leaders (2nd of 3 seminars) (Videoconference)
2024 • Rosenfeld Community
Dr. Jamika D. Burge
Bridge Building across Research Disciplines (Videoconference)
2021 • Advancing Research Community
Brian T. O’Neill
Does Designing and Researching Data Products Powered by ML/AI and Analytics Call for New UX Methods?
2022 • QuantQual Interest Group (Rosenfeld Community)
Lona Moore
Scaling Design Beyond Designers
2021 • Design at Scale 2021
Gold
Abby Covert
Panel: Collaboration Tools
2017 • DesignOps Summit 2017
Gold
Weidan Li
[Case Study] Qualitative synthesis with ChatGPT: Better or worse than human intelligence?
2024 • Designing with AI 2024
Gold
Savannah Carlin
[Case Study] Don't botch the bot: Designing interactions for AI
2024 • Designing with AI 2024
Gold
Maish Nichani
Sparking a Service Excellence Mindset at a Government Agency
2021 • Civic Design 2021
Gold
Kristin Skinner
8 Types of Measures in Design Operations (Videoconference)
2020 • DesignOps Community
Rob Mitzel
The Tale of Two Companies: Building a Successful UX Practice in a Century-Old Enterprise
2024 • Enterprise Experience 2020
Gold
Sam Proulx
Accessibility: An Opportunity to Innovate
2022 • Civic Design 2022
Gold

More Videos

Adam Cutler

"The hardest part about remote is making design reviews feel collaborative and team-based."

Adam Cutler Karen Pascoe Ian Swinson Susan Worthman

Discussion

June 8, 2016

Peter Merholz

"Many product managers got their roles because they know the business or subject matter, but they don’t know how to manage product development."

Peter Merholz

The Trials and Tribulations of Directors of UX (Videoconference)

July 13, 2023

Lisa Welchman

"Governance is about decision making, not workflow processes."

Lisa Welchman

Cleaning Up Our Mess: Digital Governance for Designers

June 14, 2018

Vincent Brathwaite

"Every small action contributes to a larger impact in the fight against climate change."

Vincent Brathwaite

Opener: Past, Present, and Future—Closing the Racial Divide in Design Teams

October 22, 2020

Brenna Fallon

"If you get a perfect score on your OKRs, it means you didn’t set your sights high enough."

Brenna Fallon

Learning Over Outcomes

October 24, 2019

Tricia Wang

"Linear perspective created this myth that we can see reality from a single perspective, which is the source of all misunderstanding."

Tricia Wang

Spatial Collapse: Designing for Emergent Culture

January 8, 2024

Edgar Anzaldua Moreno

"If you don’t bring stakeholders into the research journey, they won’t believe or use the data."

Edgar Anzaldua Moreno

Using Research to Determine Unique Value Proposition

March 11, 2021

"The toy shouldn’t be the goal of play, but a tool or a process that unlocks the unlimited possibilities set forth before a child."

Designing Systems at Scale

November 7, 2018

Erin Weigel

"A lot of developers are way too confident they write perfect code; testing bug fixes often reveals hidden issues."

Erin Weigel

Get Your Whole Team Testing to Design for Impact

July 24, 2024