Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

IBM User Experience Program—The What, Why and How (Videoconference)
Friday, October 15, 2021 • Advancing Research Community
Share the love for this talk
IBM User Experience Program—The What, Why and How (Videoconference)
Speakers: Tracy McGoldrick
Link:

Summary

How does IBM co-create with our end-users to design products they love? Learn how the IBM Cloud and AI research team created a User Experience Program that formalizes and scales the relationship between our product teams and the end-users. User Experience “Partners,” as we lovingly call them, co-create with our product team to help refine IBM products by providing feedback, ideas, and domain expertise.

Key Insights

  • IBM’s User Experience Program partners with invested customers who provide ongoing feedback without receiving incentives, creating deeper co-creation relationships than typical research participants.

  • Recruitment of UX partners involves multiple internal stakeholders and requires evangelizing the program internally to build trust and identify the right users.

  • User Experience Partners engage about one hour per month on average and must be involved at least once per quarter, balancing engagement without overburdening participants.

  • Legal agreements signed are 'evergreen' covering all company employees and do not expire, simplifying ongoing feedback collection but creating some onboarding friction.

  • Maintaining relationships with UX partners requires a dedicated program management team coordinating closely with lead researchers to deliver personalized paybacks and updates.

  • Diversity and inclusivity in UX partner recruitment are top priorities, but finding edge cases and users with diverse abilities remains a significant challenge.

  • Research outputs are stored in a robust Airtable-based repository enabling researchers self-service access while tracking participant engagement to avoid overuse.

  • The program aims to integrate UX partner feedback not only for usability improvements but for long-term strategic input shaping product roadmaps and innovation direction.

  • Effective communication with stakeholders requires flexibility: adapting style when talking to executives, account managers, or technical end users is essential.

  • IBM’s executive leadership strongly supports the program, helping drive recruitment and internal alignment through advocacy and public call to actions.

Notable Quotes

"Yesterday was a prototype means that we are continually rethinking and redesigning around our users' needs."

"Our goal is to create and deliver world-class user experiences for our customers period."

"User experience partners are our greatest source of learning. Without their feedback, we’re just guessing what they want."

"It’s a white glove concierge service to build trust and make customers comfortable to share meaningful feedback."

"We don’t promise that the feedback will show up in the product, but we regularly update partners on impact through meetings and newsletters."

"Diversity and inclusivity are huge areas we’re actively working on, especially recruiting users with diverse abilities."

"It takes a long time to get people across the company onboard and to build this type of program, but it’s worth it."

"The feedback program agreement is evergreen and covers everyone in the customer’s company, making ongoing recruiting easier."

"The most rewarding part is talking daily with customers worldwide and helping solve their problems through product improvements."

"We don’t measure this program with separate objectives; we tie its outcomes directly to the company’s overall business goals."

Ask the Rosenbot
Tony Turner
Capturing Deep Insights
2021 • DesignOps Summit 2021
Gold
Kurdin Bazaz
Culture, DIBS & Recruiting
2021 • Design at Scale 2021
Gold
Angelos Arnis
Navigating the Rapid Shifts in Tech's Turbulent Terrain
2023 • DesignOps Summit 2023
Gold
Kelly Dern
AI as a Design Partner: How to Get the Most Out of AI Tools to Scale Your Process
2023 • DesignOps Summit 2023
Gold
Elena Naids
The Power of Difficult Conversations: A Case Study on How We Introduced Design Ops in the Federal Government Space
2023 • DesignOps Summit 2023
Gold
Kristin Skinner
Theme 1 Intro
2021 • DesignOps Summit 2021
Gold
Natalia Radywyl
Co-Designing New Power in Australia's Public Sector
2022 • Civic Design 2022
Gold
Mandy Drew
What Role(s) Can Research Play in Responsible Design?
2021 • Advancing Research 2021
Gold
Jen Cardello
Learning Velocity—The Insights Speedometer (Videoconference)
2021 • Advancing Research Community
Daniel Gloyd
Designing Warmth
2025 • Rosenfeld Community
Emily Lessard
RFPs Without Tears: Writing Inclusive RFPS that Don't Scare Away Talent
2021 • Civic Design 2021
Gold
Russ Unger
Onboarding: The Ecosystem, not the Afterthought
2017 • DesignOps Summit 2017
Gold
Laine Riley Prokay
How DesignOps can Drive Inclusive Career Ladders for All
2021 • DesignOps Summit 2021
Gold
Wendy Johansson
Design at Scale: Behind the Scenes (Videoconference)
2021 • Enterprise Community
Ivana Ng
Level Up Your Program with ProductOps
2024 • Enterprise Experience 2020
Gold
Jemma Ahmed
Democratization: Working with it, not against it [Advancing Research Community Workshop Series]
2024 • Advancing Research Community

More Videos

Alex Hurworth

"Innovation in conservation practices is desperately needed to keep pace with environmental changes."

Alex Hurworth Bonnie John Fahd Arshad Antoine Marin

Designing a Contact Tracing App for Universal Access

October 23, 2020

Laine Riley Prokay

"We started to ask ourselves, does every new Design Ops practitioner need 10 years of experience like Lisa and I? What opportunities are we missing by not having more junior roles?"

Laine Riley Prokay Lisa Gordon

Carving a Path for Early Career DesignOps Practitioners

September 9, 2022

Eniola Oluwole

"TripAdvisor is really nine major business units each thinking like sub companies instead of one end-to-end user experience."

Eniola Oluwole

Lessons From the DesignOps Journey of the World's Largest Travel Site

October 24, 2019

Nathan Shedroff

"Rather than aiming for the chief strategy officer directly, build relationships with junior strategists who are more accessible."

Nathan Shedroff

Double Your Mileage: Use Your Research Strategically

March 31, 2020

Sam Proulx

"Voice control on mobile goes beyond digital assistants and can fully control the device for users who cannot use touch."

Sam Proulx

Mobile Accessibility: Why Moving Accessibility Beyond the Desktop is Critical in a Mobile-first World

November 17, 2022

Feleesha Sterling

"Rapid research is a flexible framework for quickly executing UX research for fast and often tactical or evaluative design decisions."

Feleesha Sterling

Building a Rapid Research Program (Videoconference)

May 18, 2023

Neil Barrie

"You have the power, like Navy Seals of user research, to influence the biggest issues of our time, one interaction at a time."

Neil Barrie

Widening the Aperture: The Case for Taking a Broader Lens to the Dialogue between Products and Culture

March 25, 2024

John Devanney

"Incremental improvements and disruptive innovation require very different methods and measures."

John Devanney

The Design Management Office

November 6, 2017

Katy Mogal

"If they don’t give you a seat at the table, bring a folding chair."

Katy Mogal

But Do Your Insights Scale?

March 12, 2021