Rosenverse
IBM User Experience Program—The What, Why and How

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

IBM User Experience Program—The What, Why and How

Friday, October 15, 2021 • Advancing Research Community
Share the love for this talk
IBM User Experience Program—The What, Why and How
Speakers: Tracy McGoldrick
Link:

Summary

How does IBM co-create with our end-users to design products they love? Learn how the IBM Cloud and AI research team created a User Experience Program that formalizes and scales the relationship between our product teams and the end-users. User Experience “Partners,” as we lovingly call them, co-create with our product team to help refine IBM products by providing feedback, ideas, and domain expertise.

Key Insights

  • IBM’s User Experience Program involves long-term partnerships (often 1-2 years) with customers for ongoing, strategic feedback rather than one-off sessions.

  • Customers in the program are called User Experience Partners and do not receive incentives, unlike traditional research participants.

  • Effective recruitment relies heavily on internal stakeholders like sales and account managers to identify and connect with the right customers.

  • Diversity and inclusion remain key priorities; IBM has launched initiatives specifically to recruit partners with diverse abilities and backgrounds.

  • A slender core team led by Tracy manages over 700 active user partners globally, requiring scalable processes and collaboration from multiple program managers.

  • IBM uses a robust, self-service research repository built on Airtable to track participants, research activities, and avoid over-engagement.

  • Communication with partners is highly personalized including quarterly playback meetings where customers discuss roadmaps and past feedback impacts directly with product teams.

  • Legal and data privacy challenges are complex, especially with multinational customers, requiring evergreen feedback agreements and GDPR-compliant consent forms.

  • Measuring program impact ties into IBM’s overall business objectives and benefits from customers advocating for the program internally.

  • The User Experience Program acts like an advisory board, helping IBM anticipate future needs beyond immediate usability issues, fueling innovation.

Notable Quotes

"Yesterday was a prototype – we are continually redesigning around our users’ needs."

"Our user experience partners co-create with product teams to help refine IBM products."

"We don’t promise that every piece of feedback will show up in the product, but we keep partners informed about how their input influences development."

"Recruiting diverse partners takes time and effort, and we are actively building programs to include people with diverse abilities."

"It’s like sending around the Rolls Royce with the champagne bottle – a white glove, concierge service for recruiting partners."

"We have a feedback program agreement that once signed, is evergreen and covers everyone in the customer’s company."

"We’re very careful about PII and only the lead researcher and research ops managers have access to sensitive data."

"Customers in the program become our greatest source of learning and help shape the future of our products."

"Getting internal teams on board is often the biggest challenge, but once they see the value, it lights a fire."

"We don’t need to convince executives of the program’s value – our customers do that for us."

Ask the Rosenbot
Sofia Quintero
The Product Philosophy Behind EnjoyHQ
2021 • Advancing Research 2021
Gold
Nicole Wright
Democratizing Research at HoneyBook
2022 • Advancing Research 2022
Gold
Jemma Ahmed
Collaboration: learning from other fields beyond our own [Advancing Research Community Workshop Series]
2024 • Advancing Research Community
Benjamin Real
Showing the Value of DesignOps by Not Having a DesignOps Team
2020 • DesignOps Summit 2020
Gold
Sohit Karol
Designing Delightful Listening Experiences: Mixed Methods Research in the Age of Machine Learning
2020 • Advancing Research 2020
Gold
Tim Parmee
Changing Our Design Pressure Points
2023 • DesignOps Summit 2023
Gold
Jim Kalbach
Jobs To Be Done
2021 • Enterprise Community
Peter Morville
The Architecture of Understanding
2015 • Enterprise UX 2015
Gold
Cassini Nazir
The Dangers of Empathy: Toward More Responsible Design Research
2023 • Advancing Research 2023
Gold
Bria Alexander
Opening Remarks
2021 • DesignOps Summit 2021
Gold
Prayag Narula
How to Empower Your Designers to Do Good Research – And Why You Want To
2022 • Design at Scale 2022
Gold
Asia Hoe
Partnering with Product: A Journey from Junior to Senior Design
2023 • Design in Product 2023
Gold
John Calhoun
Meters, Miles, and Madness: New Frameworks to Measure the (Elusive) Value of DesignOps
2024 • DesignOps Summit 2024
Gold
Peter Van Dijck
Coffee with Lou #4: Taking a Peek Under the Rosenbot's Hood
2024 • Rosenfeld Community
Lisa Spitz
Building Trust Through Equitable Research Practices
2022 • Civic Design 2022
Gold
Sarah Alvarado
How to make UX research leadership more effective [Advancing Research Community Workshop Series]
2023 • Advancing Research Community

More Videos

Surya Vanka

"Online, our bodies become transparent, reducing barriers and allowing for more intimate and open collaboration."

Surya Vanka

Unleashing Swarm Creativity to Solve Enterprise Challenges

June 10, 2021

Patrick Boehler

"We had precise metrics built on false assumptions, so we had to shift to more contextualized signals."

Patrick Boehler Madison Karas

The service shift: transforming media organizations to create real value through design

November 19, 2025

Andreas Huebner

"I’m most excited to get back in the office because I miss that culture and feeling like I’m working with friends every day."

Andreas Huebner Amy Takata Craig Brookes

What Is It Like To Be Part of The UX Team at Compass?

March 11, 2021

Patrizia Bertini

"The business value of design operations is hidden, unclear, and not even talked about."

Patrizia Bertini Alexandra Mengoni León

Pushing DesignOps’ Influence into New Global Markets

September 9, 2022

Phil Gilbert

"We had an engineering culture that confused uniformity with design, and consistency with design."

Phil Gilbert

A Consistent Culture of Design

May 14, 2015

Yulya Besplemennova

"AI behaves like an alien intern because it’s not capable of making sense of some things easy for us."

Yulya Besplemennova

[Demo] Stress-testing GenAI in user research synthesis

June 4, 2024

Sarah Rink

"We recruited 50% more than we needed because no-shows are incredible in remote sessions."

Sarah Rink

Remote User Research: Dos and Don'ts from the Virtual Field

June 11, 2020

Mujtaba Hameed

"AI can’t yet fully replace bespoke and careful proposal building, though it helps junior researchers draft the first outlines."

Mujtaba Hameed

The new horizon of ethnography: using AI to unlock the full potential of in-person research

March 11, 2026

Sheryl Cababa

"One of the challenges for designers is to orient around forces rather than only people."

Sheryl Cababa

Living in the Clouds: Adopting a Systems Thinking Mindset

June 6, 2023