Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

How to Coach Enterprise Experimentation

Gold
Thursday, May 14, 2015 • Enterprise UX 2015
Share the love for this talk
How to Coach Enterprise Experimentation
Speakers: Alissa Briggs
Link:

Summary

In this talk, Alyssa Briggs shares her experience coaching enterprise experimentation, emphasizing that experimentation is a mindset for problem-solving by validating assumptions through small, fast tests. She highlights that executives often support experimentation in theory but struggle to embed it into daily work. Using Intuit as a case study, Briggs illustrates how simply training and embedding experiment coaches within teams transformed the company’s culture, enabling tens of thousands of experiments annually that generate millions in revenue. She describes three essential practices for experiment coaches: collaboratively planning experiments using an experiment grid, helping teams embrace and learn from failures by facing data honestly and conducting quick customer research, and catalyzing organizational change by spreading the coaching role and uncovering new opportunities for experimentation beyond product design. Briggs walks the audience through a live experiment about a name memory trick to demonstrate how to develop hypotheses and validate assumptions quickly. She also recounts a story where a small sales experiment disproved executives’ skepticism about a new product tier, leading to significant business impact and wider cultural adoption of experimentation. Briggs encourages everyone to adopt the experiment coaching mindset and start running small experiments to shift team behaviors and company culture.

Key Insights

  • Embedding experiment coaches within existing teams is key to sustaining a culture of experimentation.

  • Experimentation thrives on embracing small failures to avoid costly large ones.

  • Executives often support experimentation top-down, but real change happens when coaches integrate experiments into daily workflows.

  • The experiment grid is a powerful yet simple tool for collaboratively planning experiments by unpacking assumptions and defining testable hypotheses.

  • Most teams fail their first experiment, and coaches must help them face the data and learn rather than become discouraged.

  • Quick, informal customer research after an experiment helps uncover root causes and increases team engagement.

  • Consistently planning follow-up experiments builds momentum and prevents the 'one-and-done' pitfall.

  • Experiment coaching is not a full-time role but can be integrated as 10-20% of a team member’s responsibilities.

  • Experiments can test not just products but internal processes and business assumptions, unlocking broader innovation.

  • Demonstrating successful experiments with quantitative data can transform executive skepticism into enthusiastic support, driving significant business impact.

Notable Quotes

"If you’re afraid of failure, that’s okay. With experimentation, you’re going to fail—but in little tiny ways that don’t really matter."

"Executives get experimentation but often it doesn’t stick when people go back to their normal teams."

"The simple thing that worked at Intuit was training and embedding experiment coaches in teams."

"An experiment coach spends about 10 to 20 percent of their time helping the team change mindsets and actions."

"The most important tool is not for running experiments, but for planning them—the experiment grid."

"If we do X, then Y percent of people will do Z—that’s how you frame hypotheses to learn from both success and failure."

"It’s better to run lots of quick, cheap experiments to remove doubt than to wait for the perfect, statistically significant test."

"Nine out of ten teams fail their first experiment, which is normal but can be demoralizing."

"Helping your team face the data honestly and then diving into customer conversations helps uncover what went wrong."

"You know you’ve succeeded as a coach when you put yourself out of a job by giving away the role."

Ask the Rosenbot
Patrizia Bertini
The (r)evolution of designOps: It’s Time to Think (really) BIG
2025 • DesignOps Summit 2025
Gold
Amy Thibodeau
Opening Keynote: Process and Ambiguity
2019 • DesignOps Summit 2019
Gold
Megan Blocker
Getting to the “So What?”: How Management Consulting Practices Can Transform Your Approach to Research
2024 • Advancing Research 2024
Gold
Julie Baher
Culture Change—My Journey
2015 • Enterprise UX 2015
Gold
Audrey Crane
Shadow Design–Where Else is Design Happening in Your Organization?
2023 • Enterprise Community
Victor Udoewa
Beyond Methods and Diversity: The Roots of Inclusion
2024 • Advancing Research 2024
Gold
Dan Willis
Enterprise Storytelling Sessions
2016 • Enterprise UX 2016
Gold
Bria Alexander
Opening Remarks
2022 • Civic Design 2022
Gold
Mark Interrante
Collaboration Flows in Product Development
2017 • Enterprise Experience 2017
Gold
Dr. Jamika D. Burge
Theme 3 Intro
2022 • Advancing Research 2022
Gold
Bria Alexander
Day 3 Welcome
2024 • DesignOps Summit 2024
Gold
Taylor Klassman
Shaping the Next Era of UX Research: Collaborative Forum
2025 • Advancing Research 2025
Gold
Bria Alexander
Opening Remarks
2021 • Design at Scale 2021
Gold
Dolly Parikh
Exit Interview #7: Journey of a Social Entrepreneur
2026 • Rosenfeld Community
George Zhang
UX Research Excellence Framework
2021 • Advancing Research 2021
Gold
Louis Rosenfeld
The Rosenbot and the Rosenverse: An AMA with Lou Rosenfeld
2024 • Designing with AI 2024
Gold

More Videos

John Cutler

"Sometimes leaders focus so much on scanning the river they’re not observing the surroundings—the banks tell you if the river is deep or shallow."

John Cutler

Oxbows, Rivers, and Estuaries: How to navigate the currents of change (without burning out)

December 3, 2024

Darian Davis

"Taking responsibility for our behaviors starts with an apology and continues with regular feedback and action."

Darian Davis

Lessons from a Toxic Work Relationship

January 8, 2024

Dave Gray

"If you’re having more conversation about what the actual question means than answering it, that’s a problem with the canvas we need to fix."

Dave Gray

Group Activity: Making Sense of DesignOps

November 7, 2017

John Cutler

"These aren't linear; every circle or box has multiple lines into it—our work does not fit neatly into trees or pyramids."

John Cutler

The Alignment Trap

November 29, 2023

Abby Covert

"When was the last time that you felt stuck? The one where you feel a sense of being stuck trying to understand something."

Abby Covert

Stuck? Diagrams Help

October 27, 2022

Mark Interrante

"Small micro changes every week add up — ask your team what tiny improvements they’ve made recently."

Mark Interrante

Collaboration Flows in Product Development

June 9, 2017

Devon Powers

"We can’t just think technology or innovation will solve our problems; we have to embrace and work with those problems."

Devon Powers

Imagining Better Futures

March 9, 2022

Prayag Narula

"Researchers want designers to help them with the research because there aren’t enough researchers in the world."

Prayag Narula

How to Empower Your Designers to Do Good Research – And Why You Want To

June 10, 2022

Peter Van Dijck

"You can’t just be a designer adapting UX workflows assuming everybody else’s workflow stays the same; everything is changing with AI."

Peter Van Dijck

Hands on AI #3: Claude Code for UX people

October 22, 2025