Rosenverse
How Your Organization's Generative Workshops Are Probably Going Wrong and How to Get Them Right

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

How Your Organization's Generative Workshops Are Probably Going Wrong and How to Get Them Right

Gold
Tuesday, March 28, 2023 • Advancing Research 2023
Share the love for this talk
How Your Organization's Generative Workshops Are Probably Going Wrong and How to Get Them Right
Speakers: Anne Mamaghani
Link:

Summary

Generative workshops are a critical generative component of any product development process. But in my 20+ years conducting product user research, I have seen more product harm come from so-called "workshops" or "design sprints" than good. In this tutorial, I will share more about my experience and what I've found are critical components of generative workshops -- whether they last five hours or five days. Contrary to popular belief, a design sprint is a highly structured and carefully designed series of exercises, not a brainstorm, design jam or free-for-all. The whole point is to drive a cross-functional team to the right outcome, and this requires a set of structured exercises which weave the thread of user needs, behaviors and attitudes throughout. This involves more than reviewing the research at the start and then moving on to create without that research in context. A true design sprint takes us from user insights -- even broad user insights -- to user-evaluated concepts or designs. The generative phase of a product is deeply impactful, and design sprints are a fantastic tool for driving this needed impact. However, many are practicing brainstorms or design jams rather than true design sprints. One can make a mismatched concept extremely usable throughout the product development process, but that will not remedy the fact that it is not the right concept. Researchers are ideal design sprint organizers and facilitators, but researchers are sometimes not even considered a critical component of the sprint. It's important for knowledgeable researchers to drive design sprint impact.

Key Insights

  • Many generative workshops fail due to fundamental mistakes more often than they succeed.

  • The 'Sprint as theater' mistake occurs when workshops are done for appearances or political reasons rather than genuine product development.

  • Well-structured workshops with specific exercises are crucial to move from research data to human-centered product concepts.

  • Integrating research both before and after a workshop grounds concepts in real human needs and allows recovery if initial research is missing.

  • Excluding key decision-makers leads to surprise blockers after workshops and risks misalignment with product goals.

  • Facilitation is a distinct, practiced skill essential to managing group dynamics, pacing, and adapting exercises during workshops.

  • Scaling back workshops too much compromises their effectiveness and the quality of resulting concepts.

  • Explicit communication about workshop outcomes and quality is necessary to help stakeholders appreciate the method's value.

  • Training facilitators in focused, incremental sessions delivers practical skills necessary for leading effective workshops.

  • Ensuring equal participation requires setting clear engagement rules and providing tool training to accommodate varying skill levels.

Notable Quotes

"The outcome of this method really makes the difference between lightning and a lightning bug."

"Sprint as theater is not going to result in a product concept that really represents human needs, behaviors, and attitudes."

"If there is no structured way to move from data to concept, you often end up with just a brainstorm, not a grounded concept."

"Lack of research before or after the workshop can be recovered from but at some cost to the concept’s validity."

"Excluding key people might save time but it often leads to surprise blockers and misaligned decisions later on."

"Facilitation is a skill that takes real practice; it’s about managing personalities, stamina, and knowing when to adapt exercises."

"There is a point where scaling back a workshop too much will make it ineffective and that trade-off must be explicit."

"Many stakeholders don’t inherently understand the difference in quality outcomes from workshops, so we must be explicit."

"Getting to know what people care about in the organization helps tailor workshops to support those goals and gain buy-in."

"It’s important to create a sincere environment where everyone feels they can equally participate, regardless of title or skill level."

Ask the Rosenbot
Nick Lewis
Designing and building low-carbon websites independently
2025 • Climate UX Interest Group
Louis Rosenfeld
Day 1 Welcome
2024 • DesignOps Summit 2024
Gold
Jennifer Fraser
What would Emmy Noether Do? Math, Models and Mulling in UX Research
2023 • Advancing Research 2023
Gold
Kristin Skinner
Group Activity: A Deep Dive Into Value and Outcomes
2019 • DesignOps Summit 2019
Gold
Farid Sabitov
Theme Four Intro
2022 • DesignOps Summit 2022
Gold
Trisha Causley
[Demo] Complexity in disguise: Crafting experiences for generative AI features
2024 • Designing with AI 2024
Gold
Jonathon Colman
How to Maximize the Impact of Content Design
2024 • DesignOps Summit 2020
Gold
Bria Alexander
Opening Remarks
2021 • Design at Scale 2021
Gold
Erin Hoffman-John
This Game is Never Done: Design Leadership Techniques from the Video Game World
2017 • DesignOps Summit 2017
Gold
Saara Kamppari-Miller
Cartography for Design Communities
2025 • DesignOps Summit 2025
Gold
Meghan Bausone
Systems Thinking and Design Innovation: Working with Leverage Points in Rural Maternal Health Systems
2026 • Rosenfeld Community
Patrick Commarford
Design Staffing for Impact
2024 • DesignOps Summit 2020
Gold
Luca Rager
Empowering Gaming at Scale: How Xbox Builds Powerful, Automated, and Distributed Design Systems with Sketch
2021 • DesignOps Summit 2021
Gold
Wendy Johansson
An Education on Design Education for Orgs
2021 • Design at Scale 2021
Gold
Theresa Slate
Why Changing Hearts & Minds Doesn’t Work When Promoting DE&I Efforts, but Checklists Do
2023 • DesignOps Summit 2023
Gold
Kit Unger
Theme 2: Introduction
2021 • Design at Scale 2021
Gold

More Videos

Iain McMaster

"If you’re not embarrassed by what you share, you’ll share too late."

Iain McMaster IHan Cheng

Design and Product: from Frenemy to Harmony

November 29, 2023

Bria Alexander

"An OKR coach told us to think of OKRs like a health panel at a physical—you have KPIs for status and OKRs for change targets."

Bria Alexander Benson Low Natalya Pemberton Stephanie Goldthorpe

OKRs—Helpful or Harmful?

January 20, 2022

Nidhi Singh Rathore

"Participatory sessions provide a unique chance to connect with users who might otherwise be hard to reach."

Nidhi Singh Rathore Amber Davis

Embracing participation to unlock deeper truths in commercial research

March 12, 2025

Prayag Narula

"Researchers often treat users as checkboxes, going in, doing research, checking the box and leaving."

Prayag Narula Rida Qadri

HCI 2.0: Humanity Deserves the Attention that UX Research has to Offer

March 28, 2023

Dan Willis

"The only time you get to build design ops at the same time as the organization structure is like in startups, but they’re so chaotic you don’t get to enjoy it."

Dan Willis

Filling the Void

November 7, 2018

Robert Fabricant

"This is probably the biggest change we are going to see within our working careers."

Robert Fabricant Sahibzada Mayed Nidhi Singh Rathore

Industry junctures: Paths forwards for UXR and the critical decisions that get us there [Advancing Research Community Workshop Series]

October 2, 2024

Cara Maritz

"Starting a repository for your existing data, however simple, is critical to enable efficient secondary research."

Cara Maritz Rachel Ny

The Art of Extrapolation

March 29, 2023

Yasmine Khan

"Paternalistic judgments from lawmakers can be tangibly harmful, leading to lack of funding for basic services and policies."

Yasmine Khan

Checking Bias and Listening to Financially Vulnerable Americans

March 30, 2020

Peter Merholz

"The farther away you are from the CEO or GM, the less happy and healthy your organization tends to be."

Peter Merholz

The 2025 State of UX/Design Organizational Health

November 12, 2025