Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

How Your Organization's Generative Workshops Are Probably Going Wrong and How to Get Them Right
Gold
Tuesday, March 28, 2023 • Advancing Research 2023
Share the love for this talk
How Your Organization's Generative Workshops Are Probably Going Wrong and How to Get Them Right
Speakers: Anne Mamaghani
Link:

Summary

Generative workshops are a critical generative component of any product development process. But in my 20+ years conducting product user research, I have seen more product harm come from so-called "workshops" or "design sprints" than good. In this tutorial, I will share more about my experience and what I've found are critical components of generative workshops -- whether they last five hours or five days. Contrary to popular belief, a design sprint is a highly structured and carefully designed series of exercises, not a brainstorm, design jam or free-for-all. The whole point is to drive a cross-functional team to the right outcome, and this requires a set of structured exercises which weave the thread of user needs, behaviors and attitudes throughout. This involves more than reviewing the research at the start and then moving on to create without that research in context. A true design sprint takes us from user insights -- even broad user insights -- to user-evaluated concepts or designs. The generative phase of a product is deeply impactful, and design sprints are a fantastic tool for driving this needed impact. However, many are practicing brainstorms or design jams rather than true design sprints. One can make a mismatched concept extremely usable throughout the product development process, but that will not remedy the fact that it is not the right concept. Researchers are ideal design sprint organizers and facilitators, but researchers are sometimes not even considered a critical component of the sprint. It's important for knowledgeable researchers to drive design sprint impact.

Key Insights

  • Design sprints and workshops are tactical methods that must reflect human needs, behaviors, and attitudes to produce successful concepts.

  • Sprint as theater, where workshops are held for appearances only, is a fundamental mistake that can do more harm than good.

  • Workshops lacking structure often result in brainstorm-like concepts that don't reliably address research data.

  • Not conducting or integrating research at the start or end of sprints reduces concept resonance but can be recovered post-workshop.

  • Excluding key stakeholders and decision-makers risks surprise blockers and misunderstanding after workshops.

  • Facilitation is a skill that requires training; untrained facilitators may struggle to manage group dynamics and keep workshops effective.

  • Over-scaling back workshops due to time or resource pressures can render workshops ineffective if critical exercises are omitted.

  • Clearly communicating the quality and outcomes of workshops to stakeholders helps build understanding and buy-in.

  • Training a small group of facilitators can be done effectively by incremental, practical, and open dialogue-based coaching.

  • Ensuring equal participation includes preparing participants on collaboration tools and explicitly fostering inclusive conversation dynamics.

Notable Quotes

"If you think of a design Sprint as something designed to take human needs, behaviors, and attitudes through to develop a concept that represents them, the outcome is completely different when done effectively versus ineffectively."

"Sprint as theater is typically initiated by non-researchers or cross-functional leaders, and it’s not going to result in a concept effectively representing human needs."

"A lack of structured exercises often causes groups to rely on brainstorms that may not reflect the upfront human-centered data."

"You can recover from lack of research by doing follow-up studies post-workshop to ground concepts."

"When key decision makers are excluded, surprise blockers appear because they don’t understand how decisions were made."

"Facilitation takes real practice. It’s a skill I had to develop, and untrained facilitators may struggle to manage personalities and keep energy balanced."

"Scaling back too much can render a workshop ineffective; knowing which exercises are fundamental is key."

"I believe facilitating generative research is a core skill for UX researchers, especially in early-stage or innovative contexts."

"To ensure equal participation, it’s important to get everyone comfortable with tools like Miro and set clear, participatory rules of engagement."

"Getting to know what stakeholders care about and aligning workshops to help achieve those goals is crucial to gaining their support."

Ask the Rosenbot
Maish Nichani
Sparking a Service Excellence Mindset at a Government Agency
2021 • Civic Design 2021
Gold
Joel Branch
Humanizing AI: Filling the Gaps with Multi-faceted Research
2021 • Advancing Research 2021
Gold
Sarah Alvarado
How to make UX research leadership more effective [Advancing Research Community Workshop Series] (Videoconference)
2023 • Advancing Research Community
Laureen Kattan
Centering Patients and Clinicians in a Complex Government Ecosystem
2023 • Design in Product 2023
Gold
Megan Blocker
Getting to the “So What?”: How Management Consulting Practices Can Transform Your Approach to Research
2024 • Advancing Research 2024
Gold
Bria Alexander
State of DesignOps Panel
2021 • DesignOps Summit 2021
Gold
Jennifer Kanyamibwa
Creating the Blueprint: Growing and Building Design Teams
2018 • DesignOps Summit 2018
Gold
Sam Proulx
Understanding Screen Readers on Mobile: How And Why to Learn from Native Users
2023 • Enterprise UX 2023
Gold
Michelle Morrison
Culture Design (Videoconference)
2020 • DesignOps Community
Bob Baxley
Leading with Design Operations Past and Present (Videoconference)
2019 • DesignOps Community
Cennydd Bowles
Day 1 Panel
2024 • Designing with AI 2024
Gold
Miles Orkin
Creativity and Culture
2018 • DesignOps Summit 2018
Gold
Dr. Jamika D. Burge
A Genuine Conversation about the Future of UX Research (Videoconference)
2024 • Advancing Research Community
Patrizia Bertini
Pushing DesignOps’ Influence into New Global Markets
2022 • DesignOps Summit 2022
Gold
Chris Hammond
Embedding sustainability into enterprise design and development: A journey towards "sustainability consciousness"
2025 • Climate UX Interest Group (Rosenfeld Community)
Laine Riley Prokay
How DesignOps can Drive Inclusive Career Ladders for All
2021 • DesignOps Summit 2021
Gold

More Videos

Adam Cutler

"A good story that people can retell is key for global communication, even if it distorts a bit."

Adam Cutler Karen Pascoe Ian Swinson Susan Worthman

Discussion

June 8, 2016

Peter Merholz

"Playing politics in UX leadership is about maximizing relationships ethically to advance your agenda, not about being underhanded."

Peter Merholz

The Trials and Tribulations of Directors of UX (Videoconference)

July 13, 2023

Lisa Welchman

"Everything that has been put online, someone like us made and put there; we bake our own biases into it."

Lisa Welchman

Cleaning Up Our Mess: Digital Governance for Designers

June 14, 2018

Vincent Brathwaite

"The time for action is now, and it must be collaborative."

Vincent Brathwaite

Opener: Past, Present, and Future—Closing the Racial Divide in Design Teams

October 22, 2020

Brenna Fallon

"OKRs are a tool for each of us to tidy our house and focus on what’s important."

Brenna Fallon

Learning Over Outcomes

October 24, 2019

Tricia Wang

"It’s human infrastructure—community organizing, unions, activists—that saves the day when other infrastructures break down."

Tricia Wang

Spatial Collapse: Designing for Emergent Culture

January 8, 2024

Edgar Anzaldua Moreno

"If you don’t bring stakeholders into the research journey, they won’t believe or use the data."

Edgar Anzaldua Moreno

Using Research to Determine Unique Value Proposition

March 11, 2021

"Leadership buy-in is really important—having an executive who understands the value of knowledge creation, distribution, application, and evaluation."

Designing Systems at Scale

November 7, 2018

Erin Weigel

"Conversion design means to create intentional change."

Erin Weigel

Get Your Whole Team Testing to Design for Impact

July 24, 2024