Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

How Your Organization's Generative Workshops Are Probably Going Wrong and How to Get Them Right
Gold
Tuesday, March 28, 2023 • Advancing Research 2023
Share the love for this talk
How Your Organization's Generative Workshops Are Probably Going Wrong and How to Get Them Right
Speakers: Anne Mamaghani
Link:

Summary

Generative workshops are a critical generative component of any product development process. But in my 20+ years conducting product user research, I have seen more product harm come from so-called "workshops" or "design sprints" than good. In this tutorial, I will share more about my experience and what I've found are critical components of generative workshops -- whether they last five hours or five days. Contrary to popular belief, a design sprint is a highly structured and carefully designed series of exercises, not a brainstorm, design jam or free-for-all. The whole point is to drive a cross-functional team to the right outcome, and this requires a set of structured exercises which weave the thread of user needs, behaviors and attitudes throughout. This involves more than reviewing the research at the start and then moving on to create without that research in context. A true design sprint takes us from user insights -- even broad user insights -- to user-evaluated concepts or designs. The generative phase of a product is deeply impactful, and design sprints are a fantastic tool for driving this needed impact. However, many are practicing brainstorms or design jams rather than true design sprints. One can make a mismatched concept extremely usable throughout the product development process, but that will not remedy the fact that it is not the right concept. Researchers are ideal design sprint organizers and facilitators, but researchers are sometimes not even considered a critical component of the sprint. It's important for knowledgeable researchers to drive design sprint impact.

Key Insights

  • Design sprints and workshops are tactical methods that must reflect human needs, behaviors, and attitudes to produce successful concepts.

  • Sprint as theater, where workshops are held for appearances only, is a fundamental mistake that can do more harm than good.

  • Workshops lacking structure often result in brainstorm-like concepts that don't reliably address research data.

  • Not conducting or integrating research at the start or end of sprints reduces concept resonance but can be recovered post-workshop.

  • Excluding key stakeholders and decision-makers risks surprise blockers and misunderstanding after workshops.

  • Facilitation is a skill that requires training; untrained facilitators may struggle to manage group dynamics and keep workshops effective.

  • Over-scaling back workshops due to time or resource pressures can render workshops ineffective if critical exercises are omitted.

  • Clearly communicating the quality and outcomes of workshops to stakeholders helps build understanding and buy-in.

  • Training a small group of facilitators can be done effectively by incremental, practical, and open dialogue-based coaching.

  • Ensuring equal participation includes preparing participants on collaboration tools and explicitly fostering inclusive conversation dynamics.

Notable Quotes

"If you think of a design Sprint as something designed to take human needs, behaviors, and attitudes through to develop a concept that represents them, the outcome is completely different when done effectively versus ineffectively."

"Sprint as theater is typically initiated by non-researchers or cross-functional leaders, and it’s not going to result in a concept effectively representing human needs."

"A lack of structured exercises often causes groups to rely on brainstorms that may not reflect the upfront human-centered data."

"You can recover from lack of research by doing follow-up studies post-workshop to ground concepts."

"When key decision makers are excluded, surprise blockers appear because they don’t understand how decisions were made."

"Facilitation takes real practice. It’s a skill I had to develop, and untrained facilitators may struggle to manage personalities and keep energy balanced."

"Scaling back too much can render a workshop ineffective; knowing which exercises are fundamental is key."

"I believe facilitating generative research is a core skill for UX researchers, especially in early-stage or innovative contexts."

"To ensure equal participation, it’s important to get everyone comfortable with tools like Miro and set clear, participatory rules of engagement."

"Getting to know what stakeholders care about and aligning workshops to help achieve those goals is crucial to gaining their support."

Ask the Rosenbot
Chris Geison
Theme 1 Intro
2022 • Advancing Research 2022
Gold
Kristin Wisnewski
Measuring What Matters
2019 • DesignOps Summit 2019
Gold
Benjamin Real
Showing the Value of DesignOps by Not Having a DesignOps Team
2020 • DesignOps Summit 2020
Gold
Catherine Dubut
Bridging Physical and Digital Spaces: Approaches to Retail Service Design (Videoconference)
2021 • Enterprise Community
Mackenzie Cockram
Integrating Qualitative and Quantitative Research from Discovery to Live
2022 • QuantQual Interest Group (Rosenfeld Community)
Meredith Black
Building Community and Common Trends to Look for in 2021 (Videoconference)
2020 • DesignOps Community
Lisa Spitz
Building Trust Through Equitable Research Practices
2022 • Civic Design 2022
Gold
Sam Proulx
Accessibility: An Opportunity to Innovate
2022 • DesignOps Summit 2022
Gold
Chris Geison
What is Research Strategy?: A Panel of Research Leaders Discuss this Emergent Question (Videoconference)
2021 • Advancing Research Community
David Cronin
Discussion
2015 • Enterprise UX 2015
Gold
John Calhoun
Meters, Miles, and Madness: New Frameworks to Measure the (Elusive) Value of DesignOps
2024 • DesignOps 2024
Gold
Nova Wehman-Brown
We've Never Done This Before
2019 • Enterprise Experience 2019
Gold
Nick Cochran
Growing in Enterprise Design through Making Connections (Videoconference)
2019 • Enterprise Community
Dave Gray
Liminal Thinking: Sense-making for systems in large organizations
2015 • Enterprise UX 2015
Gold
Rich Mironov
How Can Product Managers and UXers Help Each Other (and Why are Product Folks so Annoying Sometimes)?
2022 • Design in Product 2022
Gold
Jon Fukuda
Theme 3 Intro
2024 • DesignOps 2024
Gold

More Videos

Jennifer Kanyamibwa

"Process can make things scalable and bring folks together in ways that are not even imaginable."

Jennifer Kanyamibwa

Creating the Blueprint: Growing and Building Design Teams

November 8, 2018

Brigette Metzler

"There’s a tension between immediate evaluative research and more durable insights for future use."

Brigette Metzler Dana Chrisfield

Research Repositories: A global project by the ResearchOps Community (Videoconference)

August 27, 2020

Carl Turner

"Project delays are frequently due to organizational and cultural issues rather than actions of the project team."

Carl Turner

You Can Do This: Understand and Solve Organizational Problems to Jumpstart a Dead Project

March 28, 2023

John Mortimer

"Connecting dots goes beyond just linking user experience; it’s about engagement with the organizational system."

John Mortimer Milan Guenther Lucy Ellis Patrick Quattlebaum

Panel Discussion

December 3, 2024

Dante Guintu

"Fifty percent of our designers were already active in coaching or mentoring, yet there was a call for a different mentorship flavor."

Dante Guintu

How to Crush the Talent Crunch

September 8, 2022

Richard Buchanan

"The new marketing is about preparing users or customers for the new kinds of products that will emerge as time moves forward."

Richard Buchanan

Creativity and Principles in the Flourishing Enterprise

June 15, 2018

Dan Willis

"Shemus Bern is going to talk about how you drop into a client site and grok what’s going on without losing why they hired you."

Dan Willis

Theme 3: Intro

January 8, 2024

Dan Ward

"The worst thing that could happen is we get cake — this encourages boldness."

Dan Ward

Failure Friday #1 with Dan Ward

February 7, 2025

Chris Geison

"We don't just need to do a better job of articulating our value. We need to become more valuable."

Chris Geison

Theme Two Intro

March 28, 2023