Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

How Your Organization's Generative Workshops Are Probably Going Wrong and How to Get Them Right
Gold
Tuesday, March 28, 2023 • Advancing Research 2023
Share the love for this talk
How Your Organization's Generative Workshops Are Probably Going Wrong and How to Get Them Right
Speakers: Anne Mamaghani
Link:

Summary

Generative workshops are a critical generative component of any product development process. But in my 20+ years conducting product user research, I have seen more product harm come from so-called "workshops" or "design sprints" than good. In this tutorial, I will share more about my experience and what I've found are critical components of generative workshops -- whether they last five hours or five days. Contrary to popular belief, a design sprint is a highly structured and carefully designed series of exercises, not a brainstorm, design jam or free-for-all. The whole point is to drive a cross-functional team to the right outcome, and this requires a set of structured exercises which weave the thread of user needs, behaviors and attitudes throughout. This involves more than reviewing the research at the start and then moving on to create without that research in context. A true design sprint takes us from user insights -- even broad user insights -- to user-evaluated concepts or designs. The generative phase of a product is deeply impactful, and design sprints are a fantastic tool for driving this needed impact. However, many are practicing brainstorms or design jams rather than true design sprints. One can make a mismatched concept extremely usable throughout the product development process, but that will not remedy the fact that it is not the right concept. Researchers are ideal design sprint organizers and facilitators, but researchers are sometimes not even considered a critical component of the sprint. It's important for knowledgeable researchers to drive design sprint impact.

Key Insights

  • Design sprints and workshops are tactical methods that must reflect human needs, behaviors, and attitudes to produce successful concepts.

  • Sprint as theater, where workshops are held for appearances only, is a fundamental mistake that can do more harm than good.

  • Workshops lacking structure often result in brainstorm-like concepts that don't reliably address research data.

  • Not conducting or integrating research at the start or end of sprints reduces concept resonance but can be recovered post-workshop.

  • Excluding key stakeholders and decision-makers risks surprise blockers and misunderstanding after workshops.

  • Facilitation is a skill that requires training; untrained facilitators may struggle to manage group dynamics and keep workshops effective.

  • Over-scaling back workshops due to time or resource pressures can render workshops ineffective if critical exercises are omitted.

  • Clearly communicating the quality and outcomes of workshops to stakeholders helps build understanding and buy-in.

  • Training a small group of facilitators can be done effectively by incremental, practical, and open dialogue-based coaching.

  • Ensuring equal participation includes preparing participants on collaboration tools and explicitly fostering inclusive conversation dynamics.

Notable Quotes

"If you think of a design Sprint as something designed to take human needs, behaviors, and attitudes through to develop a concept that represents them, the outcome is completely different when done effectively versus ineffectively."

"Sprint as theater is typically initiated by non-researchers or cross-functional leaders, and it’s not going to result in a concept effectively representing human needs."

"A lack of structured exercises often causes groups to rely on brainstorms that may not reflect the upfront human-centered data."

"You can recover from lack of research by doing follow-up studies post-workshop to ground concepts."

"When key decision makers are excluded, surprise blockers appear because they don’t understand how decisions were made."

"Facilitation takes real practice. It’s a skill I had to develop, and untrained facilitators may struggle to manage personalities and keep energy balanced."

"Scaling back too much can render a workshop ineffective; knowing which exercises are fundamental is key."

"I believe facilitating generative research is a core skill for UX researchers, especially in early-stage or innovative contexts."

"To ensure equal participation, it’s important to get everyone comfortable with tools like Miro and set clear, participatory rules of engagement."

"Getting to know what stakeholders care about and aligning workshops to help achieve those goals is crucial to gaining their support."

Ask the Rosenbot
Magdalena Zadara
Zero Hour: How to Get Far Quickly When Starting Your Digital Service Unit Late
2022 • Civic Design 2022
Gold
Iram Shah
Closing Keynote: The View from the Top
2019 • Enterprise Experience 2019
Gold
Soma Ghosh
What emerging methods are advancing UX research [Advancing Research Community Workshop Series] (Videoconference)
2023 • Advancing Research Community
Bria Alexander
Opening Remarks
2021 • DesignOps Summit 2021
Gold
Dominique Ward
The Most Exciting Time for DesignOps is Now
2022 • DesignOps Summit 2022
Gold
Marc Fonteijn
First Insights from the 2025 Service Design Salary(+) Report
2024 • Advancing Service Design 2024
Gold
Clemens Janssen
Efficiently Scaling Research as a Team of One
2023 • Advancing Research 2023
Gold
Dan Willis
Enterprise Storytelling Sessions
2015 • Enterprise UX 2015
Gold
Sam Proulx
Accessibility: An Opportunity to Innovate
2022 • DesignOps Summit 2022
Gold
Greg Petroff
Software as Material—A Redux
2023 • Enterprise UX 2023
Gold
Patrick Commarford
Design Staffing for Impact
2024 • DesignOps Summit 2020
Gold
Michele Marut
Research Repositories Reconsidered (Videoconference)
2019 • DesignOps Community
Paul Pangaro, PhD
Systems Disciplines: Table Stakes for 21st Century Organizations
2023 • Enterprise UX 2023
Gold
Ignacio Martinez
Fair and Effective Designer Evaluation
2024 • DesignOps 2024
Gold
Bria Alexander
Opening Remarks
2023 • DesignOps Summit 2023
Gold
Discussion
2017 • Enterprise Experience 2017
Gold

More Videos

Alex Hurworth

"Policies must evolve to reflect the urgency of our situation."

Alex Hurworth Bonnie John Fahd Arshad Antoine Marin

Designing a Contact Tracing App for Universal Access

October 23, 2020

Laine Riley Prokay

"We started to ask ourselves, does every new Design Ops practitioner need 10 years of experience like Lisa and I? What opportunities are we missing by not having more junior roles?"

Laine Riley Prokay Lisa Gordon

Carving a Path for Early Career DesignOps Practitioners

September 9, 2022

Eniola Oluwole

"People were very adverse to changes because a small 0.5% conversion increase meant millions in revenue."

Eniola Oluwole

Lessons From the DesignOps Journey of the World's Largest Travel Site

October 24, 2019

Nathan Shedroff

"Design researchers know customers better than almost anyone else in the organization, yet they are rarely invited into strategy processes."

Nathan Shedroff

Double Your Mileage: Use Your Research Strategically

March 31, 2020

Sam Proulx

"Mobile devices not only have built-in screen readers but also pitch-to-zoom and magnification settings out of the box."

Sam Proulx

Mobile Accessibility: Why Moving Accessibility Beyond the Desktop is Critical in a Mobile-first World

November 17, 2022

Feleesha Sterling

"Choosing the right cadence depends on your team’s resources and maturity—some do it every two weeks, others monthly."

Feleesha Sterling

Building a Rapid Research Program (Videoconference)

May 18, 2023

Neil Barrie

"Culture is the most influential factor impacting people's perceptions and values today."

Neil Barrie

Widening the Aperture: The Case for Taking a Broader Lens to the Dialogue between Products and Culture

March 25, 2024

John Devanney

"A well framed project is a rare thing — it’s also a creative exercise that unleashes teams’ possibilities."

John Devanney

The Design Management Office

November 6, 2017

Katy Mogal

"If they don’t give you a seat at the table, bring a folding chair."

Katy Mogal

But Do Your Insights Scale?

March 12, 2021