Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

How Your Organization's Generative Workshops Are Probably Going Wrong and How to Get Them Right
Gold
Tuesday, March 28, 2023 • Advancing Research 2023
Share the love for this talk
How Your Organization's Generative Workshops Are Probably Going Wrong and How to Get Them Right
Speakers: Anne Mamaghani
Link:

Summary

Generative workshops are a critical generative component of any product development process. But in my 20+ years conducting product user research, I have seen more product harm come from so-called "workshops" or "design sprints" than good. In this tutorial, I will share more about my experience and what I've found are critical components of generative workshops -- whether they last five hours or five days. Contrary to popular belief, a design sprint is a highly structured and carefully designed series of exercises, not a brainstorm, design jam or free-for-all. The whole point is to drive a cross-functional team to the right outcome, and this requires a set of structured exercises which weave the thread of user needs, behaviors and attitudes throughout. This involves more than reviewing the research at the start and then moving on to create without that research in context. A true design sprint takes us from user insights -- even broad user insights -- to user-evaluated concepts or designs. The generative phase of a product is deeply impactful, and design sprints are a fantastic tool for driving this needed impact. However, many are practicing brainstorms or design jams rather than true design sprints. One can make a mismatched concept extremely usable throughout the product development process, but that will not remedy the fact that it is not the right concept. Researchers are ideal design sprint organizers and facilitators, but researchers are sometimes not even considered a critical component of the sprint. It's important for knowledgeable researchers to drive design sprint impact.

Key Insights

  • Design sprints and workshops are tactical methods that must reflect human needs, behaviors, and attitudes to produce successful concepts.

  • Sprint as theater, where workshops are held for appearances only, is a fundamental mistake that can do more harm than good.

  • Workshops lacking structure often result in brainstorm-like concepts that don't reliably address research data.

  • Not conducting or integrating research at the start or end of sprints reduces concept resonance but can be recovered post-workshop.

  • Excluding key stakeholders and decision-makers risks surprise blockers and misunderstanding after workshops.

  • Facilitation is a skill that requires training; untrained facilitators may struggle to manage group dynamics and keep workshops effective.

  • Over-scaling back workshops due to time or resource pressures can render workshops ineffective if critical exercises are omitted.

  • Clearly communicating the quality and outcomes of workshops to stakeholders helps build understanding and buy-in.

  • Training a small group of facilitators can be done effectively by incremental, practical, and open dialogue-based coaching.

  • Ensuring equal participation includes preparing participants on collaboration tools and explicitly fostering inclusive conversation dynamics.

Notable Quotes

"If you think of a design Sprint as something designed to take human needs, behaviors, and attitudes through to develop a concept that represents them, the outcome is completely different when done effectively versus ineffectively."

"Sprint as theater is typically initiated by non-researchers or cross-functional leaders, and it’s not going to result in a concept effectively representing human needs."

"A lack of structured exercises often causes groups to rely on brainstorms that may not reflect the upfront human-centered data."

"You can recover from lack of research by doing follow-up studies post-workshop to ground concepts."

"When key decision makers are excluded, surprise blockers appear because they don’t understand how decisions were made."

"Facilitation takes real practice. It’s a skill I had to develop, and untrained facilitators may struggle to manage personalities and keep energy balanced."

"Scaling back too much can render a workshop ineffective; knowing which exercises are fundamental is key."

"I believe facilitating generative research is a core skill for UX researchers, especially in early-stage or innovative contexts."

"To ensure equal participation, it’s important to get everyone comfortable with tools like Miro and set clear, participatory rules of engagement."

"Getting to know what stakeholders care about and aligning workshops to help achieve those goals is crucial to gaining their support."

Ask the Rosenbot
Joseph Meersman
Sweating the Pixel: Scaling Quality through Critique
2021 • Design at Scale 2021
Gold
Jennifer Kong
[Case study] Journeying toward AI-assisted documentation in healthcare
2024 • Designing with AI 2024
Gold
Prayag Narula
Empowering Designers to do Good Research
2022 • Advancing Research 2022
Gold
Kate Kalcevich
Integrating Accessibility in DesignOps
2024 • DesignOps 2024
Gold
Lona Moore
Scaling Design Beyond Designers
2021 • Design at Scale 2021
Gold
Jon Fukuda
The Big Question about Innovation: A Panel Discussion
2024 • DesignOps 2024
Gold
Alla Weinberg
Healing Toxic Stress
2024 • DesignOps 2024
Gold
Roberta Dombrowski
5 Reasons to Bring your Recruiting in House
2021 • DesignOps Summit 2021
Gold
Michelle Bejian Lotia
Rolling Out a Repository: How Zapier Centralizes Insights from Across their Organization
2023 • Advancing Research 2023
Gold
Bria Alexander
Opening Remarks
2022 • Civic Design 2022
Gold
Yoel Sumitro
Actions and Reflections: Bridging the Skills Gap among Researchers
2022 • Advancing Research 2022
Gold
Bria Alexander
Theme Two Intro
2022 • DesignOps Summit 2022
Gold
Roy Opata Olende
How Zapier Uses ‘All Hands Research’ to Increase Exposure to Users (Videoconference)
2020 • Advancing Research Community
Andrew Michael
Building a Product Insights Team
2022 • Advancing Research 2022
Gold
Kavana Ramesh
Meaningful inclusion: Practicing accessibility research with confidence
2024 • DesignOps 2024
Gold
Kim Fellman Cohen
Measuring the Designer Experience
2019 • DesignOps Summit 2019
Gold

More Videos

Verónica Urzúa

"This ideology acts normalizing what the correct way of doing UX research looks like, while eliminating other possible ways."

Verónica Urzúa Jorge Montiel

The B-side of the Research Impact

March 12, 2021

Michal Anne Rogondino

"This year it became a mandate for all companies to use the Astro design system on new SMC contracts."

Michal Anne Rogondino

Saving Outer Space: The First UX Design System for Our Nation’s Satellites

January 8, 2024

Jemma Ahmed

"Folks were looking at 2020 with renewed commitment and bravery to do things differently despite the knocks."

Jemma Ahmed

Theme 2 Intro

March 10, 2022

Kara Kane

"I’ve worked with international counterparts, sharing and learning through 30 international calls with designers around the world."

Kara Kane

Theme One Intro

November 16, 2022

Laine Riley Prokay

"We had to ensure that many voices contributed because I could not be the only one making org-wide changes."

Laine Riley Prokay

How DesignOps can Drive Inclusive Career Ladders for All

September 30, 2021

Laura Gatewood

"You can have the greatest idea in the world, but if you can't connect with other people, nothing will come of it."

Laura Gatewood Laine Prokay

Beyond Buzzwords: Adding Heart to Effective Slack Communication

September 23, 2024

Caitlyn Hampton

"Our agents are so honest and brutal with feedback, which I love because we don’t have to pull the truth out of them."

Caitlyn Hampton Monica Lee Jina Yoon

Compass 101: Growing Your Career In A Startup World

June 11, 2021

Hana Nagel

"First-hand engagement with UX research is what convinces product owners it doesn’t slow down development but actually speeds it up."

Hana Nagel

Turning Research Ripples into Waves

November 8, 2018

Alexandra Schmidt

"We’re often in the position of making a piece of technology work without a clearly defined problem first."

Alexandra Schmidt

Enterprise UX Playbook (Videoconference)

December 1, 2022