Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

10k Screens Later: How We Became a Data-Driven Design Organization
Gold
Tuesday, September 24, 2024 • DesignOps 2024
Share the love for this talk
10k Screens Later: How We Became a Data-Driven Design Organization
Speakers: John Paul de Guzman
Link:

Summary

In this session, we'll explore how a small UI design firm (30 headcount) developed a data-driven DesignOps practice. I'll demonstrate how we use automation and robust data pipelines to excel in managing and delivering large volumes of work. This talk also shows how we transform Figma’s comment feature into a powerful tool that integrates seamlessly with Trello, enabling our team to achieve high efficiency and precision, and to track everything in real-time without the usual administrative and logistical challenges. Automation and Custom Tooling: We leverage automation to ensure every process, from capturing to moving work, is streamlined and efficient. This approach helps us tackle the scalability of thousands of work cards without overwhelming our team. Data-Driven with a Soul: This talk addresses concerns around micromanagement and surveillance, illustrating how our methods support consistent delivery (with 95% confidence) without sacrificing the human aspect of our work.

Key Insights

  • Frost Design grew its team from 3 to 21 remote designers during the pandemic, enabling nationwide talent recruitment.

  • Their design ops uses a Kanban continuous delivery model instead of typical two-week sprints to suit volatile project conditions.

  • A custom AI-powered system parses Figma comment commands to automatically create and categorize work cards in Trello.

  • Real-time dashboards built on simple tech (API orchestration, Google Sheets) provide actionable insights to forecast delivery dates with 95% accuracy.

  • Monte Carlo simulations help model delivery probabilities, enabling data-driven project commitments without traditional time estimates.

  • Tracking cycle time across stages uncovers operational bottlenecks, such as labor-intensive refinement causing longer lead times.

  • Data-driven insights allow resource reallocation or training to smooth workloads and better negotiate delivery expectations with clients.

  • Measuring designer productivity combines time spent and output quality, avoiding extremes of overwork or misleading volume metrics.

  • Case studies of designers like Leia and Dawn demonstrate how data supports personalized intervention and eliminates inefficiencies.

  • Culture and human judgment are critical; data is used ethically to elevate talent uniqueness and prevent biases, rather than to surveil or reduce people to metrics.

Notable Quotes

"Designers, marketers—they can be talented or clever but it's not enough to be at the edge of greatness; we have to quantify the value we deliver."

"Our single mandate in design ops is to give designers more design time and remove distractions."

"Tracking and capturing the work can be a whole new work itself. People will abandon complicated processes."

"We found a solution in an odd place—the Figma comment box—where a bot creates cards automatically in 30 seconds."

"No more time-sucking, energy-depleting time estimation game; we use data-driven models for reliable results."

"Spending more time doesn't automatically make you productive; productivity must be measured by output and sustainable practice."

"Running people into the ground is bad for business; we need fair expectations and to support our talents."

"Our system is imperfect, but we embrace continuous 1% improvement every day towards being data-driven and design-driven."

"Behind the numbers are individuals with dreams and hopes, often misunderstood by their families who prefer traditional professions."

"Creating an equitable workplace demands systems and processes that enforce fairness, protect against bias, and reward silent producers."

Ask the Rosenbot
Bria Alexander
Welcome
2022 • DesignOps Summit 2022
Gold
Dr. Jamika D. Burge
Bridge Building across Research Disciplines (Videoconference)
2021 • Advancing Research Community
Samuel Proulx
Designing beyond caricatures: Embracing real, diverse user needs
2024 • Advancing Service Design 2024
Gold
Melinda Belcher
Insider preview of Enterprise Experience 2020 (Videoconference)
2020 • Enterprise Community
Nick Cochran
Growing in Enterprise Design through Making Connections (Videoconference)
2019 • Enterprise Community
Ovetta Sampson
Research in the Automated Future
2022 • Advancing Research 2022
Gold
Bria Alexander
Theme Two Intro
2022 • DesignOps Summit 2022
Gold
Jonathon Colman
How to Maximize the Impact of Content Design
2024 • DesignOps Summit 2020
Gold
Peter Levin
Solve a Problem Here, Transform a Strategy There: Research as an Occasion for Expanding Organizational Possibility
2024 • Advancing Research 2024
Gold
Vicky Teinaki
Short Take #3: UX/Product Lessons from Your Industry Peers
2022 • Design in Product 2022
Gold
Amahra Spence
Designing for Liberation, Rehearsing Freedom
2022 • Civic Design 2022
Gold
Sean Fitzell
Craft of User Research: Building Out Jobs to be Done Maps
2021 • Advancing Research 2021
Gold
Caroline Vize
The State of UX: Five Lessons from 2021 to Accelerate Digital Experience in 2022
2022 • Advancing Research 2022
Gold
Andrea Gallagher
The Problem Space (Videoconference)
2019 • Advancing Research Community
Dominique Ward
The Most Exciting Time for DesignOps is Now
2022 • DesignOps Summit 2022
Gold
Saara Kamppari-Miller
"Prototype" vs "Prototype"--Breaking Down and Rebuilding Our Understanding of What We Do
2019 • DesignOps Summit 2019
Gold

More Videos

Jennifer Kanyamibwa

"I titled my speech a blueprint because it’s a series of lessons I’ve learned throughout my career."

Jennifer Kanyamibwa

Creating the Blueprint: Growing and Building Design Teams

November 8, 2018

Brigette Metzler

"There’s a tension between immediate evaluative research and more durable insights for future use."

Brigette Metzler Dana Chrisfield

Research Repositories: A global project by the ResearchOps Community (Videoconference)

August 27, 2020

Carl Turner

"The project team gradually realized they were in charge of their own process and could get work done."

Carl Turner

You Can Do This: Understand and Solve Organizational Problems to Jumpstart a Dead Project

March 28, 2023

John Mortimer

"We come in like water—hanging out, listening, figuring out where the blood flow is in the environment."

John Mortimer Milan Guenther Lucy Ellis Patrick Quattlebaum

Panel Discussion

December 3, 2024

Dante Guintu

"Gallup says only twelve percent strongly agree their onboarding is great; that’s an abysmal metric."

Dante Guintu

How to Crush the Talent Crunch

September 8, 2022

Richard Buchanan

"The new marketing is about preparing users or customers for the new kinds of products that will emerge as time moves forward."

Richard Buchanan

Creativity and Principles in the Flourishing Enterprise

June 15, 2018

Dan Willis

"Normally the theme leader would be talking about sleep deprivation because we’re overstimulated and excited by the talks."

Dan Willis

Theme 3: Intro

January 8, 2024

Dan Ward

"We do experiments to learn, and if we learn something, then it’s a successful experiment."

Dan Ward

Failure Friday #1 with Dan Ward

February 7, 2025

Chris Geison

"There's no better time to advance research than now."

Chris Geison

Theme Two Intro

March 28, 2023