Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

10k Screens Later: How We Became a Data-Driven Design Organization
Gold
Tuesday, September 24, 2024 • DesignOps 2024
Share the love for this talk
10k Screens Later: How We Became a Data-Driven Design Organization
Speakers: John Paul de Guzman
Link:

Summary

In this session, we'll explore how a small UI design firm (30 headcount) developed a data-driven DesignOps practice. I'll demonstrate how we use automation and robust data pipelines to excel in managing and delivering large volumes of work. This talk also shows how we transform Figma’s comment feature into a powerful tool that integrates seamlessly with Trello, enabling our team to achieve high efficiency and precision, and to track everything in real-time without the usual administrative and logistical challenges. Automation and Custom Tooling: We leverage automation to ensure every process, from capturing to moving work, is streamlined and efficient. This approach helps us tackle the scalability of thousands of work cards without overwhelming our team. Data-Driven with a Soul: This talk addresses concerns around micromanagement and surveillance, illustrating how our methods support consistent delivery (with 95% confidence) without sacrificing the human aspect of our work.

Key Insights

  • Frost Design grew its team from 3 to 21 remote designers during the pandemic, enabling nationwide talent recruitment.

  • Their design ops uses a Kanban continuous delivery model instead of typical two-week sprints to suit volatile project conditions.

  • A custom AI-powered system parses Figma comment commands to automatically create and categorize work cards in Trello.

  • Real-time dashboards built on simple tech (API orchestration, Google Sheets) provide actionable insights to forecast delivery dates with 95% accuracy.

  • Monte Carlo simulations help model delivery probabilities, enabling data-driven project commitments without traditional time estimates.

  • Tracking cycle time across stages uncovers operational bottlenecks, such as labor-intensive refinement causing longer lead times.

  • Data-driven insights allow resource reallocation or training to smooth workloads and better negotiate delivery expectations with clients.

  • Measuring designer productivity combines time spent and output quality, avoiding extremes of overwork or misleading volume metrics.

  • Case studies of designers like Leia and Dawn demonstrate how data supports personalized intervention and eliminates inefficiencies.

  • Culture and human judgment are critical; data is used ethically to elevate talent uniqueness and prevent biases, rather than to surveil or reduce people to metrics.

Notable Quotes

"Designers, marketers—they can be talented or clever but it's not enough to be at the edge of greatness; we have to quantify the value we deliver."

"Our single mandate in design ops is to give designers more design time and remove distractions."

"Tracking and capturing the work can be a whole new work itself. People will abandon complicated processes."

"We found a solution in an odd place—the Figma comment box—where a bot creates cards automatically in 30 seconds."

"No more time-sucking, energy-depleting time estimation game; we use data-driven models for reliable results."

"Spending more time doesn't automatically make you productive; productivity must be measured by output and sustainable practice."

"Running people into the ground is bad for business; we need fair expectations and to support our talents."

"Our system is imperfect, but we embrace continuous 1% improvement every day towards being data-driven and design-driven."

"Behind the numbers are individuals with dreams and hopes, often misunderstood by their families who prefer traditional professions."

"Creating an equitable workplace demands systems and processes that enforce fairness, protect against bias, and reward silent producers."

Iram Shah
Closing Keynote: The View from the Top
2019 • Enterprise Experience 2019
Gold
Michael Weir
Mixed Methods and Behavioural Science (Videoconference)
2023 • Rosenfeld Community
Stephen Anderson
Puzzled? How to Coordinate Humans for Complex Challenges
2021 • Enterprise Community
Bria Alexander
Opening Remarks
2021 • DesignOps Summit 2021
Gold
Jane Reid
Self-care in User Research (Videoconference)
2020 • Advancing Research Community
Elana Chapman
Getting started with accessibility research
2025 • Rosenfeld Community
Joe Meersman
Use AI to Drive Outcomes that Go Beyond the Design Sprint
2024 • DesignOps 2024
Gold
Bassel Deeb
Do More With Less: Equip and Lead Design Orgs Through Adversity
2023 • DesignOps Summit 2023
Gold
Dawn Ressel
Full-Stack User Experiences: A Marriage of Design and Technology
2016 • Enterprise UX 2016
Gold
JD Buckley
Communicating the ROI of UX within a large enterprise and out on the streets
2018 • Enterprise Experience 2018
Gold
DesignOps and The Great Talent War of 2021 (Videoconference)
2021 • DesignOps Community
Paul Pangaro, PhD
Systems Disciplines: Table Stakes for 21st Century Organizations
2023 • Enterprise UX 2023
Gold
Louis Rosenfeld
Founder’s Welcome
2022 • Design in Product 2022
Gold
Sam Proulx
Designing For Screen Readers: Understanding the Mental Models and Techniques of Real Users
2021 • Civic Design 2021
Gold
Emily Danielson
“I mean, I can lift a shovel”: Design Skills in Disaster Response
2022 • Design at Scale 2022
Gold
Carol Massa
Designing Health: Integrating Service Design, Technology, and Strategy to Transform Patient and Clinician Experiences
2024 • Advancing Service Design 2024
Gold

More Videos

Wyatt Hayman

"Human translation is preferred for accuracy, though Google Translate is used occasionally for urgent needs."

Wyatt Hayman

Global Research Panels (Videoconference)

August 8, 2020

PJ Buddhari

"Our team does not actually build the components consumed by product teams due to how Adobe's teams are structured."

PJ Buddhari Nate Baldwin

Meet Spectrum, Adobe’s Design System

June 9, 2021

Sarah Gallimore

"Exploring Wi-Fi-free zones in Toronto highlights citizen-driven desires to unplug and maintain data privacy in public spaces."

Sarah Gallimore

Inspire Progress with Artifacts from the Future

November 18, 2022

Peter Merholz

"Developing trust means showing you understand what it takes to get something shipped, that you’re reliable, and that people can be vulnerable with you."

Peter Merholz

The Trials and Tribulations of Directors of UX (Videoconference)

July 13, 2023

Dr. Jamika D. Burge

"Semiotics allows us to decode cultural shifts and understand where gender inequalities are embedded beneath the surface."

Dr. Jamika D. Burge Mansi Gupta

Advancing the Inclusion of Womxn in Research Practices (Videoconference)

September 15, 2022

Amy Marquez

"Pair designers so they review each other's work to reduce risk before going to stakeholders."

Amy Marquez

INVEST: Discussion

June 15, 2018

Dane DeSutter

"Games are not a point in time you run away from — you don’t just drop the cartridge and walk away."

Dane DeSutter Natalie Gedeon Deborah Hendersen Cheryl Platz

Beyond the Console: The rise of the Gamer Experience and how gaming will impact UX Research across industries (Videoconference)

May 17, 2024

Zariah Cameron

"Stop saying rest is a luxury or a privilege. It is not. It is a human right."

Zariah Cameron

ReDesigning Wellbeing for Equitable Care in the Workplace

September 23, 2024

Jessica Norris

"In design Ops, the same ADHD traits—like managing ambiguity and dynamic change—are often strengths."

Jessica Norris

ADHD: A DesignOps Superpower

September 9, 2022