Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

10k Screens Later: How We Became a Data-Driven Design Organization
Gold
Tuesday, September 24, 2024 • DesignOps 2024
Share the love for this talk
10k Screens Later: How We Became a Data-Driven Design Organization
Speakers: John Paul de Guzman
Link:

Summary

In this session, we'll explore how a small UI design firm (30 headcount) developed a data-driven DesignOps practice. I'll demonstrate how we use automation and robust data pipelines to excel in managing and delivering large volumes of work. This talk also shows how we transform Figma’s comment feature into a powerful tool that integrates seamlessly with Trello, enabling our team to achieve high efficiency and precision, and to track everything in real-time without the usual administrative and logistical challenges. Automation and Custom Tooling: We leverage automation to ensure every process, from capturing to moving work, is streamlined and efficient. This approach helps us tackle the scalability of thousands of work cards without overwhelming our team. Data-Driven with a Soul: This talk addresses concerns around micromanagement and surveillance, illustrating how our methods support consistent delivery (with 95% confidence) without sacrificing the human aspect of our work.

Key Insights

  • Frost Design grew its team from 3 to 21 remote designers during the pandemic, enabling nationwide talent recruitment.

  • Their design ops uses a Kanban continuous delivery model instead of typical two-week sprints to suit volatile project conditions.

  • A custom AI-powered system parses Figma comment commands to automatically create and categorize work cards in Trello.

  • Real-time dashboards built on simple tech (API orchestration, Google Sheets) provide actionable insights to forecast delivery dates with 95% accuracy.

  • Monte Carlo simulations help model delivery probabilities, enabling data-driven project commitments without traditional time estimates.

  • Tracking cycle time across stages uncovers operational bottlenecks, such as labor-intensive refinement causing longer lead times.

  • Data-driven insights allow resource reallocation or training to smooth workloads and better negotiate delivery expectations with clients.

  • Measuring designer productivity combines time spent and output quality, avoiding extremes of overwork or misleading volume metrics.

  • Case studies of designers like Leia and Dawn demonstrate how data supports personalized intervention and eliminates inefficiencies.

  • Culture and human judgment are critical; data is used ethically to elevate talent uniqueness and prevent biases, rather than to surveil or reduce people to metrics.

Notable Quotes

"Designers, marketers—they can be talented or clever but it's not enough to be at the edge of greatness; we have to quantify the value we deliver."

"Our single mandate in design ops is to give designers more design time and remove distractions."

"Tracking and capturing the work can be a whole new work itself. People will abandon complicated processes."

"We found a solution in an odd place—the Figma comment box—where a bot creates cards automatically in 30 seconds."

"No more time-sucking, energy-depleting time estimation game; we use data-driven models for reliable results."

"Spending more time doesn't automatically make you productive; productivity must be measured by output and sustainable practice."

"Running people into the ground is bad for business; we need fair expectations and to support our talents."

"Our system is imperfect, but we embrace continuous 1% improvement every day towards being data-driven and design-driven."

"Behind the numbers are individuals with dreams and hopes, often misunderstood by their families who prefer traditional professions."

"Creating an equitable workplace demands systems and processes that enforce fairness, protect against bias, and reward silent producers."

Ask the Rosenbot
Uday Gajendar
The Rise of Meta-Design: A Starter Playbook (Videoconference)
2022 • Enterprise Community
Johanna Kollmann
Insights-Driven Product Strategy: Get your Research to Count
2022 • Design in Product 2022
Gold
Alla Weinberg
How to Build and Scale Team Safety
2024 • DesignOps Summit 2020
Gold
Saara Kamppari-Miller
Theme Three Intro
2022 • DesignOps Summit 2022
Gold
George Abraham
Design Systems To-Go: Reimagining Developer Handoff, and Introducing App Builder (Part 2)
2021 • DesignOps Summit 2021
Gold
Dan Willis
Enterprise Storytelling Sessions
2018 • Enterprise Experience 2018
Gold
Anna Avrekh
User Research, Design, and Product - A Love Story
2021 • Advancing Research 2021
Gold
Wendy Johansson
Design at Scale: Behind the Scenes (Videoconference)
2021 • Enterprise Community
Rebecca Topps
Planning and conducting remote usability studies for accessibility (Videoconference)
2020 • Advancing Research Community
Kelly Dern
AI as a Design Partner: How to Get the Most Out of AI Tools to Scale Your Process
2023 • DesignOps Summit 2023
Gold
Kurdin Bazaz
Culture, DIBS & Recruiting
2021 • Design at Scale 2021
Gold
Bria Alexander
Opening Remarks Day 2
2024 • Advancing Research 2024
Gold
Nick Cochran
Growing in Enterprise Design through Making Connections
2019 • Enterprise Experience 2019
Gold
Sean McKay
Whole Product Thinking: Expanding beyond problem and solution space thinking (Videoconference)
2024 • Rosenfeld Community
Meghan Hellstern
The Next 100 Years of Civic Design: How Might We Better Rise to Meet the Challenges of Today and Tomorrow?
2021 • Civic Design 2021
Gold
Charles Lee
Building a New Home for the Atlassian Design System (Videoconference)
2020 • Enterprise Community

More Videos

"If design didn’t move the needle, we wouldn’t be having this conversation."

Standardizing Product Merits for Leaders, Designers, and Everyone

June 15, 2018

Simon Wardley

"Building a map is like learning to play chess—you have to see the board to decide your move."

Simon Wardley

Maps and Topographical Intelligence (Videoconference)

January 31, 2019

Sandra Camacho

"There’s a gap between intentions and impact; humility is needed to close it."

Sandra Camacho

Creating More Bias-Proof Designs

January 22, 2025

Darian Davis

"I felt on edge around Jeff and physically depleted after our interactions."

Darian Davis

Lessons from a Toxic Work Relationship

January 8, 2024

Fisayo Osilaja

"Providing more holistic recommendations helped us gain more trust and buy-in from stakeholders, increasing UX maturity."

Fisayo Osilaja

[Demo] The AI edge: From researcher to strategist

June 4, 2024

Uday Gajendar

"Creating tangible artifacts forces reaction and debate, helping break enterprise paralysis and drive decisions."

Uday Gajendar

The Wicked Craft of Enterprise UX

May 13, 2015

Davis Neable

"Trust is often underestimated but is critical when designers face public critique and feedback."

Davis Neable Guy Segal

How to Drive a Design Project When you Don’t Have a Design Team

June 10, 2021

Eniola Oluwole

"You won’t know what success looks like until you put something out there and see how it works in practice."

Eniola Oluwole

Lessons From the DesignOps Journey of the World's Largest Travel Site

October 24, 2019

Aurobinda Pradhan

"Design producers love their creative tools and want to keep using them without multiple manual reporting steps."

Aurobinda Pradhan Shashank Deshpande

Introduction to Collaborative DesignOps using Cubyts

September 9, 2022