Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

10k Screens Later: How We Became a Data-Driven Design Organization
Gold
Tuesday, September 24, 2024 • DesignOps 2024
Share the love for this talk
10k Screens Later: How We Became a Data-Driven Design Organization
Speakers: John Paul de Guzman
Link:

Summary

In this session, we'll explore how a small UI design firm (30 headcount) developed a data-driven DesignOps practice. I'll demonstrate how we use automation and robust data pipelines to excel in managing and delivering large volumes of work. This talk also shows how we transform Figma’s comment feature into a powerful tool that integrates seamlessly with Trello, enabling our team to achieve high efficiency and precision, and to track everything in real-time without the usual administrative and logistical challenges. Automation and Custom Tooling: We leverage automation to ensure every process, from capturing to moving work, is streamlined and efficient. This approach helps us tackle the scalability of thousands of work cards without overwhelming our team. Data-Driven with a Soul: This talk addresses concerns around micromanagement and surveillance, illustrating how our methods support consistent delivery (with 95% confidence) without sacrificing the human aspect of our work.

Key Insights

  • Frost Design grew its team from 3 to 21 remote designers during the pandemic, enabling nationwide talent recruitment.

  • Their design ops uses a Kanban continuous delivery model instead of typical two-week sprints to suit volatile project conditions.

  • A custom AI-powered system parses Figma comment commands to automatically create and categorize work cards in Trello.

  • Real-time dashboards built on simple tech (API orchestration, Google Sheets) provide actionable insights to forecast delivery dates with 95% accuracy.

  • Monte Carlo simulations help model delivery probabilities, enabling data-driven project commitments without traditional time estimates.

  • Tracking cycle time across stages uncovers operational bottlenecks, such as labor-intensive refinement causing longer lead times.

  • Data-driven insights allow resource reallocation or training to smooth workloads and better negotiate delivery expectations with clients.

  • Measuring designer productivity combines time spent and output quality, avoiding extremes of overwork or misleading volume metrics.

  • Case studies of designers like Leia and Dawn demonstrate how data supports personalized intervention and eliminates inefficiencies.

  • Culture and human judgment are critical; data is used ethically to elevate talent uniqueness and prevent biases, rather than to surveil or reduce people to metrics.

Notable Quotes

"Designers, marketers—they can be talented or clever but it's not enough to be at the edge of greatness; we have to quantify the value we deliver."

"Our single mandate in design ops is to give designers more design time and remove distractions."

"Tracking and capturing the work can be a whole new work itself. People will abandon complicated processes."

"We found a solution in an odd place—the Figma comment box—where a bot creates cards automatically in 30 seconds."

"No more time-sucking, energy-depleting time estimation game; we use data-driven models for reliable results."

"Spending more time doesn't automatically make you productive; productivity must be measured by output and sustainable practice."

"Running people into the ground is bad for business; we need fair expectations and to support our talents."

"Our system is imperfect, but we embrace continuous 1% improvement every day towards being data-driven and design-driven."

"Behind the numbers are individuals with dreams and hopes, often misunderstood by their families who prefer traditional professions."

"Creating an equitable workplace demands systems and processes that enforce fairness, protect against bias, and reward silent producers."

Ask the Rosenbot
Dem Gerolemou
Climate technology fundamentals (Videoconference)
2024 • Climate UX Interest Group (Rosenfeld Community)
Maria Giudice
Becoming a Changemaker by Leading with Design
2023 • Advancing Research 2023
Gold
Erin Weigel
Real-world lessons to improve your conversion rates (Videoconference)
2024 • Rosenfeld Community
Sheryl Cababa
Living in the Clouds: Adopting a Systems Thinking Mindset
2023 • Enterprise UX 2023
Gold
Exploring DesignOps as a Business Strategic Function
2025 • DesignOps Community
Civic Design in 2022 (Videoconference)
2022 • Civic Design Community
Russ Unger
Onboarding: The Ecosystem, not the Afterthought
2017 • DesignOps Summit 2017
Gold
Aras Bilgen
Research Democratization: A Debate
2023 • Advancing Research 2023
Gold
John Calhoun
Meters, Miles, and Madness: New Frameworks to Measure the (Elusive) Value of DesignOps
2024 • DesignOps 2024
Gold
Victor Udoewa
Radical Participatory Design: Decolonizing Participatory Design Processes
2021 • Civic Design 2021
Gold
Michaela Mora
Advanced Concept Testing Approaches To Guide Product Development and Business Decisions
2022 • Advancing Research 2022
Gold
Luca Rager
Empowering Gaming at Scale: How Xbox Builds Powerful, Automated, and Distributed Design Systems with Sketch
2021 • DesignOps Summit 2021
Gold
B. Pagels-Minor
Breaking the Tension: The Power of Enabling Your Employees to Show Up Authentically
2022 • Design at Scale 2022
Gold
Jennifer Kanyamibwa
Creating the Blueprint: Growing and Building Design Teams
2018 • DesignOps Summit 2018
Gold
Ellie Krysl
Planned Right. Managed Right. Designed Right.
2023 • Enterprise UX 2023
Gold
Discussion
2017 • Enterprise Experience 2017
Gold

More Videos

Angelos Arnis

"Design is navigating through unprecedented times."

Angelos Arnis

Navigating the Rapid Shifts in Tech's Turbulent Terrain

October 2, 2023

John Calhoun

"Prioritizing design ops work is tough amid competing priorities and limited time and budget."

John Calhoun Rachel Posman

Bring your DesignOps Story to Life! The Definitive DesignOps Book Jam

October 3, 2023

Alfred Kahn

"Design is often a subsidiary of product, really there to serve engineering—wireframe people."

Alfred Kahn

A Seat at the Table: Making Your Team a Strategic Partner

November 29, 2023

Dan Willis

"I should have brought you along on this journey instead of scheduling a big meeting — I was wrong."

Dan Willis

Enterprise Storytelling Sessions

June 3, 2019

John Maeda

"Design ops professionals need to embrace their role as agents of change, supporting others but often facing resistance."

John Maeda Alison Rand

About Design Organizations (Videoconference)

May 13, 2019

Anat Fintzi

"When I interviewed everyone, I asked what success meant to them specifically to inform my UX roadmap."

Anat Fintzi Rachel Minnicks

Delivering at Scale: Making Traction with Resistant Partners

June 9, 2022

Uday Gajendar

"Working with CEOs like Mark Templeton is like Dancing with the Stars — an interpretive dance of translating fuzzy ideas."

Uday Gajendar

The Wicked Craft of Enterprise UX

May 13, 2015

Kristin Skinner

"We recognized recurring challenges: lack of visibility, proving value, and coordinating across teams."

Kristin Skinner

Theme 1 Intro

September 29, 2021

Maish Nichani

"Playing the infinite game is like gardening: if you neglect it, things wither, but if you tend it, it thrives. Service excellence requires the same ongoing care."

Maish Nichani

Sparking a Service Excellence Mindset at a Government Agency

December 9, 2021