Summary
In this session, we'll explore how a small UI design firm (30 headcount) developed a data-driven DesignOps practice. I'll demonstrate how we use automation and robust data pipelines to excel in managing and delivering large volumes of work. This talk also shows how we transform Figma’s comment feature into a powerful tool that integrates seamlessly with Trello, enabling our team to achieve high efficiency and precision, and to track everything in real-time without the usual administrative and logistical challenges. Automation and Custom Tooling: We leverage automation to ensure every process, from capturing to moving work, is streamlined and efficient. This approach helps us tackle the scalability of thousands of work cards without overwhelming our team. Data-Driven with a Soul: This talk addresses concerns around micromanagement and surveillance, illustrating how our methods support consistent delivery (with 95% confidence) without sacrificing the human aspect of our work.
Key Insights
-
•
Frost Design grew its team from 3 to 21 remote designers during the pandemic, enabling nationwide talent recruitment.
-
•
Their design ops uses a Kanban continuous delivery model instead of typical two-week sprints to suit volatile project conditions.
-
•
A custom AI-powered system parses Figma comment commands to automatically create and categorize work cards in Trello.
-
•
Real-time dashboards built on simple tech (API orchestration, Google Sheets) provide actionable insights to forecast delivery dates with 95% accuracy.
-
•
Monte Carlo simulations help model delivery probabilities, enabling data-driven project commitments without traditional time estimates.
-
•
Tracking cycle time across stages uncovers operational bottlenecks, such as labor-intensive refinement causing longer lead times.
-
•
Data-driven insights allow resource reallocation or training to smooth workloads and better negotiate delivery expectations with clients.
-
•
Measuring designer productivity combines time spent and output quality, avoiding extremes of overwork or misleading volume metrics.
-
•
Case studies of designers like Leia and Dawn demonstrate how data supports personalized intervention and eliminates inefficiencies.
-
•
Culture and human judgment are critical; data is used ethically to elevate talent uniqueness and prevent biases, rather than to surveil or reduce people to metrics.
Notable Quotes
"Designers, marketers—they can be talented or clever but it's not enough to be at the edge of greatness; we have to quantify the value we deliver."
"Our single mandate in design ops is to give designers more design time and remove distractions."
"Tracking and capturing the work can be a whole new work itself. People will abandon complicated processes."
"We found a solution in an odd place—the Figma comment box—where a bot creates cards automatically in 30 seconds."
"No more time-sucking, energy-depleting time estimation game; we use data-driven models for reliable results."
"Spending more time doesn't automatically make you productive; productivity must be measured by output and sustainable practice."
"Running people into the ground is bad for business; we need fair expectations and to support our talents."
"Our system is imperfect, but we embrace continuous 1% improvement every day towards being data-driven and design-driven."
"Behind the numbers are individuals with dreams and hopes, often misunderstood by their families who prefer traditional professions."
"Creating an equitable workplace demands systems and processes that enforce fairness, protect against bias, and reward silent producers."
Or choose a question:
More Videos
"All data has bias, problems, and limitations; there is no perfectly clean data, only varying degrees of quality."
Jemma Ahmed Steve Carrod Chris Geison Dr. Shadi Janansefat Christopher NashDemocratization: Working with it, not against it [Advancing Research Community Workshop Series]
July 24, 2024
"Our design system team became less builders and more librarians and facilitators over time."
Nina JurcicThe Design System Rollercoaster: From Enabler and Bottleneck to Catalyst for Change
October 3, 2023
"A pattern library is not a design system — you need the code as a single source of truth to prevent people dropping the ball."
Nathan Curtis Nalini P. Kotamraju Jack Moffett Dawn ResselDiscussion
June 9, 2016
"Measurements are always a conversation; they should not be a covenant imposed on you, especially when you’re trying something new."
Saara Kamppari-Miller Nicole Bergstrom Shashi JainKey Metrics: Comparing Three Letter Acronym Metrics That Include the Word “Key”
November 13, 2024
"We added an in-product feedback framework and used the UMUX scale to get feedback at scale and distinguish true pain points."
Malini RaoLessons Learned from a 4-year Product Re-platforming Journey
June 9, 2021
"85% of people were leaving after just looking at one page on the old site—that was a huge problem."
Mackenzie Cockram Sara Branco Cunha Ian FranklinIntegrating Qualitative and Quantitative Research from Discovery to Live
December 16, 2022
"If you signed up for a cohort, please make sure you’re in your private cohort channel to meet and discuss with your group."
Bria AlexanderOpening Remarks
June 9, 2021
"Growth boards enabled direction change sooner by objectively evaluating team health and strategic alignment."
Jackie HoLead Effectively While Preserving Team Autonomy with Growth Boards
January 8, 2024
"Private cars are parked 95% of the time, making them highly inefficient in urban environments."
Dan HillDesigning for the infrastructures of everyday life
June 4, 2024