Summary
In this session, we'll explore how a small UI design firm (30 headcount) developed a data-driven DesignOps practice. I'll demonstrate how we use automation and robust data pipelines to excel in managing and delivering large volumes of work. This talk also shows how we transform Figma’s comment feature into a powerful tool that integrates seamlessly with Trello, enabling our team to achieve high efficiency and precision, and to track everything in real-time without the usual administrative and logistical challenges. Automation and Custom Tooling: We leverage automation to ensure every process, from capturing to moving work, is streamlined and efficient. This approach helps us tackle the scalability of thousands of work cards without overwhelming our team. Data-Driven with a Soul: This talk addresses concerns around micromanagement and surveillance, illustrating how our methods support consistent delivery (with 95% confidence) without sacrificing the human aspect of our work.
Key Insights
-
•
Frost Design grew its team from 3 to 21 remote designers during the pandemic, enabling nationwide talent recruitment.
-
•
Their design ops uses a Kanban continuous delivery model instead of typical two-week sprints to suit volatile project conditions.
-
•
A custom AI-powered system parses Figma comment commands to automatically create and categorize work cards in Trello.
-
•
Real-time dashboards built on simple tech (API orchestration, Google Sheets) provide actionable insights to forecast delivery dates with 95% accuracy.
-
•
Monte Carlo simulations help model delivery probabilities, enabling data-driven project commitments without traditional time estimates.
-
•
Tracking cycle time across stages uncovers operational bottlenecks, such as labor-intensive refinement causing longer lead times.
-
•
Data-driven insights allow resource reallocation or training to smooth workloads and better negotiate delivery expectations with clients.
-
•
Measuring designer productivity combines time spent and output quality, avoiding extremes of overwork or misleading volume metrics.
-
•
Case studies of designers like Leia and Dawn demonstrate how data supports personalized intervention and eliminates inefficiencies.
-
•
Culture and human judgment are critical; data is used ethically to elevate talent uniqueness and prevent biases, rather than to surveil or reduce people to metrics.
Notable Quotes
"Designers, marketers—they can be talented or clever but it's not enough to be at the edge of greatness; we have to quantify the value we deliver."
"Our single mandate in design ops is to give designers more design time and remove distractions."
"Tracking and capturing the work can be a whole new work itself. People will abandon complicated processes."
"We found a solution in an odd place—the Figma comment box—where a bot creates cards automatically in 30 seconds."
"No more time-sucking, energy-depleting time estimation game; we use data-driven models for reliable results."
"Spending more time doesn't automatically make you productive; productivity must be measured by output and sustainable practice."
"Running people into the ground is bad for business; we need fair expectations and to support our talents."
"Our system is imperfect, but we embrace continuous 1% improvement every day towards being data-driven and design-driven."
"Behind the numbers are individuals with dreams and hopes, often misunderstood by their families who prefer traditional professions."
"Creating an equitable workplace demands systems and processes that enforce fairness, protect against bias, and reward silent producers."
Or choose a question:
More Videos
"I have to triangulate socially because Yorkshire folks are quite reserved; they won't openly admit issues."
Adam Cutler Karen Pascoe Ian Swinson Susan WorthmanDiscussion
June 8, 2016
"If you’re doing a lot of work that’s not in your job description, you might actually be doing leadership."
Peter MerholzThe Trials and Tribulations of Directors of UX (Videoconference)
July 13, 2023
"If you haven’t designed who your teams are and who your players are, expecting people to comply with standards won’t work."
Lisa WelchmanCleaning Up Our Mess: Digital Governance for Designers
June 14, 2018
"The time for action is now, and it must be collaborative."
Vincent BrathwaiteOpener: Past, Present, and Future—Closing the Racial Divide in Design Teams
October 22, 2020
"Psychological safety was far and away the key ingredient for teams being effective."
Brenna FallonLearning Over Outcomes
October 24, 2019
"Most organizations are still asking design questions at a global level; we need to be hyper-local now."
Tricia WangSpatial Collapse: Designing for Emergent Culture
January 8, 2024
"If you don’t bring stakeholders into the research journey, they won’t believe or use the data."
Edgar Anzaldua MorenoUsing Research to Determine Unique Value Proposition
March 11, 2021
"Knowledge needs to be thought of as a reusable circular process, not a linear one ending at project completion."
Designing Systems at Scale
November 7, 2018
"Design is the rendering of intent — bringing ideas into a form people can interact with to solve problems, as Jared Spool said."
Erin WeigelGet Your Whole Team Testing to Design for Impact
July 24, 2024
