Designing Systems at Scale
Summary
To be alive in the twenty-first century is to rely on countless complex systems that profoundly affect our lives, where small mistakes can turn into massive inefficiencies and failures. These failures seem to stem from very different problems, but their underlying causes turn out to be surprisingly similar. This talk will cover about the common threads of these failures, how they can be detected and ultimately prevented using various research disciplines – from market research to anthropology to data science. We need to get good at designing and building for systems to tackle multi-dimensional problems at the intersection of people and technology.
Key Insights
-
•
Judy Ellis taught that the key to good design is combining aesthetics, manufacturing knowledge, business understanding, and an appreciation of play.
-
•
Successful processes must be transparent yet become invisible in their application to empower creativity and decision-making.
-
•
Shopify divides work into product lines addressing audiences and service lines ensuring knowledge flow and organizational alignment.
-
•
Data types fall into two complementary streams: object-oriented 'what' data and context-oriented 'where' data.
-
•
The brain processes 'what' and 'where' data in different hippocampus areas before combining them for decision-making.
-
•
Qualitative, context-rich data (the where stream) reaches decision centers earlier and is critical for effective decisions.
-
•
Cross-disciplinary collaboration among UX researchers, data scientists, anthropologists, and market researchers maximizes insight quality.
-
•
Knowledge distribution is best managed by shaping the environment and workflows rather than micromanaging the process itself.
-
•
Leadership support and clear executive ownership are vital to sustaining centralized research and knowledge cycles.
-
•
Tools like Shopify’s merchant frustrations database improve asset visibility and continuous improvement for customer-centric decisions.
Notable Quotes
"Toy design is not about the toy itself but a tool that unlocks unlimited possibilities before a child."
"Successful operations must have well laid out and transparent process documentation but that process must become invisible in its application."
"Service lines bridge gaps between product lines by facilitating knowledge flow and alignment."
"Our brains are terrible at operating on only one type of information—object-oriented or context-oriented."
"It’s the context-related data gathered through qualitative research that reaches our decision-making centers first."
"UX researchers at Shopify travel across product lines to share expertise and knowledge continuously."
"Knowledge creation, distribution, application, and evaluation form a reusable circular process, not a linear one."
"Leadership is really important—having an executive who understands the value of the knowledge cycle is key."
"Shopify’s merchant frustrations tool tracks customer issues over time, making that knowledge available to all teams."
"Properly maintained, knowledge becomes a vehicle that probes the most hidden spaces of what’s possible."
Or choose a question:
More Videos
"Decision making here is basically forge trading — people argue and withhold support until they get what they want."
Carl TurnerYou Can Do This: Understand and Solve Organizational Problems to Jumpstart a Dead Project
March 28, 2023
"With selfie pay, you take a picture, blink to prove it’s you alive, and authenticate in-app seamlessly and securely."
Karen PascoeDeveloping Experience Teams and Talent in the Enterprise
June 8, 2016
"When you remove nonverbal cues from communication, messages get easily misinterpreted."
Jilanna WilsonDistributed Design Operations Management
October 23, 2019
"We’ve seen self-service tool usage grow from hundreds to millions of veterans served monthly after launching a unified VA platform."
Shawna Hein Kevin HoffmanCreate a Cohesive Civic Design Practice Across Agency, Vendors, and Contracts
November 17, 2022
"Working in healthcare means every tiny moment in a patient’s experience can either uphold or erode their dignity and sense of control."
Barb SpantonDoing Work That Matters: A Look Beyond The Idealistic Notion of 'Doing Meaningful Work'
June 10, 2022
"We decided not to chase shiny objects because we wanted to stay true to our mission."
Briana ThomasThe Quiet Force: Uncovering Hidden Leadership in High-Impact Design Teams
September 24, 2024
"Service design is 10% connecting the dots and 90% creating the conditions that bring those dots closer together."
Gina MendoliaTherapists, Coaches, and Grandmas: Techniques for Service Design in Complex Systems
December 3, 2024
"Understanding how assistive technology evolves is crucial because it foretells the future of interface design."
Lija Hogan Milan Mijatovic Sam Proulx Louis RosenfeldThree Years Out: Perspectives on the Near-Term Future of User Research
March 15, 2024
"Be human first when creating new roles; treat them with the same care as hiring new team members."
John Calhoun Rachel PosmanTwo Sides of the DesignOps Coin: Teams Ops and Product Ops
January 8, 2024
Latest Books All books
Dig deeper with the Rosenbot
How can storytelling and influence be used to secure sponsorship for design ops initiatives?
What role should AI play in user research tools, and how do you manage associated risks and accountability?
Is it possible to bypass HIPAA by initially targeting veterinary markets for clinical app development?