Designing Systems at Scale
Summary
This talk will cover about the common threads of these failures, how they can be detected and ultimately prevented using various research disciplines – from market research to anthropology to data science. We need to get good at designing and building for systems to tackle multi-dimensional problems at the intersection of people and technology.
Key Insights
-
•
Judy Ellis taught that the key to good design is combining aesthetics, manufacturing knowledge, business understanding, and an appreciation of play.
-
•
Successful processes must be transparent yet become invisible in their application to empower creativity and decision-making.
-
•
Shopify divides work into product lines addressing audiences and service lines ensuring knowledge flow and organizational alignment.
-
•
Data types fall into two complementary streams: object-oriented 'what' data and context-oriented 'where' data.
-
•
The brain processes 'what' and 'where' data in different hippocampus areas before combining them for decision-making.
-
•
Qualitative, context-rich data (the where stream) reaches decision centers earlier and is critical for effective decisions.
-
•
Cross-disciplinary collaboration among UX researchers, data scientists, anthropologists, and market researchers maximizes insight quality.
-
•
Knowledge distribution is best managed by shaping the environment and workflows rather than micromanaging the process itself.
-
•
Leadership support and clear executive ownership are vital to sustaining centralized research and knowledge cycles.
-
•
Tools like Shopify’s merchant frustrations database improve asset visibility and continuous improvement for customer-centric decisions.
Notable Quotes
"Toy design is not about the toy itself but a tool that unlocks unlimited possibilities before a child."
"Successful operations must have well laid out and transparent process documentation but that process must become invisible in its application."
"Service lines bridge gaps between product lines by facilitating knowledge flow and alignment."
"Our brains are terrible at operating on only one type of information—object-oriented or context-oriented."
"It’s the context-related data gathered through qualitative research that reaches our decision-making centers first."
"UX researchers at Shopify travel across product lines to share expertise and knowledge continuously."
"Knowledge creation, distribution, application, and evaluation form a reusable circular process, not a linear one."
"Leadership is really important—having an executive who understands the value of the knowledge cycle is key."
"Shopify’s merchant frustrations tool tracks customer issues over time, making that knowledge available to all teams."
"Properly maintained, knowledge becomes a vehicle that probes the most hidden spaces of what’s possible."
Or choose a question:
More Videos
"People were overwhelmed, missing the point, and didn’t even know where to start with all this change."
Erin HauberDesign is Not the Frosting on the Scaled Agile Layer Cake
October 24, 2019
"Being badass means being vulnerable, standing up, being brave, and being true to yourself."
Megan KiersteadYou Are a Badass at UX: Overcoming Imposter Syndrome
March 10, 2021
"When the world outside is crazy, the team needs to know that at least design ops has things under control internally."
Maggie DieringerCreating Consistency Through Constant Change
January 8, 2024
"Lift and shift equals timidity—it’s sticking to what you know rather than delivering real value."
Meaghan Waters Fotina KoutropoulousLack of Product Thinking will Doom Your Legacy Modernization
June 9, 2021
"We can’t expect all researchers to switch seamlessly across methods without training and time."
Jemma AhmedBringing together market and user research
October 17, 2019
"Activation isn’t just at the end of the journey; it must be embedded throughout the knowledge management process."
Maria TaylorKnowledge is Power: Managing the Lifeblood of the Design Org
October 3, 2023
"Simulation or personas can never replace testing with real users to build empathy and get accurate results."
Sam ProulxUnderstanding Screen Readers on Mobile: How And Why to Learn from Native Users
June 6, 2023
"We introduced 'go-to' people, like account managers, responsible for particular business areas to maintain relationships."
Catherine BlizzardUsing Integrated Insight to Drive Growth
March 10, 2022
"I put down my question guide and just talked with Carol."
Randolph Duke IIWar Stories LIVE! Randy Duke II
March 30, 2020
