Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Designing Systems at Scale
Gold
Wednesday, November 7, 2018 • DesignOps Summit 2018
Share the love for this talk
Link:

Summary

To be alive in the twenty-first century is to rely on countless complex systems that profoundly affect our lives, where small mistakes can turn into massive inefficiencies and failures. These failures seem to stem from very different problems, but their underlying causes turn out to be surprisingly similar. This talk will cover about the common threads of these failures, how they can be detected and ultimately prevented using various research disciplines – from market research to anthropology to data science. We need to get good at designing and building for systems to tackle multi-dimensional problems at the intersection of people and technology.

Key Insights

  • Judy Ellis’s fourth element—appreciation of play—is critical in designing tools that unlock limitless possibilities beyond the product itself.

  • Balancing engineering processes and design invisibility creates successful operations by making processes seamless yet well-documented.

  • At Shopify, service lines function as bridges between product lines to facilitate knowledge flow and alignment across domains.

  • The brain processes data through two main streams: the 'what' stream (quantitative/object data) and the 'where' stream (qualitative/context data), both essential for good decision-making.

  • Contextual, qualitative data (the 'where' stream) reaches decision-making centers in the brain before quantitative data, highlighting its primacy in evaluations.

  • Knowledge creation, distribution, application, and evaluation form a circular cycle essential for transforming companies into learning organizations.

  • Cross-disciplinary teams combining anthropologists, UX researchers, data scientists, and market researchers improve the richness and relevance of knowledge creation.

  • Centralized research hubs combined with decentralized embedded experts provide balanced, accessible, and context-rich knowledge distribution.

  • Visible, accessible knowledge assets like Shopify’s merchant frustrations tool enhance organizational learning and responsiveness.

  • Strong leadership that understands and promotes knowledge cycles is key to embedding fact-based decision-making throughout an organization.

Notable Quotes

"The toy shouldn’t be the goal of play, but a tool or a process that unlocks the unlimited possibilities set forth before a child."

"Successful operations must have a well-laid-out and transparent process and documentation, but that process must become invisible in its application."

"Service lines bridge the gaps between product lines through information flows to provide the right knowledge at the right time."

"Our brains are terrible at operating only on one type of information, whether object-oriented or context-oriented."

"Context-related data gathered through qualitative research is the first to reach our decision-making centers in the brain."

"Knowledge needs to be thought of as a reusable circular process, not a linear one ending at project completion."

"We want to build teams with diverse skill sets so we can create a full picture during the knowledge creation phase."

"We manage the environment in which knowledge distribution takes place, not the process itself."

"Leadership buy-in is really important—having an executive who understands the value of knowledge creation, distribution, application, and evaluation."

"With proper maintenance, knowledge becomes a vehicle that probes the most hidden spaces of possibility and brings the best decisions to the surface."

Ask the Rosenbot
Group Activity: Making Sense of DesignOps
2017 • DesignOps Summit 2017
Gold
Alexia Cohen
Increasing Health Equity and Improving the Service Experience for Under-Served Latine Communities in Arizona
2024 • Advancing Service Design 2024
Gold
Maria Giudice
Becoming a Changemaker by Leading with Design
2023 • Advancing Research 2023
Gold
Nicole Umphress
Delivering Design Education During a Global Pandemic: Lessons Learned
2022 • Design at Scale 2022
Gold
Jorge Arango
[Demo] How to re-categorize content at scale using LLMs
2024 • Designing with AI 2024
Gold
Jemma Ahmed
Convergent Research Techniques in Customer Journey Mapping
2020 • Advancing Research 2020
Gold
April Reagan
Look, Think, Act: The Futures-Smart Design Organization
2021 • DesignOps Summit 2021
Gold
Dantley Davis
Leadership & Diversity—A Fireside Chat with Dantley Davis (Videoconference)
2020 • Enterprise Community
Kit Unger
Theme 2: Discussion
2024 • Enterprise Experience 2020
Gold
Kit Unger
Theme 1 Intro
2022 • Design at Scale 2022
Gold
Uday Gajendar
Theme Four Intro
2023 • Enterprise UX 2023
Gold
Victor Lombardi
Bridging Design and Climate Science (Videoconference)
2024 • Climate UX Interest Group (Rosenfeld Community)
Peter Van Dijck
Coffee with Lou #4: Taking a Peek Under the Rosenbot's Hood (Videoconference)
2024 • Rosenfeld Community
Sarah Auslander
Incremental Steps to Drive Radical Innovation in Policy Design
2022 • Civic Design 2022
Gold
Dave Hoffer
UX Job Search AMA with Joanne Weaver and Dave Hoffer
2025 • Rosenfeld Community
Kristen Honey
"Let’s Talk About Data and Crisis”: Public Digital Service Delivery = Open Data + Human Centered Design (Videoconference)
2021 • Civic Design Community

More Videos

Adam Cutler

"Can you show me your process, not just your portfolio? That shows me your real design thinking."

Adam Cutler Karen Pascoe Ian Swinson Susan Worthman

Discussion

June 8, 2016

Peter Merholz

"UXers are less satisfied than their peers because we have failed to set expectations about the real work of UX in organizations."

Peter Merholz

The Trials and Tribulations of Directors of UX (Videoconference)

July 13, 2023

Lisa Welchman

"If you haven’t designed who your teams are and who your players are, expecting people to comply with standards won’t work."

Lisa Welchman

Cleaning Up Our Mess: Digital Governance for Designers

June 14, 2018

Vincent Brathwaite

"Every small action contributes to a larger impact in the fight against climate change."

Vincent Brathwaite

Opener: Past, Present, and Future—Closing the Racial Divide in Design Teams

October 22, 2020

Brenna Fallon

"If you get a perfect score on your OKRs, it means you didn’t set your sights high enough."

Brenna Fallon

Learning Over Outcomes

October 24, 2019

Tricia Wang

"Never be afraid to get into good trouble; start by asking why."

Tricia Wang

Spatial Collapse: Designing for Emergent Culture

January 8, 2024

Edgar Anzaldua Moreno

"Marital status mattered because car buying decisions often involve family members, not just the individual."

Edgar Anzaldua Moreno

Using Research to Determine Unique Value Proposition

March 11, 2021

"Context-related data gathered through qualitative research is the first to reach our decision-making centers in the brain."

Designing Systems at Scale

November 7, 2018

Erin Weigel

"Decades worth of agricultural data had to be thrown out because they lacked control groups and statistical rigor."

Erin Weigel

Get Your Whole Team Testing to Design for Impact

July 24, 2024