Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Designing Systems at Scale
Gold
Wednesday, November 7, 2018 • DesignOps Summit 2018
Share the love for this talk
Link:

Summary

To be alive in the twenty-first century is to rely on countless complex systems that profoundly affect our lives, where small mistakes can turn into massive inefficiencies and failures. These failures seem to stem from very different problems, but their underlying causes turn out to be surprisingly similar. This talk will cover about the common threads of these failures, how they can be detected and ultimately prevented using various research disciplines – from market research to anthropology to data science. We need to get good at designing and building for systems to tackle multi-dimensional problems at the intersection of people and technology.

Key Insights

  • Judy Ellis’s fourth element—appreciation of play—is critical in designing tools that unlock limitless possibilities beyond the product itself.

  • Balancing engineering processes and design invisibility creates successful operations by making processes seamless yet well-documented.

  • At Shopify, service lines function as bridges between product lines to facilitate knowledge flow and alignment across domains.

  • The brain processes data through two main streams: the 'what' stream (quantitative/object data) and the 'where' stream (qualitative/context data), both essential for good decision-making.

  • Contextual, qualitative data (the 'where' stream) reaches decision-making centers in the brain before quantitative data, highlighting its primacy in evaluations.

  • Knowledge creation, distribution, application, and evaluation form a circular cycle essential for transforming companies into learning organizations.

  • Cross-disciplinary teams combining anthropologists, UX researchers, data scientists, and market researchers improve the richness and relevance of knowledge creation.

  • Centralized research hubs combined with decentralized embedded experts provide balanced, accessible, and context-rich knowledge distribution.

  • Visible, accessible knowledge assets like Shopify’s merchant frustrations tool enhance organizational learning and responsiveness.

  • Strong leadership that understands and promotes knowledge cycles is key to embedding fact-based decision-making throughout an organization.

Notable Quotes

"The toy shouldn’t be the goal of play, but a tool or a process that unlocks the unlimited possibilities set forth before a child."

"Successful operations must have a well-laid-out and transparent process and documentation, but that process must become invisible in its application."

"Service lines bridge the gaps between product lines through information flows to provide the right knowledge at the right time."

"Our brains are terrible at operating only on one type of information, whether object-oriented or context-oriented."

"Context-related data gathered through qualitative research is the first to reach our decision-making centers in the brain."

"Knowledge needs to be thought of as a reusable circular process, not a linear one ending at project completion."

"We want to build teams with diverse skill sets so we can create a full picture during the knowledge creation phase."

"We manage the environment in which knowledge distribution takes place, not the process itself."

"Leadership buy-in is really important—having an executive who understands the value of knowledge creation, distribution, application, and evaluation."

"With proper maintenance, knowledge becomes a vehicle that probes the most hidden spaces of possibility and brings the best decisions to the surface."

Ask the Rosenbot
Ned Dwyer
The Future of DesignOps is Tool Consolidation
2024 • DesignOps 2024
Gold
Megan Blocker
Getting to the “So What?”: How Management Consulting Practices Can Transform Your Approach to Research
2024 • Advancing Research 2024
Gold
Josh Clark
Sentient Design, AI, and the Radically Adaptive Experience (1st of 3 seminars)
2025 • Rosenfeld Community
John Devanney
The Design Management Office
2017 • DesignOps Summit 2017
Gold
Alla Weinberg
Healing Toxic Stress
2024 • DesignOps 2024
Gold
Jack Behar
How to Build Prototypes that Behave like an End-Product
2022 • Design in Product 2022
Gold
Theresa Neil
Just Build Me a Dashboard! (Videoconference)
2019 • Enterprise Community
Uday Gajendar
Theme Four Intro
2023 • Enterprise UX 2023
Gold
Liz Ebengo
The Burden on Children: The Cost of Insufficient Post-Conflict Services and Pathways Forward
2024 • Advancing Service Design 2024
Gold
Michele Marut
Research Repositories Reconsidered (Videoconference)
2019 • DesignOps Community
Briana Thomas
The Quiet Force: Uncovering Hidden Leadership in High-Impact Design Teams
2024 • DesignOps 2024
Gold
Bria Alexander
The Big Question about Resilience: A panel discussion
2024 • DesignOps 2024
Gold
Michelle Bejian Lotia
Rolling Out a Repository: How Zapier Centralizes Insights from Across their Organization
2023 • Advancing Research 2023
Gold
Sara Logel
Your Colleagues are Your Users Too
2023 • Advancing Research 2023
Gold
Janelle Estes
UX Research Trends (Videoconference)
2021 • Advancing Research Community
Sarah Barrett
AI in Real Life: Using LLMs to Turbocharge Microsoft Learn
2025 • Rosenfeld Community

More Videos

Alex Hurworth

"Policies must evolve to reflect the urgency of our situation."

Alex Hurworth Bonnie John Fahd Arshad Antoine Marin

Designing a Contact Tracing App for Universal Access

October 23, 2020

Laine Riley Prokay

"Mentors are wonderful partners for feedback, collaboration, and setting employees up for success."

Laine Riley Prokay Lisa Gordon

Carving a Path for Early Career DesignOps Practitioners

September 9, 2022

Eniola Oluwole

"Everyone wanted to know what was the official pattern and who was accountable for it."

Eniola Oluwole

Lessons From the DesignOps Journey of the World's Largest Travel Site

October 24, 2019

Nathan Shedroff

"If your budgets don’t connect to strategy goals, maybe those budget items shouldn’t exist."

Nathan Shedroff

Double Your Mileage: Use Your Research Strategically

March 31, 2020

Sam Proulx

"On mobile, the version of the screen reader matches the OS version, making it easier to test and replicate issues."

Sam Proulx

Mobile Accessibility: Why Moving Accessibility Beyond the Desktop is Critical in a Mobile-first World

November 17, 2022

Feleesha Sterling

"It’s important to socialize the research program internally so teams get excited and take initiative."

Feleesha Sterling

Building a Rapid Research Program (Videoconference)

May 18, 2023

Neil Barrie

"We are at an inflection point where what got us here won't get us to a thriving future."

Neil Barrie

Widening the Aperture: The Case for Taking a Broader Lens to the Dialogue between Products and Culture

March 25, 2024

John Devanney

"Most organizations know they need to evaluate impact, but very few have effective ways to do it."

John Devanney

The Design Management Office

November 6, 2017

Katy Mogal

"It’s not about the specific tool, but about how you expose people to the insights in a way that excites them."

Katy Mogal

But Do Your Insights Scale?

March 12, 2021