Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Data Science and Design: A Tale of Two Tribes

Gold
Wednesday, May 13, 2015 • Enterprise UX 2015
Share the love for this talk
Data Science and Design: A Tale of Two Tribes
Speakers: Chris Chapo
Link:

Summary

In this talk, Jon explores the often misunderstood relationship between data scientists and designers and how their collaboration can create significant customer value. Drawing on his experience at Intuit, he discusses developing an enterprise-wide A/B testing platform that initially struggled with adoption until working closely with designers to identify key leading metrics like platform ease of use and time to deployment, rather than just lagging outcomes. Jon also recounts a retail case where overwhelming daily data was distilled by studying top-performing store managers in context, enabling the team to design a focused dashboard that increased sales conversion by 10%. Lastly, he highlights eBay's approach to extracting meaningful signals from vast transaction data by partnering designers with 300 data analysts to streamline workflows and reduce insight time from weeks to a day, democratizing access across the company. He concludes that integrating data science fully into product teams alongside design and development creates more delightful, insight-driven products.

Key Insights

  • Less than 1% of global data is used to generate human insights, showing the value in efficient data utilization.

  • A data scientist combines statistical skills, hacking mindset, and entrepreneurial thinking to solve complex problems.

  • At Intuit, pairing designers with data scientists uncovered that ease of use and awareness were key to increasing adoption of an A/B testing platform.

  • Lagging indicators like number of experiments performed or features deployed are insufficient alone; leading indicators such as time to consumption and user awareness better drive adoption.

  • Ethnographic studies can reveal user behaviors and misalignments in what enterprise teams measure versus what actually drives business outcomes.

  • Studying the best-performing store leaders on the floor uncovered critical behaviors that informed a focused dashboard replacing overwhelming 424-page daily reports.

  • A simple data product tracking live customer-to-employee ratios, transaction progress, staff availability, and service queue length helped retail store managers improve performance and customer experience.

  • eBay’s approach to ‘signal extraction’ from massive data involves time series analysis, decision trees, and close designer-analyst collaboration to cut insight delivery from weeks to a day.

  • Democratizing data insights across an enterprise empowers broader decision-making beyond traditional analyst-only access.

  • Integrating data science as a core pillar alongside design, development, and product management can transform teams into more effective problem solvers and innovators.

Notable Quotes

"Since we started this presentation, enough data has been collected to fill everyone’s hard drive about 500,000 times, and fewer than 1% is ever used for insights."

"Data scientists are part stats geek, part hacker, and part entrepreneur."

"Develop deep customer empathy — really understand who’s using a product and why — walk a day in their shoes."

"Rapid experimentation with customers is key. Iterate, iterate, iterate."

"It doesn’t matter what the insight is if no one does anything with it."

"We realized we were measuring the wrong things — we focused on lagging indicators rather than the leading ones we could influence."

"Surprisingly, many developers didn’t even know our testing platform existed."

"By studying the best store leaders, we learned patterns that informed a dashboard reducing 424 pages of data to a few key, actionable metrics."

"eBay cut the time it took to get answers from weeks to one day by integrating design with data analysis workflows."

"Bringing data science into the core product process is like adding a fourth leg to the stool — design, development, product management, and data together create delight."

Ask the Rosenbot
Peter Levin
Solve a Problem Here, Transform a Strategy There: Research as an Occasion for Expanding Organizational Possibility
2024 • Advancing Research 2024
Gold
Erika Flowers
AI-Readiness: Preparing NASA for a Data-Driven, Agile Future
2025 • Designing with AI 2025
Gold
Adel Du Toit
Get Your CFO To Say: 'Our Strategic Goal is User Obsession'
2022 • Design at Scale 2022
Gold
Bas Raijmakers, PhD (RCA)
What Design Research can Learn from Documentary Filmmaking
2022 • Advancing Research 2022
Gold
Patrizia Bertini
Pushing DesignOps’ Influence into New Global Markets
2022 • DesignOps Summit 2022
Gold
Samuel Proulx
Invisible barriers: Why accessible service design can’t be an afterthought
2024 • Advancing Service Design 2024
Gold
Matt Duignan
HITS, Microsoft's internal human insight system: From research library to living body of knowledge
2019 • Advancing Research Community
Etienne Fang
Power of Insights: Why sharing is better than silos with Uber’s Insights Platform
2019 • Advancing Research Community
Sarah Brooks
Fireside chat with Sarah Brooks and Jen Pahlka
2021 • Civic Design Community
Andrew Webster
Scaling Design Capability: How Involved Should You Be?
2021 • DesignOps Summit 2021
Gold
Sahibzada Mayed
Cultivating Design Ecologies of Care, Community, and Collaboration
2023 • DesignOps Summit 2023
Gold
Zen Ren
Taking Inspiration from Instructional Design for Research
2022 • Advancing Research 2022
Gold
Kevin Bethune
Reimagining Design: Unlocking Strategic Innovation
2022 • Design at Scale 2022
Gold
Maggie Dieringer
Creating Consistency Through Constant Change
2024 • DesignOps Summit 2020
Gold
Husani Oakley
Theme Two Intro
2023 • Enterprise UX 2023
Gold
Toby Haug
Discussion
2017 • Enterprise Experience 2017
Gold

More Videos

Joanna Vodopivec

"Inviting other teams into research sessions lets us triangulate findings by combining interviews, observations, and focus groups."

Joanna Vodopivec Prabhas Pokharel

One Research Team for All - Influence Without Authority

March 9, 2022

Louis Rosenfeld

"Careers here are jungle gyms, not ladders; you can move laterally and explore many paths."

Louis Rosenfeld Lashanda Hodge Senongo Akpem Chris Hodowanec

Becoming a Civic Designer: Making the Move from Private to Public Sector

November 17, 2022

Bria Alexander

"We are closing out design ops 2024 with innovation curated by the incomparable John Kuda."

Bria Alexander

Day 3 Welcome

September 25, 2024

Uday Gajendar

"Am I getting what I wanna get out of this conference? What’s not coming and what would I still like to learn?"

Uday Gajendar Louis Rosenfeld

Day 2 Welcome

June 5, 2024

Sam Proulx

"Frequent, bite-sized training is crucial so staff actually remember how to support customers with disabilities."

Sam Proulx

Online Shopping: Designing an Accessible Experience

June 7, 2023

Russ Unger

"Unpaid design exercises are unfair because they don’t take into account people's real-life constraints."

Russ Unger

Onboarding: The Ecosystem, not the Afterthought

November 7, 2017

Catherine Dubut

"Physical prototyping is a tool to explore interaction modalities and physically connected environments beyond all things digital."

Catherine Dubut

Bridging Physical and Digital Spaces: Approaches to Retail Service Design

March 18, 2021

Josh Clark

"Characters live at the extreme of radically adaptive AI—they react in the moment and follow the user’s lead."

Josh Clark Veronika Kindred

Sentient Design: New Postures for AI-Mediated Experiences (2nd of 3 seminars)

January 29, 2025

Dantley Davis

"Ownership needs to be shared. The craft of making is similar to raising a child — it takes a village."

Dantley Davis

Leadership & Diversity—A Fireside Chat with Dantley Davis

September 17, 2020