Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Data Science and Design: A Tale of Two Tribes

Gold
Wednesday, May 13, 2015 • Enterprise UX 2015
Share the love for this talk
Data Science and Design: A Tale of Two Tribes
Speakers: Chris Chapo
Link:

Summary

In this talk, Jon explores the often misunderstood relationship between data scientists and designers and how their collaboration can create significant customer value. Drawing on his experience at Intuit, he discusses developing an enterprise-wide A/B testing platform that initially struggled with adoption until working closely with designers to identify key leading metrics like platform ease of use and time to deployment, rather than just lagging outcomes. Jon also recounts a retail case where overwhelming daily data was distilled by studying top-performing store managers in context, enabling the team to design a focused dashboard that increased sales conversion by 10%. Lastly, he highlights eBay's approach to extracting meaningful signals from vast transaction data by partnering designers with 300 data analysts to streamline workflows and reduce insight time from weeks to a day, democratizing access across the company. He concludes that integrating data science fully into product teams alongside design and development creates more delightful, insight-driven products.

Key Insights

  • Less than 1% of global data is used to generate human insights, showing the value in efficient data utilization.

  • A data scientist combines statistical skills, hacking mindset, and entrepreneurial thinking to solve complex problems.

  • At Intuit, pairing designers with data scientists uncovered that ease of use and awareness were key to increasing adoption of an A/B testing platform.

  • Lagging indicators like number of experiments performed or features deployed are insufficient alone; leading indicators such as time to consumption and user awareness better drive adoption.

  • Ethnographic studies can reveal user behaviors and misalignments in what enterprise teams measure versus what actually drives business outcomes.

  • Studying the best-performing store leaders on the floor uncovered critical behaviors that informed a focused dashboard replacing overwhelming 424-page daily reports.

  • A simple data product tracking live customer-to-employee ratios, transaction progress, staff availability, and service queue length helped retail store managers improve performance and customer experience.

  • eBay’s approach to ‘signal extraction’ from massive data involves time series analysis, decision trees, and close designer-analyst collaboration to cut insight delivery from weeks to a day.

  • Democratizing data insights across an enterprise empowers broader decision-making beyond traditional analyst-only access.

  • Integrating data science as a core pillar alongside design, development, and product management can transform teams into more effective problem solvers and innovators.

Notable Quotes

"Since we started this presentation, enough data has been collected to fill everyone’s hard drive about 500,000 times, and fewer than 1% is ever used for insights."

"Data scientists are part stats geek, part hacker, and part entrepreneur."

"Develop deep customer empathy — really understand who’s using a product and why — walk a day in their shoes."

"Rapid experimentation with customers is key. Iterate, iterate, iterate."

"It doesn’t matter what the insight is if no one does anything with it."

"We realized we were measuring the wrong things — we focused on lagging indicators rather than the leading ones we could influence."

"Surprisingly, many developers didn’t even know our testing platform existed."

"By studying the best store leaders, we learned patterns that informed a dashboard reducing 424 pages of data to a few key, actionable metrics."

"eBay cut the time it took to get answers from weeks to one day by integrating design with data analysis workflows."

"Bringing data science into the core product process is like adding a fourth leg to the stool — design, development, product management, and data together create delight."

Ask the Rosenbot
Rebecca Topps
Planning and conducting remote usability studies for accessibility
2020 • Advancing Research Community
Cornelius Rachieru
Handling Complexity: Framing a Scale of Design
2021 • Design at Scale 2021
Gold
Tracy McGoldrick
IBM User Experience Program—The What, Why and How
2021 • Advancing Research Community
Christian Crumlish
AMA with Christian Crumlish, author of Product Management for UX People
2022 • Enterprise Community
Joseph Williams
Unlocking impact and influence through inclusive hiring in research
2021 • Advancing Research Community
Husani Oakley
Bias Towards Action: Building Teams that Build Work
2018 • Enterprise Experience 2018
Gold
Joel Branch
Humanizing AI: Filling the Gaps with Multi-faceted Research
2021 • Advancing Research 2021
Gold
Chelsea Mauldin
Let's Talk About Money
2022 • Civic Design 2022
Gold
Michelle Morrison
Practice What You Preach
2024 • DesignOps Summit 2020
Gold
Mike Davidson
Fireside Chat
2022 • Advancing Research 2022
Gold
Mac Smith
Measuring Up: Using Product Research for Organizational Impact
2021 • Advancing Research 2021
Gold
Tatyana Mamut
Opening Keynote: Breaking Conway's Law--or How to Work Differently and Not Ship Your Org Chart
2019 • Enterprise Experience 2019
Gold
Simon Wardley
Maps and Topographical Intelligence
2019 • Enterprise Community
Dr. Jamika D. Burge
Theme 3 Intro
2022 • Advancing Research 2022
Gold
Luca Rager
Empowering Gaming at Scale: How Xbox Builds Powerful, Automated, and Distributed Design Systems with Sketch
2021 • DesignOps Summit 2021
Gold
Adrian Howard
Sturgeon’s Biases
2024 • DesignOps Summit 2024
Gold

More Videos

John Cutler

"It is impossible to survive in this industry by pushing against the current all the time; you must put yourself in positions to leverage the current."

John Cutler

Oxbows, Rivers, and Estuaries: How to navigate the currents of change (without burning out)

December 3, 2024

Darian Davis

"I felt on edge and physically depleted after our interactions."

Darian Davis

Lessons from a Toxic Work Relationship

January 8, 2024

Dave Gray

"We’re all in this together and figuring it out — making it up as we go along."

Dave Gray

Group Activity: Making Sense of DesignOps

November 7, 2017

John Cutler

"I never thought I'd say this, but can someone please for love of God, just make a RACI so we can align on who's responsible for things."

John Cutler

The Alignment Trap

November 29, 2023

Abby Covert

"Diagramming is kindness we give to ourselves and others to get our bearings on things we’re stuck on."

Abby Covert

Stuck? Diagrams Help

October 27, 2022

Mark Interrante

"Culture is what you tolerate — if you tolerate rudeness or tardiness, it becomes part of who you are."

Mark Interrante

Collaboration Flows in Product Development

June 9, 2017

Devon Powers

"The metaverse has not summoned those angels; instead, it has brought in all the good and the bad from the real world."

Devon Powers

Imagining Better Futures

March 9, 2022

Prayag Narula

"Share your learning quickly and often—don’t wait for big reports. Your deliverable as a designer doing research is the design itself."

Prayag Narula

How to Empower Your Designers to Do Good Research – And Why You Want To

June 10, 2022

Peter Van Dijck

"We need to dramatically change the hats, the walls, and the workflow of how we work together in design and development."

Peter Van Dijck

Hands on AI #3: Claude Code for UX people

October 22, 2025