Summary
The talk addresses the often misunderstood roles of data scientists and designers, emphasizing the power of their collaboration to create customer delight and actionable insights. Drawing from his experiences at Intuit and a large retailer, the speaker illustrates how data platforms and design thinking come together to improve product experimentation speed, usability, and business outcomes. At Intuit, data scientist and design teams partnered to streamline A/B testing across thousands of developers, revealing the importance of measuring leading indicators like ease of use and time to production rather than just lagging metrics. In retail, a collaboration focused on understanding high-performing store managers led to a simplified, actionable dashboard removing overwhelming data overload and improving conversion by 10%. The third story from eBay shows how cross-functional work with designers and analysts democratized massive data sets, significantly reducing time to insight from weeks to a day. The speaker underscores that fusing data science with design elevates enterprise products and innovations, proposing that data should be the fourth pillar alongside designers, developers, and product managers to foster customer delight and insight-driven decisions.
Key Insights
-
•
Fewer than 1% of global data collected is ever used to generate insights that impact people.
-
•
Data scientists blend skills from statistics, hacking, and entrepreneurship to extract value from big data.
-
•
Rapid experimentation through A/B testing drives innovation but requires platform usability and awareness to scale.
-
•
Measuring leading indicators like time to consumption and platform awareness can better drive adoption than lagging metrics alone.
-
•
Ethnographic field studies with end users (developers, store managers) uncover critical insights missed by pure data analysis.
-
•
Simplifying complex dashboards based on top-performers’ workflows empowers users and improves business outcomes (e.g., 10% sales lift).
-
•
Combining design and data science can democratize complex enterprise data, reducing insight turnaround from weeks to days.
-
•
Data’s role should expand within product teams to become the fourth essential pillar alongside design, product, and development.
-
•
Effective data products require not just analytics but thoughtful user-centered design to shift insights from theory to actionable knowledge.
-
•
Data quality factors like platform uptime and test reliability critically affect the confidence and usage of data-driven features.
Notable Quotes
"Fewer than 1% of the data collected globally is actually ever used to deliver any sort of insights for people."
"A data scientist is part stat geek, part hacker, and part entrepreneur all rolled into one."
"If you want to drive more experiments, the platform has to be easy to use, and people need to actually know it exists."
"What really matters isn’t just how many experiments you run, but how many new features get delivered to customers."
"We found that measuring the lagging indicators wasn’t enough; we needed leading indicators to understand what really drove adoption."
"Instead of overwhelming store managers with 424 pages of data, we focused on what the best-performing stores actually use to run their business."
"Spending time with 300 data analysts helped designers understand their workflow so they could build a product that accelerates insight delivery."
"This data platform became one of the top three services within the company by truly shifting conversations from I think to I know."
"Combining design and data science is how you bring data to life and make it truly meaningful for everyone across an enterprise."
"I hope data becomes the fourth leg of the stool alongside design, development, and product management."
Or choose a question:
More Videos
"Your breath is the most powerful thing. It moves on its own, but it’s the one thing you can control."
Zariah CameronReDesigning Wellbeing for Equitable Care in the Workplace
September 23, 2024
"Priorities aren’t priorities until they’ve been prioritized with attributes and values."
John Cutler Harry MaxPrioritization for designers and product managers (1st of 3 seminars) (Videoconference)
June 13, 2024
"Every time somebody purchased a domain name, I earned a commission. Over three to four years, I earned over $100,000 as a high school student."
Nick CochranGrowing in Enterprise Design through Making Connections
June 3, 2019
"I often lock a process against changes for one to two months unless a major issue arises."
Deanna SmithLeading Change with Confidence: Strategies for Optimizing Your Process
September 23, 2024
"Don’t automatically dismiss paper forms—they often contain simplifications that accelerate digital service design."
Magdalena ZadaraZero Hour: How to Get Far Quickly When Starting Your Digital Service Unit Late
November 16, 2022
"What gets us into trouble is not what we don’t know. It’s what we know for sure that just ain’t so."
Nova Wehman-BrownWe've Never Done This Before
June 4, 2019
"By identifying the triggers that lead customers to ask questions, I was able to help data scientists figure out what training data to access and explore."
Liwei DaiThe Heart and Brain of the AI Research
March 31, 2020
"My phone buzzed again. I have a job this weekend for you and your team to help on the COVID response if you’re available."
Gordon Ross12 Months of COVID-19 Design and Digital Response with the British Columbia Government
December 8, 2021
"I was running on fumes for decades."
Tutti TaygerlyMake Space to Lead
June 12, 2021
Latest Books All books
Dig deeper with the Rosenbot
What role does effect size play in determining the value of a detected change in experiments?
How can designers cultivate a collective, hopeful ideal for the future of design amidst technological hype?
What are slices of value in iterative platform development and how do they help deliver healthcare IT projects?