Summary
The talk addresses the often misunderstood roles of data scientists and designers, emphasizing the power of their collaboration to create customer delight and actionable insights. Drawing from his experiences at Intuit and a large retailer, the speaker illustrates how data platforms and design thinking come together to improve product experimentation speed, usability, and business outcomes. At Intuit, data scientist and design teams partnered to streamline A/B testing across thousands of developers, revealing the importance of measuring leading indicators like ease of use and time to production rather than just lagging metrics. In retail, a collaboration focused on understanding high-performing store managers led to a simplified, actionable dashboard removing overwhelming data overload and improving conversion by 10%. The third story from eBay shows how cross-functional work with designers and analysts democratized massive data sets, significantly reducing time to insight from weeks to a day. The speaker underscores that fusing data science with design elevates enterprise products and innovations, proposing that data should be the fourth pillar alongside designers, developers, and product managers to foster customer delight and insight-driven decisions.
Key Insights
-
•
Fewer than 1% of global data collected is ever used to generate insights that impact people.
-
•
Data scientists blend skills from statistics, hacking, and entrepreneurship to extract value from big data.
-
•
Rapid experimentation through A/B testing drives innovation but requires platform usability and awareness to scale.
-
•
Measuring leading indicators like time to consumption and platform awareness can better drive adoption than lagging metrics alone.
-
•
Ethnographic field studies with end users (developers, store managers) uncover critical insights missed by pure data analysis.
-
•
Simplifying complex dashboards based on top-performers’ workflows empowers users and improves business outcomes (e.g., 10% sales lift).
-
•
Combining design and data science can democratize complex enterprise data, reducing insight turnaround from weeks to days.
-
•
Data’s role should expand within product teams to become the fourth essential pillar alongside design, product, and development.
-
•
Effective data products require not just analytics but thoughtful user-centered design to shift insights from theory to actionable knowledge.
-
•
Data quality factors like platform uptime and test reliability critically affect the confidence and usage of data-driven features.
Notable Quotes
"Fewer than 1% of the data collected globally is actually ever used to deliver any sort of insights for people."
"A data scientist is part stat geek, part hacker, and part entrepreneur all rolled into one."
"If you want to drive more experiments, the platform has to be easy to use, and people need to actually know it exists."
"What really matters isn’t just how many experiments you run, but how many new features get delivered to customers."
"We found that measuring the lagging indicators wasn’t enough; we needed leading indicators to understand what really drove adoption."
"Instead of overwhelming store managers with 424 pages of data, we focused on what the best-performing stores actually use to run their business."
"Spending time with 300 data analysts helped designers understand their workflow so they could build a product that accelerates insight delivery."
"This data platform became one of the top three services within the company by truly shifting conversations from I think to I know."
"Combining design and data science is how you bring data to life and make it truly meaningful for everyone across an enterprise."
"I hope data becomes the fourth leg of the stool alongside design, development, and product management."
Or choose a question:
More Videos
"Restoration is not just about replanting trees; it’s about rebuilding entire ecosystems."
Alex Hurworth Bonnie John Fahd Arshad Antoine MarinDesigning a Contact Tracing App for Universal Access
October 23, 2020
"Investing in new practitioners is mutually rewarding; we learn from their fresh perspectives and reassess what we know ourselves."
Laine Riley Prokay Lisa GordonCarving a Path for Early Career DesignOps Practitioners
September 9, 2022
"Once cash prizes were gone, people stopped feeling ownership of the design system."
Eniola OluwoleLessons From the DesignOps Journey of the World's Largest Travel Site
October 24, 2019
"If your budgets don’t connect to strategy goals, maybe those budget items shouldn’t exist."
Nathan ShedroffDouble Your Mileage: Use Your Research Strategically
March 31, 2020
"If you focus on desktop accessibility, you’re leaving out some of your most important users who may have mobile-only access."
Sam ProulxMobile Accessibility: Why Moving Accessibility Beyond the Desktop is Critical in a Mobile-first World
November 17, 2022
"At LinkedIn, rapid research uncovered trends across products that helped reduce duplicate work."
Feleesha SterlingBuilding a Rapid Research Program (Videoconference)
May 18, 2023
"Triple win cultural roles speak to what a company commits to, what users need, and wider cultural tensions."
Neil BarrieWidening the Aperture: The Case for Taking a Broader Lens to the Dialogue between Products and Culture
March 25, 2024
"You can’t measure long-term customer relationship value with short-term KPIs."
John DevanneyThe Design Management Office
November 6, 2017
"You need to understand stakeholders’ fears, motivations, and incentives to change hearts and minds."
Katy MogalBut Do Your Insights Scale?
March 12, 2021