Summary
The talk addresses the often misunderstood roles of data scientists and designers, emphasizing the power of their collaboration to create customer delight and actionable insights. Drawing from his experiences at Intuit and a large retailer, the speaker illustrates how data platforms and design thinking come together to improve product experimentation speed, usability, and business outcomes. At Intuit, data scientist and design teams partnered to streamline A/B testing across thousands of developers, revealing the importance of measuring leading indicators like ease of use and time to production rather than just lagging metrics. In retail, a collaboration focused on understanding high-performing store managers led to a simplified, actionable dashboard removing overwhelming data overload and improving conversion by 10%. The third story from eBay shows how cross-functional work with designers and analysts democratized massive data sets, significantly reducing time to insight from weeks to a day. The speaker underscores that fusing data science with design elevates enterprise products and innovations, proposing that data should be the fourth pillar alongside designers, developers, and product managers to foster customer delight and insight-driven decisions.
Key Insights
-
•
Fewer than 1% of global data collected is ever used to generate insights that impact people.
-
•
Data scientists blend skills from statistics, hacking, and entrepreneurship to extract value from big data.
-
•
Rapid experimentation through A/B testing drives innovation but requires platform usability and awareness to scale.
-
•
Measuring leading indicators like time to consumption and platform awareness can better drive adoption than lagging metrics alone.
-
•
Ethnographic field studies with end users (developers, store managers) uncover critical insights missed by pure data analysis.
-
•
Simplifying complex dashboards based on top-performers’ workflows empowers users and improves business outcomes (e.g., 10% sales lift).
-
•
Combining design and data science can democratize complex enterprise data, reducing insight turnaround from weeks to days.
-
•
Data’s role should expand within product teams to become the fourth essential pillar alongside design, product, and development.
-
•
Effective data products require not just analytics but thoughtful user-centered design to shift insights from theory to actionable knowledge.
-
•
Data quality factors like platform uptime and test reliability critically affect the confidence and usage of data-driven features.
Notable Quotes
"Fewer than 1% of the data collected globally is actually ever used to deliver any sort of insights for people."
"A data scientist is part stat geek, part hacker, and part entrepreneur all rolled into one."
"If you want to drive more experiments, the platform has to be easy to use, and people need to actually know it exists."
"What really matters isn’t just how many experiments you run, but how many new features get delivered to customers."
"We found that measuring the lagging indicators wasn’t enough; we needed leading indicators to understand what really drove adoption."
"Instead of overwhelming store managers with 424 pages of data, we focused on what the best-performing stores actually use to run their business."
"Spending time with 300 data analysts helped designers understand their workflow so they could build a product that accelerates insight delivery."
"This data platform became one of the top three services within the company by truly shifting conversations from I think to I know."
"Combining design and data science is how you bring data to life and make it truly meaningful for everyone across an enterprise."
"I hope data becomes the fourth leg of the stool alongside design, development, and product management."
Or choose a question:
More Videos
"You have to be proactive in identifying opportunities and influence through solid communication and relationships."
Catt Small Micah Bennett Brian Carr Jessica HarlleeWhat's Next for ICs: Exploring Staff and Principal Designer Roles (Videoconference)
February 22, 2024
"The current LLM models are great at summarizing, but they’re not so great at capturing exact details."
Jennifer Kong[Case study] Journeying toward AI-assisted documentation in healthcare
June 5, 2024
"When our bathroom scales deliver bad news, we hop on and off again, but we accept good news quickly."
Sara LogelYour Colleagues are Your Users Too
March 29, 2023
"We created a rolling study program where researchers owned expertise for specific user roles, resulting in more efficient studies."
Veevi RosensteinBuilding for Scale: Creating the Zendesk UX Research Practice
January 8, 2024
"AI can help cut through the noise, but it can’t replace knowing our company strategy or customer context."
Michelle Bejian Lotia Anne-Marie MorellRolling Out a Repository: How Zapier Centralizes Insights from Across their Organization
March 28, 2023
"Share your story, be vulnerable, go first, and reveal what truly matters to you."
Tutti TaygerlyVideconference: How to Work with Difficult People with Tutti Taygerly
June 25, 2020
"If you’re like us, your team simply isn’t large enough to fully staff every project with 100% of the UX talent it needs."
Patrick CommarfordDesign Staffing for Impact
January 8, 2024
"How might we unlock the full capabilities of our most valuable resource—our people, their skills, their knowledge, and their potential?"
Frances YllanaTheme 2 Intro
September 24, 2024
"A map is not the territory; frameworks must be selective and purposeful to be useful."
Mujtaba HameedFrameworks for Excellence: Using Visual Thinking and Communication to Elevate Your Research
March 26, 2024