Summary
In this talk, Johanna Kollmann will discuss how true insights can inform product strategy, with direct impact on the roadmap and metrics. Drawing on her experience as a research lead and product manager, Johanna will share case studies and tools that are relevant for researchers, designers, and product leaders. Stick around to join the conversation and ask Johanna your questions during our post-session Q+A, moderated by Christian Crumlish.
Key Insights
-
•
Research often starts too narrowly focused on validating design elements rather than addressing broader product strategy.
-
•
Distinguishing between research questions and interview questions significantly improves research planning and outcomes.
-
•
Adding generative elements to research sessions reveals user attitudes that directly affect adoption and transformation success.
-
•
Confirmation bias among domain expert stakeholders can hinder recognizing important but unexpected insights.
-
•
Collaborative frameworks like 'See, Mean, Matter' help teams convert observations into actionable, business-relevant insights.
-
•
Framing insights in terms of strategic business outcomes like adoption gains more leadership attention than tactical usability issues.
-
•
Systemic issues affecting product impact may require elevating findings to senior policy-making levels to enable change.
-
•
Visual tools such as quadrant diagrams empower product managers to communicate research priorities effectively to leadership.
-
•
Integrating human-centric customer experience metrics alongside traditional business metrics provides a fuller picture of success.
-
•
Inviting researchers into performance forums fosters cross-team alignment around mission goals and data-driven decision making.
Notable Quotes
"The product leadership really doesn’t see the value in research and they’re thinking about shutting the research team down."
"Research was completely evaluative and tactical, positioned as serving design rather than product strategy."
"Design strategy provides a framework for design solutions supporting product strategy, but product strategy focuses on the business model and roadmap."
"The difference between research questions and interview questions is the most significant source of confusion."
"Insights are unexpected discoveries about how things work and how to make them work better."
"Confirmation bias makes us ignore or misinterpret data that conflicts with our existing beliefs."
"I replaced the testing script with a research plan highlighting research questions and a separate discussion guide with interview questions."
"If you frame an insight as poor usability, only usability folks care; but frame it as risking adoption, and everyone pays attention."
"We used storytelling metaphors and a journey map with a rickety drawbridge to convey blockers to senior stakeholders."
"Human-centric metrics like employee well-being and client relationships are crucial alongside efficiency and productivity."
Or choose a question:
More Videos
"You need well-defined frameworks and guardrails for experimentation success to prevent chaos across teams."
Jemma Ahmed Steve Carrod Chris Geison Dr. Shadi Janansefat Christopher NashDemocratization: Working with it, not against it [Advancing Research Community Workshop Series]
July 24, 2024
"You need sponsorship from senior leadership but also buy-in from all corners of the company to succeed."
Nina JurcicThe Design System Rollercoaster: From Enabler and Bottleneck to Catalyst for Change
October 3, 2023
"A pattern library is not a design system — you need the code as a single source of truth to prevent people dropping the ball."
Nathan Curtis Nalini P. Kotamraju Jack Moffett Dawn ResselDiscussion
June 9, 2016
"When tactical metrics end up on the left side and KPIs on the right side of the compass, that signals we need a longer conversation about what we measure."
Saara Kamppari-Miller Nicole Bergstrom Shashi JainKey Metrics: Comparing Three Letter Acronym Metrics That Include the Word “Key”
November 13, 2024
"It’s really hard to make changes to these systems because it’s risk-ridden and a major undertaking."
Malini RaoLessons Learned from a 4-year Product Re-platforming Journey
June 9, 2021
"Over 4,000 users volunteered to look at the beta version, giving us excellent data at scale."
Mackenzie Cockram Sara Branco Cunha Ian FranklinIntegrating Qualitative and Quantitative Research from Discovery to Live
December 16, 2022
"You can change the time zone to whatever works for you on the conference site to avoid ambiguity."
Bria AlexanderOpening Remarks
June 9, 2021
"Everyone is looking for ways to build better products and go faster."
Jackie HoLead Effectively While Preserving Team Autonomy with Growth Boards
January 8, 2024
"Design is about cultural imagination, not just problem solving."
Dan HillDesigning for the infrastructures of everyday life
June 4, 2024