Summary
In this talk, Johanna Kollmann will discuss how true insights can inform product strategy, with direct impact on the roadmap and metrics. Drawing on her experience as a research lead and product manager, Johanna will share case studies and tools that are relevant for researchers, designers, and product leaders. Stick around to join the conversation and ask Johanna your questions during our post-session Q+A, moderated by Christian Crumlish.
Key Insights
-
•
Research often starts too narrowly focused on validating design elements rather than addressing broader product strategy.
-
•
Distinguishing between research questions and interview questions significantly improves research planning and outcomes.
-
•
Adding generative elements to research sessions reveals user attitudes that directly affect adoption and transformation success.
-
•
Confirmation bias among domain expert stakeholders can hinder recognizing important but unexpected insights.
-
•
Collaborative frameworks like 'See, Mean, Matter' help teams convert observations into actionable, business-relevant insights.
-
•
Framing insights in terms of strategic business outcomes like adoption gains more leadership attention than tactical usability issues.
-
•
Systemic issues affecting product impact may require elevating findings to senior policy-making levels to enable change.
-
•
Visual tools such as quadrant diagrams empower product managers to communicate research priorities effectively to leadership.
-
•
Integrating human-centric customer experience metrics alongside traditional business metrics provides a fuller picture of success.
-
•
Inviting researchers into performance forums fosters cross-team alignment around mission goals and data-driven decision making.
Notable Quotes
"The product leadership really doesn’t see the value in research and they’re thinking about shutting the research team down."
"Research was completely evaluative and tactical, positioned as serving design rather than product strategy."
"Design strategy provides a framework for design solutions supporting product strategy, but product strategy focuses on the business model and roadmap."
"The difference between research questions and interview questions is the most significant source of confusion."
"Insights are unexpected discoveries about how things work and how to make them work better."
"Confirmation bias makes us ignore or misinterpret data that conflicts with our existing beliefs."
"I replaced the testing script with a research plan highlighting research questions and a separate discussion guide with interview questions."
"If you frame an insight as poor usability, only usability folks care; but frame it as risking adoption, and everyone pays attention."
"We used storytelling metaphors and a journey map with a rickety drawbridge to convey blockers to senior stakeholders."
"Human-centric metrics like employee well-being and client relationships are crucial alongside efficiency and productivity."
Or choose a question:
More Videos
"Process can make things scalable and bring folks together in ways that are not even imaginable."
Jennifer KanyamibwaCreating the Blueprint: Growing and Building Design Teams
November 8, 2018
"Having a repo isn’t the same as having a strategy for socializing and evangelizing the research."
Brigette Metzler Dana ChrisfieldResearch Repositories: A global project by the ResearchOps Community (Videoconference)
August 27, 2020
"A cross-functional project in name only means people report back to their management silos, not to the project team."
Carl TurnerYou Can Do This: Understand and Solve Organizational Problems to Jumpstart a Dead Project
March 28, 2023
"We come in like water—hanging out, listening, figuring out where the blood flow is in the environment."
John Mortimer Milan Guenther Lucy Ellis Patrick QuattlebaumPanel Discussion
December 3, 2024
"Information overload with checklists on top of checklists does not create a great onboarding experience."
Dante GuintuHow to Crush the Talent Crunch
September 8, 2022
"Creativity means a change in perception, from the familiar to the unfamiliar, even initially ridiculous."
Richard BuchananCreativity and Principles in the Flourishing Enterprise
June 15, 2018
"Shemus Bern is going to talk about how you drop into a client site and grok what’s going on without losing why they hired you."
Dan WillisTheme 3: Intro
January 8, 2024
"Failure is when effort did not produce the desired result, not an identity."
Dan WardFailure Friday #1 with Dan Ward
February 7, 2025
"We don't just need to do a better job of articulating our value. We need to become more valuable."
Chris GeisonTheme Two Intro
March 28, 2023