Summary
In this talk, Johanna Kollmann will discuss how true insights can inform product strategy, with direct impact on the roadmap and metrics. Drawing on her experience as a research lead and product manager, Johanna will share case studies and tools that are relevant for researchers, designers, and product leaders. Stick around to join the conversation and ask Johanna your questions during our post-session Q+A, moderated by Christian Crumlish.
Key Insights
-
•
Research often starts too narrowly focused on validating design elements rather than addressing broader product strategy.
-
•
Distinguishing between research questions and interview questions significantly improves research planning and outcomes.
-
•
Adding generative elements to research sessions reveals user attitudes that directly affect adoption and transformation success.
-
•
Confirmation bias among domain expert stakeholders can hinder recognizing important but unexpected insights.
-
•
Collaborative frameworks like 'See, Mean, Matter' help teams convert observations into actionable, business-relevant insights.
-
•
Framing insights in terms of strategic business outcomes like adoption gains more leadership attention than tactical usability issues.
-
•
Systemic issues affecting product impact may require elevating findings to senior policy-making levels to enable change.
-
•
Visual tools such as quadrant diagrams empower product managers to communicate research priorities effectively to leadership.
-
•
Integrating human-centric customer experience metrics alongside traditional business metrics provides a fuller picture of success.
-
•
Inviting researchers into performance forums fosters cross-team alignment around mission goals and data-driven decision making.
Notable Quotes
"The product leadership really doesn’t see the value in research and they’re thinking about shutting the research team down."
"Research was completely evaluative and tactical, positioned as serving design rather than product strategy."
"Design strategy provides a framework for design solutions supporting product strategy, but product strategy focuses on the business model and roadmap."
"The difference between research questions and interview questions is the most significant source of confusion."
"Insights are unexpected discoveries about how things work and how to make them work better."
"Confirmation bias makes us ignore or misinterpret data that conflicts with our existing beliefs."
"I replaced the testing script with a research plan highlighting research questions and a separate discussion guide with interview questions."
"If you frame an insight as poor usability, only usability folks care; but frame it as risking adoption, and everyone pays attention."
"We used storytelling metaphors and a journey map with a rickety drawbridge to convey blockers to senior stakeholders."
"Human-centric metrics like employee well-being and client relationships are crucial alongside efficiency and productivity."
Dig deeper—ask the Rosenbot:
More Videos
"We combine explicit and implicit quantitative methods to fully get the user's perspective on the tested products."
Daniela Magaña Flores Ariane Rahn Jeff Ephraim BanderAhead of Competition: Learn What UX Benchmarking Can Do for Your Business Today
March 10, 2022
"Prompting at its core involves very specifically using the inputs you give the technology so you can elicit desired outputs."
Savina HawkinsHarnessing AI in UXR: Practical Strategies for Positive Impact
March 26, 2024
"The consequences of inaction are not hypothetical; they are happening right now."
Alex Hurworth Bonnie John Fahd Arshad Antoine MarinDesigning a Contact Tracing App for Universal Access
October 23, 2020
"Durability of insights varies; some human factors last a long time while cultural elements like hamburger menus shift over time."
Matt DuignanHITS, Microsoft's internal human insight system: From research library to living body of knowledge (Videoconference)
July 16, 2019
"Dark patterns trick or manipulate users into doing something they wouldn’t normally do or against their own or society’s best interests - Craig Vor."
Craig VillamorDesign Systems for Ethical Design (Videoconference)
January 26, 2023
"Move from thoughts to things — the faster you get something tangible, the faster people stop debating opinions."
Ovetta SampsonTurning UX Passion into Real Product Influence
June 7, 2023
"Every company wants to be a software company, launching faster and improving quality with more developer velocity."
Rima Campbell Amrit S BhachuIncrease Productivity and Drive Business Impact
September 24, 2024
"Leadership trust score went up by 22 points after design ops was established – that’s how we measured impact."
Amy Gawronski ZuccaroAdvice for DesignOps Employee #1
September 29, 2021
"We have to move into radical participatory research where researcher is community member."
Victor UdoewaBeyond Methods and Diversity: The Roots of Inclusion
March 26, 2024
