Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Finding the unknown in the known: Harnessing meta-analysis and literature review

Gold
Wednesday, March 12, 2025 • Advancing Research 2025
Share the love for this talk
Finding the unknown in the known: Harnessing meta-analysis and literature review
Speakers: Katie Hansen
Link:

Summary

Meta-analyses and literature reviews tap into the vast potential of existing research, uncovering powerful insights that can transform your work. These often-underused methods go beyond desk research, saving you time and money while adding depth and rigor to your findings. We’ll inspire you to embrace these tools and guide you on how to leverage them to elevate your research to new heights.

Key Insights

  • Revisiting existing research can save weeks or months by building on previously gathered insights.

  • Literature reviews provide rich thematic understanding, while meta-analyses quantitatively aggregate findings to reveal robust patterns.

  • Thumbtack's Homeowner Playbook synthesized insights from over 85 studies to create a foundational, strategic resource that cultivates empathy and aligns teams.

  • Leadership buy-in and internal communications are crucial for ensuring organizational adoption and visibility of research syntheses.

  • Meta-analysis can answer new, high-impact questions that original studies were not designed to address.

  • The Nielsen Norman Group’s search meta-analysis revealed the 'pinball pattern' where users bounce between multiple search result elements instead of scanning linearly.

  • Synthesizing research requires careful handling of selection bias, overgeneralization, variable data formats, and time/resource constraints.

  • Creating living documents that are periodically updated keeps synthesized research relevant and impactful over time.

  • Collaborative brainstorming and structured databases help organize large volumes of internal research for effective synthesis.

  • Even small efforts to revisit and synthesize research can significantly elevate team alignment and strategic decision making.

Notable Quotes

"The answers to our most pressing questions aren’t out there waiting to be discovered, but right here hidden in what we already know."

"Meta-analysis is like looking at the average Rotten Tomatoes score to get an overall sentiment from many individual reviews."

"A literature review pulls together different perspectives to paint a bigger picture, not just averages."

"Every piece of research we’ve conducted represents valuable context and insights that can still guide us today."

"The Homeowner Playbook helped align teams across product, marketing, and operations by giving everyone a shared research fact understanding."

"It doesn’t happen very often, but I’m speechless. I’m truly impressed by the clarity, structure, and impressive synthesis of the Homeowner Playbook."

"Meta-analysis reveals overarching patterns that might otherwise be hidden within isolated studies."

"Users now bounce between different elements on the page influenced by visually compelling features and keywords — what we call the pinball pattern."

"Selection bias, overgeneralization, data variability, and time constraints are common challenges to synthesis."

"Start small, revisit a past study, synthesize related findings, or take a step towards creating something like a playbook for your own organization."

Ask the Rosenbot
Dan Donald
Design Systems as a Vehicle for Systemic Change
2023 • DesignOps Community
Aditi Ruiz
Pulse Check: Empathy Mapping Your Product Manager, Pt. 2
2022 • Design in Product 2022
Gold
Alison Rand
Scaling Impact with Service Design
2021 • DesignOps Community
Ren Pope
Building Experiences for Knowledge Systems
2023 • Enterprise UX 2023
Gold
Peter Van Dijck
Coffee with Lou #4: Taking a Peek Under the Rosenbot's Hood
2024 • Rosenfeld Community
Lavrans Løvlie
Ask me anything – Authors of Service Design: From Insight to Implementation
2025 • Advancing Service Design 2025
Gold
Dem Gerolemou
Climate technology fundamentals
2024 • Climate UX Interest Group
Laura Klein
Unique challenges of innovation in enterprises
2020 • Enterprise Community
Alëna Iouguina
Designing Systems at Scale
2018 • DesignOps Summit 2018
Gold
Rachael Dietkus, LCSW
AI: Passionate defenses and reasoned critique [Advancing Research Community Workshop Series]
2024 • Advancing Research Community
Jemma Ahmed
Democratization: Working with it, not against it [Advancing Research Community Workshop Series]
2024 • Advancing Research Community
Saara Kamppari-Miller
Inclusive Design is DesignOps
2021 • DesignOps Summit 2021
Gold
Shipra Kayan
Emerging principles for using AI in Design: What the product design team at Miro has learned from deeply integrating AI in their workflow
2025 • Designing with AI 2025
Gold
Frances Yllana
DesignOps–Leading the Path to Parity
2023 • DesignOps Community
Jennifer Fraser
What would Emmy Noether Do? Math, Models and Mulling in UX Research
2023 • Advancing Research 2023
Gold
Savannah Carlin
Don't botch the bot: Designing interactions for AI
2024 • Designing with AI 2024
Gold

More Videos

Peter Van Dijck

"Synthetic data is useful because it’s easier to generate more examples of something you already have than to create entirely new data."

Peter Van Dijck

Building impactful AI products for design and product leaders, Part 2: Evals are your moat

July 23, 2025

Xenia Adjoubei

"The use of dovetail helps organize diverse information without losing the author’s voice or connection to original data."

Xenia Adjoubei Sean Bruce

Empowering Communities Through the Researcher in Residence Program

March 29, 2023

James Rampton

"Each hard control button in a car costs between 50 cents and 10 dollars, which adds up to millions in manufacturing costs."

James Rampton

The Basics of Automotive UX & Why Phones Are a Part of That Future

July 25, 2024

Lily Aduana

"With User Interviews, you can launch a project immediately and get your first qualified participant as fast as three hours."

Lily Aduana Savannah Hobbs Brittany Rutherford

5 Reasons to Bring Your Recruiting in-House (and How To Do It)

March 12, 2021

Kayla Farrell

"I want to grow as a researcher by trying different environments and building new research muscles."

Kayla Farrell Chelsey Glasson Sean Fitzell Jared LeClerc

What It's Like To Be a User Researcher at Compass

March 12, 2021

Kate Kalcevich

"I recommend asking about user needs rather than disability, like whether someone needs captions or larger fonts."

Kate Kalcevich

Integrating Accessibility in DesignOps

September 23, 2024

Ovetta Sampson

"Our role as designers and researchers will be to determine what not to design to preserve human culture and values."

Ovetta Sampson

Research in the Automated Future

March 11, 2022

Deanna Mitchell

"Culture is the stories that we tell both ourselves and other people about who we are."

Deanna Mitchell

Designing with culture: Unlocking impactful insights for Product and UX

March 12, 2025

Ren Pope

"Knowledge is not only intended for human consumption, it is meant for human action."

Ren Pope

Building Experiences for Knowledge Systems

June 6, 2023