Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Atomizing Research: Trend or Trap
Gold
Monday, March 30, 2020 • Advancing Research 2020
Share the love for this talk
Atomizing Research: Trend or Trap
Speakers: Matt Duignan
Link:

Summary

There has been an explosion of interest in atomizing research, where researchers stop writing reports and instead tag individual insights in a database. The theory is that this will unlock your insights, making them findable and reusable. But does it work, and should you be doing the same? At Microsoft we tried it: Five years, 40,000 insights, 20+ research teams, and 17,000 unique users. So what have we learnt? We learnt that a structured insight library can be worth the effort. But we also learnt that atomizing insight can be taken too far. We learnt that context is critical. We learnt that short term efficiency is king, and that the required culture change is hard. And through this journey we’ve begun to discover how to blend atomized insight with your traditional research process.

Key Insights

  • Conventional research repositories often become dumping grounds where insights go to die, making reuse difficult.

  • Focusing on atomic insights — individual findings rather than entire reports — enables better indexing, linking, and reuse of research knowledge.

  • Durable insights emerge by connecting related observations across times, contexts, teams, and products, creating a living knowledge network.

  • Separating raw observations and durable insights into strict categories can hinder insight creation; durability is better inferred via reference and use patterns.

  • Human cognitive biases like hyperbolic discounting and in-group bias work against the effort to create reusable insights.

  • Researchers gain more motivation if reusable insight creation provides immediate tactical value and fits naturally into their workflow.

  • Deep linking insights down to atomic facts within reports improves trust, transparency, and communication among designers and PMs.

  • Maintaining older research data while marking superseded insights preserves context and historical perspective for conflicting findings.

  • A cultural shift and explicit prioritization by management is critical to sustain continuous curation practices for durable research knowledge.

  • The just-in-time curation approach folds reusable knowledge creation into daily research activities via tactical value, effortless connection, and inferred durability principles.

Notable Quotes

"Is your research repository a place where your presentations and reports go to die?"

"What if the atomic unit of research wasn’t the report, but the insight within those reports?"

"Creating a culture of continuous curation is super important, but it’s also super hard."

"Researchers want immediate gratification; reusable, durable insight creation asks them to defer that gratification."

"Reusable insights are the gifts that keep on giving, but they take longer to prepare and digest."

"Product teams often want quick, grab-and-go research results and not durable abstract insights."

"Treating each insight as a standalone database entry destroys the researcher’s ability to tell a narrative."

"Linking not just to a report, but to a fact inside a report is super keen to this approach."

"We can let durable insights emerge organically based on their use and reference patterns in the system."

"Do you and your organization have the energy to overcome the cultural and technical challenges pulling your researchers back towards the main corner?"

Ask the Rosenbot
Justin Entzminger
Risk and Reward: How to Diversify the Field of Civic Innovators and Designers
2022 • Civic Design 2022
Gold
Bria Alexander
Charting the future of DesignOps: A community workshop (Videoconference)
2024 • DesignOps Community
Elizabeth Churchill
Exploring Cadence: You, Your Team, and Your Enterprise
2017 • Enterprise Experience 2017
Gold
Dane DeSutter
Keeping the Body in Mind: What Gestures and Embodied Actions Tell You That Users May Not
2024 • Advancing Research 2024
Gold
Kristin Wisnewski
Measuring What Matters
2019 • DesignOps Summit 2019
Gold
Maish Nichani
Sparking a Service Excellence Mindset at a Government Agency
2021 • Civic Design 2021
Gold
Tim Parmee
Changing Our Design Pressure Points
2023 • DesignOps Summit 2023
Gold
Ana Maria Montero Barrantes
The Authentic UX Talent Show
2024 • Enterprise Experience 2020
Gold
Denise Jacobs
Interactive Keynote: Social Change by Design
2024 • Enterprise Experience 2020
Gold
Alla Weinberg
Workers Are Sick of Change: The Cure is Psychological Safety
2023 • Enterprise UX 2023
Gold
Christian Crumlish
Afternoon Insights Panel
2022 • Design in Product 2022
Gold
Louis Rosenfeld
Welcome / Housekeeping
2023 • Enterprise UX 2023
Gold
Kat Vellos
Opener: The Other L Word
2024 • DesignOps Summit 2020
Gold
Maria Skaaden
Panel Discussion: Methodologies and Work Environments
2018 • DesignOps Summit 2018
Gold
Bob Baxley
Leading with Design Operations Past and Present (Videoconference)
2019 • DesignOps Community
Louis Rosenfeld
Opening Remarks
2022 • Civic Design 2022
Gold

More Videos

Adam Cutler

"The hardest part about remote is making design reviews feel collaborative and team-based."

Adam Cutler Karen Pascoe Ian Swinson Susan Worthman

Discussion

June 8, 2016

Peter Merholz

"Sometimes the director is the most senior design person in the org and ends up playing the executive role without the title or support."

Peter Merholz

The Trials and Tribulations of Directors of UX (Videoconference)

July 13, 2023

Lisa Welchman

"If you don’t tune it properly, sometimes you just don’t get what you want."

Lisa Welchman

Cleaning Up Our Mess: Digital Governance for Designers

June 14, 2018

Vincent Brathwaite

"Sustainable practices are not just a luxury; they are a necessity for our survival."

Vincent Brathwaite

Opener: Past, Present, and Future—Closing the Racial Divide in Design Teams

October 22, 2020

Brenna Fallon

"The greatest sign of success for a teacher is just to be able to say the children are now working as if I did not exist."

Brenna Fallon

Learning Over Outcomes

October 24, 2019

Tricia Wang

"Factory owners manipulated people’s time so much that workers were afraid to carry a watch."

Tricia Wang

Spatial Collapse: Designing for Emergent Culture

January 8, 2024

Edgar Anzaldua Moreno

"Proto personas created by cross-department participants helped us build unbiased, relevant survey questions."

Edgar Anzaldua Moreno

Using Research to Determine Unique Value Proposition

March 11, 2021

"Service lines bridge the gaps between product lines through information flows to provide the right knowledge at the right time."

Designing Systems at Scale

November 7, 2018

Erin Weigel

"The conversion design process creates collective knowledge, which gets reinfused to strengthen future experiments."

Erin Weigel

Get Your Whole Team Testing to Design for Impact

July 24, 2024