Scale Smart: AI-Powered Content Organization Strategies
Summary
It's a task well-suited for generative AI. Large language models have powerful capabilities that can help teams keep content organized at scale. Using LLMs in this capacity can lead to better user experiences and free team members to focus on more valuable efforts.
This presentation explores two approaches for using LLMs to organize content at scale: 1) re-categorizing content using existing categories and 2) developing new categories from existing content. Both will be shown as proofs of concept alongside feasible next steps.
Key Insights
-
•
Maintaining organized large content repositories is often deprioritized despite evolving product portfolios, leading to reduced findability.
-
•
Search alone is insufficient for large repositories because users often lack context about what content exists.
-
•
Evolving taxonomies require periodic retagging of older content to keep it relevant and findable.
-
•
AI, specifically large language models like GPT-4, can automate taxonomy maintenance tasks significantly faster than humans.
-
•
Human oversight is critical to review AI-suggested tags to prevent hallucinations and ensure quality.
-
•
Developing new taxonomies requires analyzing content holistically, which exceeds typical LLM context windows.
-
•
Embedding databases help chunk and relate content statistically for clustering similar topics at scale.
-
•
Graph Retrieval Augmented Generation (Graph RAG) integrates knowledge graphs with LLMs to increase precision by leveraging semantic relationships.
-
•
RAG enables querying domain-specific content unseen by generic LLM training data, supporting bespoke AI assistants.
-
•
AI tools enable higher speed and new methods for content work but require new workflows and ongoing experimentation.
Notable Quotes
"Keeping large content repositories organized is an ongoing challenge that often gets deprioritized."
"Search alone doesn’t cut it, particularly when people don’t know what they’re looking for or lack context."
"If organizations don’t keep content organized, it becomes less usable and less useful over time."
"Large language models can help organize content faster and at much larger scale than people can."
"I used GPT-4 to retag 1,200 blog posts, reducing an estimated 10–12 hours of tedious manual work to about a third of that time."
"I made sure the LLM would only use terms from my predefined taxonomy, but it still introduced some of its own tags."
"Working with these tools requires new workflows and checkpoints to validate and tweak the AI's output."
"Graph RAG uses knowledge graphs instead of just plain text snippets, which really improves precision."
"I see these AI tools as augmenting human work, letting us focus on what matters most, not replacing humans."
"The best way to understand these technologies is to learn them hands-on, especially if your work involves language or taxonomies."
Or choose a question:
More Videos
"UX really doesn’t have a seat at the table yet and that has some implications for us."
Rich MironovHow Can Product Managers and UXers Help Each Other (and Why are Product Folks so Annoying Sometimes)?
December 6, 2022
"I often find myself wondering what I really gained from time away from my desk beyond swag and catching up with colleagues."
Bria AlexanderTheme Two Intro
October 3, 2023
"When we pivoted because of business decisions, we felt anxious but kept adapting together."
Ruzanna RozmanGetting in Flow with Your Team
January 8, 2024
"An ops-focused discussion guide helps us gather feedback from leadership and designers so our recommendations meet their needs."
Briana Thomas Christina RodriguezWhen Design Ops Comes in H.O.T. : A Tale of a Transformed Design Org
September 30, 2021
"Veterans don’t use the internet was the common excuse we heard, but that was simply not true."
Marina MartinLives on the Line: The Stakes of UX at the Scale of Government
June 14, 2018
"Insight summaries create durable knowledge that only goes away when it's been resolved or no longer relevant."
Jake BurghardtStop wasting research: Create new value with insight summaries
July 9, 2025
"Research is actually a sales role – you have to show off a little to get buy-in from the top."
Clemens Janssen Jane DavisEfficiently Scaling Research as a Team of One
March 28, 2023
"Customers can’t buy products they can’t find, and often that’s because product content isn’t related to non-product content."
Bram WesselEnterprise Information Architecture
January 10, 2020
"The title of the talk is a misnomer: this work isn't actually that fast and shouldn't be done without fear of consequences."
Kaitlin TaskerFast and Fearless Inclusive Research
March 27, 2023
Latest Books All books
Dig deeper with the Rosenbot
Who are natural allies for healthcare UX professionals inside complex healthcare systems, and how do you engage them?
How can I use an AI chatbot like Rosenbot to get quick answers on UX and product design topics?
How do multiple perspectives in a story affect the way researchers analyze and present findings?