Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Scale Smart: AI-Powered Content Organization Strategies

Gold
Tuesday, September 24, 2024 • DesignOps Summit 2024
Share the love for this talk
Scale Smart: AI-Powered Content Organization Strategies
Speakers: Jorge Arango
Link:

Summary

Keeping large content repositories organized is an ongoing challenge. There's always new stuff coming in, and taxonomies evolve over time. Resource-strapped teams seldom have opportunities to re-categorize older content. It's a task well-suited for generative AI. Large language models have powerful capabilities that can help teams keep content organized at scale. Using LLMs in this capacity can lead to better user experiences and free team members to focus on more valuable efforts. This presentation explores two approaches for using LLMs to organize content at scale: 1) re-categorizing content using existing categories and 2) developing new categories from existing content. Both will be shown as proofs of concept alongside feasible next steps.

Key Insights

  • Maintaining organized large content repositories is often deprioritized despite evolving product portfolios, leading to reduced findability.

  • Search alone is insufficient for large repositories because users often lack context about what content exists.

  • Evolving taxonomies require periodic retagging of older content to keep it relevant and findable.

  • AI, specifically large language models like GPT-4, can automate taxonomy maintenance tasks significantly faster than humans.

  • Human oversight is critical to review AI-suggested tags to prevent hallucinations and ensure quality.

  • Developing new taxonomies requires analyzing content holistically, which exceeds typical LLM context windows.

  • Embedding databases help chunk and relate content statistically for clustering similar topics at scale.

  • Graph Retrieval Augmented Generation (Graph RAG) integrates knowledge graphs with LLMs to increase precision by leveraging semantic relationships.

  • RAG enables querying domain-specific content unseen by generic LLM training data, supporting bespoke AI assistants.

  • AI tools enable higher speed and new methods for content work but require new workflows and ongoing experimentation.

Notable Quotes

"Keeping large content repositories organized is an ongoing challenge that often gets deprioritized."

"Search alone doesn’t cut it, particularly when people don’t know what they’re looking for or lack context."

"If organizations don’t keep content organized, it becomes less usable and less useful over time."

"Large language models can help organize content faster and at much larger scale than people can."

"I used GPT-4 to retag 1,200 blog posts, reducing an estimated 10–12 hours of tedious manual work to about a third of that time."

"I made sure the LLM would only use terms from my predefined taxonomy, but it still introduced some of its own tags."

"Working with these tools requires new workflows and checkpoints to validate and tweak the AI's output."

"Graph RAG uses knowledge graphs instead of just plain text snippets, which really improves precision."

"I see these AI tools as augmenting human work, letting us focus on what matters most, not replacing humans."

"The best way to understand these technologies is to learn them hands-on, especially if your work involves language or taxonomies."

Ask the Rosenbot
Sarah Williams
Verizon_A Framework for CX Transformation
2024 • Design at Scale 2021
Gold
Sam Proulx
To Boldly Go: The New Frontiers of Accessibility
2022 • Design at Scale 2022
Gold
Robert Fabricant
Industry junctures: Paths forwards for UXR and the critical decisions that get us there [Advancing Research Community Workshop Series]
2024 • Advancing Research Community
Erin Hoffman-John
This Game is Never Done: Design Leadership Techniques from the Video Game World
2017 • DesignOps Summit 2017
Gold
Eric Shumake
Diagnosis UX: Building Influence in Healthcare Design
2026 • Rosenfeld Community
Silke Bochat
5 Antifragile Strategies for a DesignOps 2.0
2024 • DesignOps Summit 2024
Gold
Frank Duran
Partnership Playbook: Lessons Learned in Effective Partnership
2024 • Enterprise Experience 2020
Gold
Jaskiran Kang
Why Community is Key to Professionalizing Design
2022 • Civic Design Community
Nina Jurcic
The Design System Rollercoaster: From Enabler and Bottleneck to Catalyst for Change
2023 • DesignOps Summit 2023
Gold
Amahra Spence
Designing for Liberation, Rehearsing Freedom
2022 • Civic Design 2022
Gold
Vanessa Varin
Feedback: The Other F-Word
2025 • DesignOps Summit 2025
Gold
Robin Beers
How to create actionable insight in the face of politics and silos [Advancing Research Community Workshop Series]
2023 • Advancing Research Community
Bria Alexander
Theme Two Intro
2023 • DesignOps Summit 2023
Gold
Nalini P. Kotamraju
Two Jobs in One: Being a “Leader who is a Researcher” and a “Researcher who is a Leader"
2021 • Advancing Research 2021
Gold
Peter Van Dijck
Hands on AI #3: Claude Code for UX people
2025 • Rosenfeld Community
Rebecca Gimenez
Work in Progress: Service Design at Airbnb
2024 • Advancing Service Design 2024
Gold

More Videos

Taylor Jennings

"Having a place for people to self-serve insights is really big, so they don’t ask us to repeat research."

Taylor Jennings Joe Nelson Alex Knoll

Repository Retrospective: Learnings from Introducing a Central Place for UX Research

March 9, 2022

Nicole Aleong

"Speculation fills in the gaps where past experience fails us, often seen in hesitation or pauses."

Nicole Aleong

Future Orientations to Everyday Life: Futures Anthropology as a Methodology

March 26, 2024

Jeff Gothelf

"Innovation is not a spice that you sprinkle on and suddenly magical new things come out."

Jeff Gothelf

Innovation Studios: the Engines of Enterprise Experimentation

May 14, 2015

Saara Kamppari-Miller

"By designing products through the lens of edge cases like disabilities first, they often become better products for everyone."

Saara Kamppari-Miller

DesignOps for Inclusive Design and Accessibility

May 26, 2022

Tess Dixon

"Design ops folks meet the habit of catering so much to everybody’s increasingly trivial whims that it takes us away from the real meaty ops work."

Tess Dixon

C'mon Get Happy

September 29, 2021

Liam Thurston

"When your team sees themselves in your North Star and structure, they feel safe, secure, and inspired to stay."

Liam Thurston

Why Your Design Team Is Quitting, And How To Fix It

June 10, 2022

Ian Swinson

"It’s huge to have a framework so managers and employees speak the same language around skills and growth."

Ian Swinson

Designing and Driving UX Careers

June 8, 2016

Leisa Reichelt

"If you make rules, put numbers in them, and say them confidently, sometimes people actually do them."

Leisa Reichelt

Opening Keynote: Operating in Context

November 7, 2018

Rachael Greene

"Slowing down is hard in a capitalist economy that values speed, but patience and self-care are necessary."

Rachael Greene Alison Davis

Building a Design Ops Practice that Really Works (Most of the Time)

October 2, 2025