Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Scale Smart: AI-Powered Content Organization Strategies

Gold
Tuesday, September 24, 2024 • DesignOps Summit 2024
Share the love for this talk
Scale Smart: AI-Powered Content Organization Strategies
Speakers: Jorge Arango
Link:

Summary

Keeping large content repositories organized is an ongoing challenge. There's always new stuff coming in, and taxonomies evolve over time. Resource-strapped teams seldom have opportunities to re-categorize older content. It's a task well-suited for generative AI. Large language models have powerful capabilities that can help teams keep content organized at scale. Using LLMs in this capacity can lead to better user experiences and free team members to focus on more valuable efforts. This presentation explores two approaches for using LLMs to organize content at scale: 1) re-categorizing content using existing categories and 2) developing new categories from existing content. Both will be shown as proofs of concept alongside feasible next steps.

Key Insights

  • Maintaining organized large content repositories is often deprioritized despite evolving product portfolios, leading to reduced findability.

  • Search alone is insufficient for large repositories because users often lack context about what content exists.

  • Evolving taxonomies require periodic retagging of older content to keep it relevant and findable.

  • AI, specifically large language models like GPT-4, can automate taxonomy maintenance tasks significantly faster than humans.

  • Human oversight is critical to review AI-suggested tags to prevent hallucinations and ensure quality.

  • Developing new taxonomies requires analyzing content holistically, which exceeds typical LLM context windows.

  • Embedding databases help chunk and relate content statistically for clustering similar topics at scale.

  • Graph Retrieval Augmented Generation (Graph RAG) integrates knowledge graphs with LLMs to increase precision by leveraging semantic relationships.

  • RAG enables querying domain-specific content unseen by generic LLM training data, supporting bespoke AI assistants.

  • AI tools enable higher speed and new methods for content work but require new workflows and ongoing experimentation.

Notable Quotes

"Keeping large content repositories organized is an ongoing challenge that often gets deprioritized."

"Search alone doesn’t cut it, particularly when people don’t know what they’re looking for or lack context."

"If organizations don’t keep content organized, it becomes less usable and less useful over time."

"Large language models can help organize content faster and at much larger scale than people can."

"I used GPT-4 to retag 1,200 blog posts, reducing an estimated 10–12 hours of tedious manual work to about a third of that time."

"I made sure the LLM would only use terms from my predefined taxonomy, but it still introduced some of its own tags."

"Working with these tools requires new workflows and checkpoints to validate and tweak the AI's output."

"Graph RAG uses knowledge graphs instead of just plain text snippets, which really improves precision."

"I see these AI tools as augmenting human work, letting us focus on what matters most, not replacing humans."

"The best way to understand these technologies is to learn them hands-on, especially if your work involves language or taxonomies."

Ask the Rosenbot
Uday Gajendar
Leading through the long tail of trauma
2022 • Advancing Research Community
Ilana Lipsett
Anticipating Risk, Regulating Tech: A Playbook for Ethical Technology Governance
2021 • Civic Design 2021
Gold
Sha Hwang
The First Fifty Years of Civic Design
2022 • Civic Design 2022
Gold
Josh Clark
Sentient Design: New Postures for AI-Mediated Experiences (2nd of 3 seminars)
2025 • Rosenfeld Community
Anna Poznyakov
Get The Most Out Of Stakeholder Collaboration—and Maximize Your Research Impact
2021 • Advancing Research 2021
Gold
Crystal Philcox
The Many Faces of Operations
2017 • DesignOps Summit 2017
Gold
Paula Bach
Improving Legacy Software: How Much Better Does it Have to Be?
2022 • Advancing Research 2022
Gold
James Rampton
The Basics of Automotive UX & Why Phones Are a Part of That Future
2024 • Rosenfeld Community
Ariel Kennan
Building a Design Culture
2017 • Enterprise Experience 2017
Gold
Emily DiLeo
Stronger Together: Lessons Learned from UX Research Ops
2024 • DesignOps Summit 2024
Gold
Bria Alexander
Opening Remarks
2022 • DesignOps Summit 2022
Gold
Lori Muszynski
Keeping Design Weird
2023 • DesignOps Summit 2023
Gold
Tara Tressel
Investigating qualitative depth of AI-moderated interviews
2026 • Advancing Research 2026
Gold
How to Identify and Increase your "Experience Quotient"
2018 • Enterprise Experience 2018
Gold
Lukas Moro
“Feels Like Paper!”: Interfacing AI through Paper
2025 • Designing with AI 2025
Gold
Alissa Briggs
How to Coach Enterprise Experimentation
2015 • Enterprise UX 2015
Gold

More Videos

Eric Shumake

"The integration of AI into clinical workflows is creating urgent demand for sharper UX thinking, not less."

Eric Shumake

Diagnosis UX: Building Influence in Healthcare Design

April 9, 2026

Kit Unger

"Service design is very up-and-coming, but there’s still a long way to go in thinking about the entire user journey."

Kit Unger Jackie Ho Veevi Rosenstein Vasileios Xanthopoulos

Theme 2: Discussion

January 8, 2024

Chris Geison

"The existing insights repositories aren’t engaging other parts of the organization effectively."

Chris Geison Dr. Jamika D. Burge Jemma Ahmed

What's Next for Research?

June 17, 2021

Megan Blocker

"Ethics isn’t just about empathy during research, it’s every step where humans are involved."

Megan Blocker Marieke McCloskey Renee Reid

Positioning insight: Structuring teams, roles and careers for a changing research landscape

March 13, 2025

Jules Monza

"Consistency is key in large organizations to make sure you’re measuring the same things and talking about them the same way."

Jules Monza

Use These Words and Count These Things

September 25, 2024

Ruzanna Rozman

"Developing team flow is a lot like dating—you have to nurture it, build instinct, and practice."

Ruzanna Rozman

Getting in Flow with Your Team

January 8, 2024

Uday Gajendar

"Am I getting what I wanna get out of this conference? What’s not coming and what would I still like to learn?"

Uday Gajendar Louis Rosenfeld

Day 2 Welcome

June 5, 2024

Lavy Kumar

"It doesn’t matter when work is done, so long as it’s done and its quality."

Lavy Kumar Kat Temple Shan Sebastian Tara Jensen Jenn Chou

Future of Work

June 9, 2021

Dave Malouf

"Collaboration is working together; coordination is doing separate parts and then syncing up later."

Dave Malouf

Closing Keynote: Amplify. Not Optimize.

October 24, 2019