Rosenverse
Latent Scope: Finding structure in unstructured data

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Latent Scope: Finding structure in unstructured data

Gold
Wednesday, June 11, 2025 • Designing with AI 2025

This video is featured in the Designing with AI 2025 playlist and 1 more.

Share the love for this talk
Latent Scope: Finding structure in unstructured data
Speakers: Ian Johnson
Link:

Summary

As a data visualization designer and developer the challenge I often face is what to do with unstructured data. One case study I can show is exploring survey results where the multiple-choice questions are straightforward to analyze but interesting open-ended questions like “What do your colleagues not understand about data visualization?” are much harder to crack.

Latent Scope is an open-source tool I built that streamlines a process of embedding text, mapping it to 2D, clustering the data points on the map and summarizing those clusters with an LLM. Once the process is done on a dataset structure emerges from the unstructured text, allowing us to get a sense of patterns in the survey answers. Themes like “the time it takes” to develop data visualization pop out, as do “the importance of good design.” While people don’t use the same language to describe these themes, they show up as clusters in the tool thanks to the power of embedding models.

https://github.com/enjalot/latent-scope

Key Insights

  • •

    AI embeddings transform unstructured data like text or sketches into high-dimensional vectors capturing hidden semantic patterns.

  • •

    Dimensionality reduction algorithms map these high-dimensional embeddings into 2D clusters, making patterns visually accessible.

  • •

    Free text survey responses, often too large to analyze manually, can be organized and explored effectively through embedding and clustering.

  • •

    Google Cloud user journey data revealed surprising usage patterns, like enterprise and beginner tools being combined unexpectedly.

  • •

    Simple rule-based filters for harmful prompts in generative AI image models can be bypassed by subtle prompt variations; embedding-based classifiers are more effective.

  • •

    Latent Scope is an open source tool enabling non-technical users to embed, cluster, label, and visualize unstructured text data locally.

  • •

    Local runs of embedding and clustering models on modest hardware are practical, preserving data privacy and sensitive user information.

  • •

    Embedding models trained on multilingual data can cluster semantically similar texts across diverse languages in one shared space.

  • •

    Breaking long text into smaller chunks can make embeddings more manageable and improve similarity comparisons.

  • •

    Hands-on exploration of embedding models via platforms like Hugging Face helps users internalize concepts of semantic similarity and pattern discovery.

Notable Quotes

"People just don't get that the design and the process is fundamental."

"Similar inputs will produce similar high dimensional numbers."

"Dimensionality reduction algorithms take data points in high dimensional space and put them close together in 2D if they're similar."

"We found patterns that product teams didn’t expect or even want to look for."

"Simple word-list based filters can easily be tricked by misspellings or slight variations in prompts."

"What if you didn’t know there were important questions you should be asking in your data?"

"Latent Scope lets you quickly explore hundreds or thousands of free text responses to find clusters and patterns."

"You don’t need special hardware; these open source models can run locally on an M1 MacBook or a gaming machine."

"Multilingual embedding models can cluster similar meanings across languages in a shared latent space."

"Downloading and playing with local open source models gives a different experience than using faceless APIs mediated through interfaces."

Ask the Rosenbot
Noel Lamb
Cultivating Business Partnerships to Grow Research Ops
2022 • Advancing Research Community
Peter Merholz
The Trials and Tribulations of Directors of UX
2023 • Enterprise Community
Anna Avrekh
Expert Panel: Leading in and with Research
2022 • Advancing Research 2022
Gold
Peter Merholz
Customer-Centered Design Organizations
2017 • Enterprise Experience 2017
Gold
Emily Lessard
RFPs Without Tears: Writing Inclusive RFPS that Don't Scare Away Talent
2021 • Civic Design 2021
Gold
Dharani Perera
The mandala of service design: unlocking alignment and action through service design
2025 • Advancing Service Design 2025
Gold
Susan Weinschenk
Evaluating the Maturity of UX in Your Organization
2020 • Enterprise Community
Daniel J. Rosenberg
Designing with and for Artificial Intelligence
2022 • Enterprise Community
Johnny Michaelsen
Measure Behaviors, Not Results
2026 • Rosenfeld Community
Jackie Ho
Lead Effectively While Preserving Team Autonomy with Growth Boards
2024 • Enterprise Experience 2020
Gold
Steve Portigal
Looking Back…to Look Ahead
2024 • Advancing Research 2024
Gold
Johanna Kollmann
Insights-Driven Product Strategy: Get your Research to Count
2022 • Design in Product 2022
Gold
Deanna Mitchell
Designing with culture: Unlocking impactful insights for Product and UX
2025 • Advancing Research 2025
Gold
Charlotte Vorbeck
Pipeline to Civic Design
2021 • Civic Design 2021
Gold
Maggie Dieringer
Creating Consistency Through Constant Change
2024 • DesignOps Summit 2020
Gold
Renee Bouwens
Landing Product Impact: Aligning Research as a Foundational Driver for Delivering the World’s Best Products
2023 • QuantQual Interest Group

More Videos

Dave Malouf

"We have do’s and don’ts, but approaching it from a rules-based perspective just reduces buy-in."

Dave Malouf Amy Thibodeau

Panel: Design Systems and Documentation

November 7, 2017

John Donmoyer

"One of the most important questions before starting is what tools do I have to work with."

John Donmoyer

Shipping your code generation experiments to production

June 11, 2025

Clara Kliman-Silver

"Novice users can try things out thanks to automation, but experts can focus on the challenging and creative pieces."

Clara Kliman-Silver

UX Futures: The Role of Artificial Intelligence in Design

June 7, 2023

Mark Templeton

"The post-PC era has had more impact on enterprise UX and computing than any other factor in all history."

Mark Templeton

Creating a Legacy: the ultimate experience

June 9, 2017

Sarah Gallimore

"Every parent we talked to had some variation of the question: this exists, can I use it right now? Where was this when I needed to apply?"

Sarah Gallimore

Inspire Progress with Artifacts from the Future

November 18, 2022

Sam Proulx

"When you magnify prototypes, they may look blurry, but that’s something to fix in the final website design."

Sam Proulx

Prototype Reviews, People With Disabilities, and You

December 8, 2021

Anna Nguyen

"Our monthly voice of the customer reports we call Stories in Dovetail; we share them with the team every month."

Anna Nguyen Emily Brogan

Why Our Voice of the Customer is Better Than Yours

March 10, 2022

Anna Poznyakov

"Unmoderated tools can achieve 100% completion rates and rapid insights if designed thoughtfully."

Anna Poznyakov Richa Prajapati

Get The Most Out Of Stakeholder Collaboration—and Maximize Your Research Impact

March 12, 2021

Nalini P. Kotamraju

"I don’t exactly even know who I am if not a researcher."

Nalini P. Kotamraju

Two Jobs in One: Being a “Leader who is a Researcher” and a “Researcher who is a Leader"

March 10, 2021