Rosenverse
Coffee with Lou #4: Taking a Peek Under the Rosenbot's Hood

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Coffee with Lou #4: Taking a Peek Under the Rosenbot's Hood

Friday, June 14, 2024 • Rosenfeld Community
Share the love for this talk
Coffee with Lou #4: Taking a Peek Under the Rosenbot's Hood
Speakers: Peter Van Dijck and Louis Rosenfeld
Link:

Summary

What happens when you cross an eager librarian, a happy puppy, and 800 UX experts? You get the Rosenbot—Rosenfeld's new GPT-4 level chatbot, trained on our books and hundreds of hours of conference and community call recordings. What went into creating the Rosenbot? Lou is joined by SimplyPut's Peter van Dijck, an old friend from the IA community and the chief architect of the Rosenbot. If you're beginning your journey into developing generative AI products, you'll want to join Lou and Peter to learn from their lessons, ask questions, and share your own thoughts on AI's role in making curated content more useful and impactful.

Key Insights

  • The Rosen bot uses curated, high-quality content from Rosenfeld Media to avoid common pitfalls of enterprise chatbots operating on messy internal data.

  • Significant project resources, around 30-50%, must be devoted to evaluation combining user tests, expert reviews, and repeatable automated metrics.

  • The chatbot intentionally avoids summarizing entire books to prevent cannibalizing book sales, instead acting as an entry point to authors’ original work.

  • Users and researchers often don’t know how they will use AI tools initially; the use cases evolve through interaction with the technology.

  • Building AI conversational agents requires embedding follow-up questions and memory simulation into the interaction design beyond a basic large language model.

  • Semantic search and topic analytics behind the scenes enable insights about conversation content trends and authors' influence in real time.

  • Balancing fresh, current content with older foundational material is challenging since methodologies and societal norms continually evolve.

  • There is a tension between jumping in to build and learn quickly versus cautious, deliberate product development; both parties in the talk appreciate different approaches.

  • Interactive UI elements like expandable answers and filters for broadening or narrowing responses are planned to enhance the conversational interface.

  • The Rosen bot acts as a creative companion and research assistant, helping accelerate idea exploration and uncover relevant historic knowledge efficiently.

Notable Quotes

"If you don’t jump in and learn, you’ll spend your time reading stuff on it and not really understand the tech."

"People forget the expertise every seven years and have to learn everything again—this bot helps make that expertise accessible."

"The content behind this bot is curated and high quality, unlike the typical confusing, outdated information in corporate repositories."

"We devote 30 to 50 percent of the project time just on evaluation with real users and experts to ensure quality and safety."

"The bot doesn’t summarize books because we’re a publisher and don’t want to cannibalize book sales—it points users to the original sources."

"We’re building in the attribution of ideas to authors and speakers, emphasizing the humans behind the expertise."

"Chatbots aren’t just the language model—they have structure around intent classification, safety checks, and session memory simulation."

"Sometimes you have to build stuff and learn from it rather than wait for the perfect moment or tools."

"AI in design can act as a creative companion, helping explore ideas and analyze past research more efficiently."

"The product is imperfect, probably about 60 percent there, but if we get to 80 percent it will be a compelling tool for UX content."

Ask the Rosenbot
Kat Vellos
Opener: The Other L Word
2024 • DesignOps Summit 2020
Gold
Emily Danielson
“I mean, I can lift a shovel”: Design Skills in Disaster Response
2022 • Design at Scale 2022
Gold
Jon White
Unsticking Research for Better Information Flow
2026 • Advancing Research 2026
Gold
Sam Proulx
Designing For Screen Readers: Understanding the Mental Models and Techniques of Real Users
2021 • DesignOps Summit 2021
Gold
Christopher Taylor Edwards
Design as a Team Practice, A Practical Guide to Cross-functional Collaboration
2021 • DesignOps Summit 2021
Gold
Jacqui Frey
Setting the Table for Dynamic Change
2019 • DesignOps Summit 2019
Gold
Ryan Matthew
DesignOps without Boundaries: Building More with What You Have
2025 • DesignOps Summit 2025
Gold
Christian Bason
Expand—Rethinking Design for Public Challenges
2022 • Civic Design Community
Fisayo Osilaja
[Demo] The AI edge: From researcher to strategist
2024 • Designing with AI 2024
Gold
Abbey Smalley
Today’s Design Ops and Programs Landscape & Career Paths
2023 • DesignOps Summit 2023
Gold
Joanna Vodopivec
One Research Team for All - Influence Without Authority
2022 • Advancing Research 2022
Gold
Shipra Kayan
How Tess Dixon Facilitates Team Engagement and Collaboration at Condé Nast Using Miro 
2021 • DesignOps Summit 2021
Gold
Patrizia Bertini
Pushing DesignOps’ Influence into New Global Markets
2022 • DesignOps Summit 2022
Gold
Sarah Barrett
AI in Real Life: Using LLMs to Turbocharge Microsoft Learn
2025 • Rosenfeld Community
Jemma Ahmed
Theme 1 Intro
2026 • Advancing Research 2026
Gold
Angelos Arnis
Navigating the Rapid Shifts in Tech's Turbulent Terrain
2023 • DesignOps Summit 2023
Gold

More Videos

Jerome “Axle” Brown

"Sometimes the loudest voices dominate, but asynchronous collaboration helps give quieter voices a chance to speak."

Jerome “Axle” Brown

How to Use Self-Directed Learning to Ensure Your Research Insights are Heard and Acted Upon

March 11, 2021

Phil Gilbert

"Design thinking is the scientific method for the 21st century."

Phil Gilbert

A Consistent Culture of Design

May 14, 2015

Kate Towsey

"As more software is being built for specific personas, precise participant targeting becomes more important over time."

Kate Towsey Basel Fakhoury Oren Friedman Graham Gardner

Participant Recruitment and Management Tools

March 12, 2026

Sohit Karol

"There hasn’t been a better time to be a user researcher, especially in machine learning enabled experiences."

Sohit Karol

Designing Delightful Listening Experiences: Mixed Methods Research in the Age of Machine Learning

March 31, 2020

Christopher Taylor Edwards

"Pairing isn't about taking away jobs; it's about amplifying everyone's expertise and breaking down hierarchy."

Christopher Taylor Edwards Valerie Roske

Design as a Team Practice, A Practical Guide to Cross-functional Collaboration

September 30, 2021

Sheryl Cababa

"By myopically focusing on a single part, people are unable to see the elephant in the room."

Sheryl Cababa

Expanding Your Design Lens with Systems Thinking

February 23, 2023

Francesca Barrientos, PhD

"Team members told me they felt really seen for the first time during these discussions."

Francesca Barrientos, PhD

You Need Your Own Definition of Design Maturity

June 8, 2022

Allison Sanders

"Mentoring new hires actually reignites the mentor’s own passion for their work."

Allison Sanders

Operating with Purpose

January 8, 2024

Saara Kamppari-Miller

"If we had pulled something off the internet, half the time would be spent on critique."

Saara Kamppari-Miller

"Prototype" vs "Prototype"--Breaking Down and Rebuilding Our Understanding of What We Do

October 24, 2019