Rosenverse
Coffee with Lou #4: Taking a Peek Under the Rosenbot's Hood

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Coffee with Lou #4: Taking a Peek Under the Rosenbot's Hood

Friday, June 14, 2024 • Rosenfeld Community
Share the love for this talk
Coffee with Lou #4: Taking a Peek Under the Rosenbot's Hood
Speakers: Peter Van Dijck and Louis Rosenfeld
Link:

Summary

What happens when you cross an eager librarian, a happy puppy, and 800 UX experts? You get the Rosenbot—Rosenfeld's new GPT-4 level chatbot, trained on our books and hundreds of hours of conference and community call recordings. What went into creating the Rosenbot? Lou is joined by SimplyPut's Peter van Dijck, an old friend from the IA community and the chief architect of the Rosenbot. If you're beginning your journey into developing generative AI products, you'll want to join Lou and Peter to learn from their lessons, ask questions, and share your own thoughts on AI's role in making curated content more useful and impactful.

Key Insights

  • •

    The Rosen bot uses curated, high-quality content from Rosenfeld Media to avoid common pitfalls of enterprise chatbots operating on messy internal data.

  • •

    Significant project resources, around 30-50%, must be devoted to evaluation combining user tests, expert reviews, and repeatable automated metrics.

  • •

    The chatbot intentionally avoids summarizing entire books to prevent cannibalizing book sales, instead acting as an entry point to authors’ original work.

  • •

    Users and researchers often don’t know how they will use AI tools initially; the use cases evolve through interaction with the technology.

  • •

    Building AI conversational agents requires embedding follow-up questions and memory simulation into the interaction design beyond a basic large language model.

  • •

    Semantic search and topic analytics behind the scenes enable insights about conversation content trends and authors' influence in real time.

  • •

    Balancing fresh, current content with older foundational material is challenging since methodologies and societal norms continually evolve.

  • •

    There is a tension between jumping in to build and learn quickly versus cautious, deliberate product development; both parties in the talk appreciate different approaches.

  • •

    Interactive UI elements like expandable answers and filters for broadening or narrowing responses are planned to enhance the conversational interface.

  • •

    The Rosen bot acts as a creative companion and research assistant, helping accelerate idea exploration and uncover relevant historic knowledge efficiently.

Notable Quotes

"If you don’t jump in and learn, you’ll spend your time reading stuff on it and not really understand the tech."

"People forget the expertise every seven years and have to learn everything again—this bot helps make that expertise accessible."

"The content behind this bot is curated and high quality, unlike the typical confusing, outdated information in corporate repositories."

"We devote 30 to 50 percent of the project time just on evaluation with real users and experts to ensure quality and safety."

"The bot doesn’t summarize books because we’re a publisher and don’t want to cannibalize book sales—it points users to the original sources."

"We’re building in the attribution of ideas to authors and speakers, emphasizing the humans behind the expertise."

"Chatbots aren’t just the language model—they have structure around intent classification, safety checks, and session memory simulation."

"Sometimes you have to build stuff and learn from it rather than wait for the perfect moment or tools."

"AI in design can act as a creative companion, helping explore ideas and analyze past research more efficiently."

"The product is imperfect, probably about 60 percent there, but if we get to 80 percent it will be a compelling tool for UX content."

Ask the Rosenbot
Miles Orkin
Creativity and Culture
2018 • DesignOps Summit 2018
Gold
Anna Avrekh
Diversity In and For Design: Building Conscious Diversity in Design and Research
2021 • Design at Scale 2021
Gold
Tiffany Cheng
Designing in a Pandemic: Integrating Speed and Rigor
2022 • Design at Scale 2022
Gold
Michelle Morrison
Culture Design
2020 • DesignOps Community
Sam Proulx
Understanding Screen Readers on Mobile: How And Why to Learn from Native Users
2023 • Enterprise UX 2023
Gold
World Usability Day Panel Discussion
2022 • DesignOps Community
Dave Hoffer
UX Job Search AMA #2 with Joanne Weaver and Dave Hoffer
2025 • Rosenfeld Community
Bud Caddell
DesignOps Community Sensing Session
2021 • DesignOps Community
Bria Alexander
Theme Two Intro
2023 • DesignOps Summit 2023
Gold
Bria Alexander
Day 3 Welcome
2024 • DesignOps Summit 2024
Gold
John Mortimer
Panel Discussion
2024 • Advancing Service Design 2024
Gold
Theresa Slate
Why Changing Hearts & Minds Doesn’t Work When Promoting DE&I Efforts, but Checklists Do
2023 • DesignOps Summit 2023
Gold
Christian Rohrer
Insight Types That Influence Enterprise Decision Makers
2015 • Enterprise UX 2015
Gold
Andrea Gallagher
The Problem Space
2019 • Advancing Research Community
Alexis Lucio
Scaling Accessibility Through Design Systems
2022 • Design at Scale 2022
Gold
Alexia Cohen
Increasing Health Equity and Improving the Service Experience for Under-Served Latine Communities in Arizona
2024 • Advancing Service Design 2024
Gold

More Videos

Jorge Arango

"I wouldn’t want AI to think for me; these tools are to help me grow, not replace my thinking."

Jorge Arango

AI as Thought Partner: How to Use LLMs to Transform Your Notes (3rd of 3 seminars)

May 3, 2024

John Paul de Guzman

"Spending more time doesn’t automatically make you productive, it just means you spent more time doing things."

John Paul de Guzman

10k Screens Later: How We Became a Data-Driven Design Organization

September 24, 2024

Sean McKay

"Product operations serve as the binding agent to enable teams and processes to work seamlessly together."

Sean McKay

Whole Product Thinking: Expanding beyond problem and solution space thinking

March 14, 2024

Megan Clegg

"Accessibility education embedded in onboarding and ongoing training builds organizational muscle."

Megan Clegg Michael Haggerty-Villa Alexis Morin

Space for Everyone: Reframing Accessibility Through a Wider Lens

June 10, 2021

Bria Alexander

"Working on a different word than empower: People already have power, we have to respect it."

Bria Alexander Ariel Kennan Charlotte Lee Sarah Brooks Emily Lessard Gordon Ross Joanne Dong

Reflect and Chart Forward

December 10, 2021

Kurdin Bazaz

"The people here want to be here. They want the company and customers to succeed and to change the world."

Kurdin Bazaz Liz Rytting Alex Karr

Culture, DIBS & Recruiting

June 10, 2021

Kayla Farrell

"Agents often have fascinating second or third career backgrounds that unlock deeper research insights."

Kayla Farrell Chelsey Glasson Sean Fitzell Jared LeClerc

What It's Like To Be a User Researcher at Compass

March 12, 2021

Gina Mendolia

"Small feedback comments like, 'Hey, how’s that going?' keep the momentum alive in addition to structured meetings."

Gina Mendolia Jasmine Toy

Coordinated collaboration: a Service Design & DesignOps love story

November 19, 2025

Erin Weigel

"We are the shopkeepers of today; it just looks a little bit different."

Erin Weigel

Real-world lessons to improve your conversion rates

June 26, 2024