Rosenverse
Coffee with Lou #4: Taking a Peek Under the Rosenbot's Hood

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Coffee with Lou #4: Taking a Peek Under the Rosenbot's Hood

Friday, June 14, 2024 • Rosenfeld Community
Share the love for this talk
Coffee with Lou #4: Taking a Peek Under the Rosenbot's Hood
Speakers: Peter Van Dijck and Louis Rosenfeld
Link:

Summary

What happens when you cross an eager librarian, a happy puppy, and 800 UX experts? You get the Rosenbot—Rosenfeld's new GPT-4 level chatbot, trained on our books and hundreds of hours of conference and community call recordings. What went into creating the Rosenbot? Lou is joined by SimplyPut's Peter van Dijck, an old friend from the IA community and the chief architect of the Rosenbot. If you're beginning your journey into developing generative AI products, you'll want to join Lou and Peter to learn from their lessons, ask questions, and share your own thoughts on AI's role in making curated content more useful and impactful.

Key Insights

  • The Rosen bot uses curated, high-quality content from Rosenfeld Media to avoid common pitfalls of enterprise chatbots operating on messy internal data.

  • Significant project resources, around 30-50%, must be devoted to evaluation combining user tests, expert reviews, and repeatable automated metrics.

  • The chatbot intentionally avoids summarizing entire books to prevent cannibalizing book sales, instead acting as an entry point to authors’ original work.

  • Users and researchers often don’t know how they will use AI tools initially; the use cases evolve through interaction with the technology.

  • Building AI conversational agents requires embedding follow-up questions and memory simulation into the interaction design beyond a basic large language model.

  • Semantic search and topic analytics behind the scenes enable insights about conversation content trends and authors' influence in real time.

  • Balancing fresh, current content with older foundational material is challenging since methodologies and societal norms continually evolve.

  • There is a tension between jumping in to build and learn quickly versus cautious, deliberate product development; both parties in the talk appreciate different approaches.

  • Interactive UI elements like expandable answers and filters for broadening or narrowing responses are planned to enhance the conversational interface.

  • The Rosen bot acts as a creative companion and research assistant, helping accelerate idea exploration and uncover relevant historic knowledge efficiently.

Notable Quotes

"If you don’t jump in and learn, you’ll spend your time reading stuff on it and not really understand the tech."

"People forget the expertise every seven years and have to learn everything again—this bot helps make that expertise accessible."

"The content behind this bot is curated and high quality, unlike the typical confusing, outdated information in corporate repositories."

"We devote 30 to 50 percent of the project time just on evaluation with real users and experts to ensure quality and safety."

"The bot doesn’t summarize books because we’re a publisher and don’t want to cannibalize book sales—it points users to the original sources."

"We’re building in the attribution of ideas to authors and speakers, emphasizing the humans behind the expertise."

"Chatbots aren’t just the language model—they have structure around intent classification, safety checks, and session memory simulation."

"Sometimes you have to build stuff and learn from it rather than wait for the perfect moment or tools."

"AI in design can act as a creative companion, helping explore ideas and analyze past research more efficiently."

"The product is imperfect, probably about 60 percent there, but if we get to 80 percent it will be a compelling tool for UX content."

Ask the Rosenbot
Asia Hoe
Partnering with Product: A Journey from Junior to Senior Design
2023 • Design in Product 2023
Gold
Chris Geison
What is Research Strategy?: A Panel of Research Leaders Discuss this Emergent Question
2021 • Advancing Research Community
Jemma Ahmed
Bringing together market and user research
2019 • Advancing Research Community
Jose Coronado
People First - Design at JP Morgan
2021 • Design at Scale 2021
Gold
Trisha Terhar
Empathizing with the Empowered: Non-Researcher Responses to Democratization
2022 • Advancing Research 2022
Gold
Tess Dixon
C'mon Get Happy
2021 • DesignOps Summit 2021
Gold
Matt Bernius
Learnings from Applying Trauma-Informed Principles to the Research Process
2022 • Advancing Research 2022
Gold
Brian Moss
What Does it Mean to be a Resilient Research Team?
2022 • Advancing Research 2022
Gold
Ted Neward
Theme 4: Enterprise Organizational Journey
2019 • Enterprise Experience 2019
Gold
Brad Orego
Bringing Customer Research to More Internal Teams
2022 • Advancing Research 2022
Gold
Theresa Neil
Designing for Wellness: Specializing in Healthcare
2024 • Rosenfeld Community
Craig Villamor
Design Systems for Ethical Design
2023 • Enterprise Community
Megan Blocker
Panel: Excellence in Impact
2024 • Advancing Research 2024
Gold
Panel Discussion: Communicating the Value of DesignOps
2018 • DesignOps Summit 2018
Gold
Nidhi Singh Rathore
Embracing participation to unlock deeper truths in commercial research
2025 • Advancing Research 2025
Gold
Jacqui Frey
Panel Discussion: Integrating DesignOps
2018 • DesignOps Summit 2018
Gold

More Videos

Sofía Delsordo

"Imagine a world where the government prototypes and iterates the whole time."

Sofía Delsordo Kassim Vera

Public Policy for Jalisco's Designers to Make Design Matter

December 8, 2021

"Design needs to balance business strategy and technology limitations but always keep users centered."

Product and Design at Bloomberg: A 15-year Evolution

December 6, 2022

Liza Pemstein

"We have the quantity of research work; now we’re focused on building up the quality."

Liza Pemstein Jane Davis

Scaling Research Via an Ops First Model at Clever

March 27, 2023

Kara Kane

"The UK Government Digital Service launched 10 years ago, kicking off a new era in digital public service."

Kara Kane

Theme One Intro

November 16, 2022

Mark Interrante

"AI can accelerate prioritization tasks, but the final judgment must come from humans who understand context."

Mark Interrante Harry Max

AI for Prioritization (3rd of 3 seminars)

July 11, 2024

Sam Proulx

"If you build accessible shopping with these four keys, compliance with legal standards like WCAG will naturally fall into place."

Sam Proulx

Online Shopping: Designing an Accessible Experience

October 3, 2023

Rich Mironov

"We try to figure out who needs to be in the room to hear it — research is how we build team cohesion."

Rich Mironov

How Can Product Managers and UXers Help Each Other (and Why are Product Folks so Annoying Sometimes)?

December 6, 2022

Juhan Sonin

"Nobody asked for this damn thing, nobody funded it, but we just made it."

Juhan Sonin

Design Now! The Agenda for Action

September 4, 2025

Mansi Gupta

"I’m dreaming of a world where women-centricity is so ingrained that frameworks like this don’t need to exist anymore."

Mansi Gupta

Drawing from Feminist Practice to Make Inclusive Design Operational

September 9, 2022