Rosenverse
Hands-on AI #1: Let’s write your first AI eval

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Hands-on AI #1: Let’s write your first AI eval

Wednesday, October 8, 2025 • Rosenfeld Community

This video is featured in the Evals + Claude playlist.

Share the love for this talk
Hands-on AI #1: Let’s write your first AI eval
Speakers: Peter Van Dijck
Link:

Summary

If you’re a product manager, UX researcher, or any kind of designer involved in creating an AI product or feature, you need to understand evals. And a great way to learn is with a hands-on example.

In this talk, Peter Van Dijck of the helpful intelligence company will walk you through writing your first eval. You will learn the basic concepts and the tools, and write an eval together. This talk is hands on; you can follow along, and there will be plenty of time for questions.

You will go away with an understanding of the basic building blocks of AI evals, and with the confidence that you know how to write one. And more importantly, you’ll build some intuition, some product sense, around how the best AI products today are built, and how that can help you use them more effectively yourself.

Key Insights

  • •

    Evals consist of a task, a golden dataset with known correct outputs, and an evaluator that measures correctness.

  • •

    Manual AI prompt testing is slow and inconsistent; automated evals accelerate and scale evaluation.

  • •

    UX and product teams can and should learn evals as a practical, non-technical skill.

  • •

    Creating your own golden dataset is essential and cannot be outsourced or fully automated.

  • •

    Models are fixed once trained; improvements happen by refining prompts and context design, not retraining the model.

  • •

    Evaluations measure task performance, not the underlying model itself, allowing comparison across models.

  • •

    Outputting a confidence score from models is unreliable due to lack of internal memory and inconsistent scale interpretation.

  • •

    Biases are baked into models during training via evals used in post-training refinement.

  • •

    LLMs can be used to judge other LLM outputs to evaluate tasks with non-binary answers.

  • •

    Effective eval work requires collaboration across data analysts, engineers, subject matter experts, and UX/product teams.

Notable Quotes

"Evals are like a way to define what good looks like."

"The model was baked and once it’s baked, it does not learn again until they bake a new one."

"You need to be looking at the data. Nobody wants to, but that’s core work."

"Without a golden dataset, you have to build the golden dataset yourself."

"We’re not teaching the model anything; we’re improving our prompts and context."

"Confidence scores from the model are not a good idea because the model has no memory."

"Biases are baked in through the evals used during model training and post-training."

"LLMs judging other LLMs might sound crazy, but if you do it right, it works."

"Evals are a product and UX skill; learning them lets you make these systems do what you want."

"There is a large and growing capability overhang in these models we haven’t discovered yet."

Ask the Rosenbot
Chelsey Glasson
Exit Interview #3: Same as It Ever Was: What Leaving Tech Taught Me About Change
2025 • Rosenfeld Community
Heidi Trost
When AI Becomes the User’s Point Person—and Point of Failure
2025 • Rosenfeld Community
Gabrielle Verderber
Documentation Your Team Will Actually Use
2023 • DesignOps Summit 2023
Gold
Brad Peters
Short Take #1: UX/Product Lessons from Your Industry Peers
2022 • Design in Product 2022
Gold
David Cronin
Discussion
2015 • Enterprise UX 2015
Gold
Laura Weiss
Turn Down the Heat: 3 Ways to Handle Conflict in the Moment
2024 • Rosenfeld Community
Bud Caddell
DesignOps Community Sensing Session
2021 • DesignOps Community
Victor Udoewa
Theme One Intro
2023 • Advancing Research 2023
Gold
Charlotte Lee
Theme 1 Intro
2021 • Civic Design 2021
Gold
Sarah Rink
Remote User Research: Dos and Don'ts from the Virtual Field
2020 • Advancing Research Community
Mansi Gupta
Women-Centric Research: What, Why, How
2023 • Advancing Research 2023
Gold
JD Buckley
Communicating the ROI of UX within a large enterprise and out on the streets
2018 • Enterprise Experience 2018
Gold
Jen Crim
Culture, DIBS & Recruiting
2021 • Design at Scale 2021
Gold
Erika Flowers
Introduction to MURAL for UX
2021 • Design at Scale 2021
Gold
Jodi Forlizzi
Design and AI innovation
2024 • Designing with AI 2024
Gold
Jane Davis
Strategic Shifts and Innovations in User Research: Navigating Challenges and Opportunities
2025 • Advancing Research 2025
Gold

More Videos

Simon Wardley

"The Red Queen effect means you have no choice but to adapt as others evolve faster."

Simon Wardley

Maps and Topographical Intelligence

January 31, 2019

Megan Blocker

"We need to transform our role as connectors between people, disciplines, and ideas that together make our work richer and more impactful."

Megan Blocker

Theme 2 Intro

March 12, 2025

Mila Kuznetsova

"Kids are not little adults. You can’t just simplify the text and call it for kids."

Mila Kuznetsova Lucy Denton

How Lessons Learned from Our Youngest Users Can Help Us Evolve our Practices

March 9, 2022

Megan Blocker

"We have to step outside research and understand AI, technology, and product processes to put ourselves in the right space."

Megan Blocker Lada Gorlenko Fatimah Richmond Molly Stevens

What UX research maturity looks like and how we get there [Advancing Research Community Workshop Series]

November 9, 2023

Wendy Johansson

"Design thinking is accessible and teachable quickly, but mastering design as a craft is a multi-year journey."

Wendy Johansson Surya Vanka

Design at Scale: Behind the Scenes

April 29, 2021

David Sternberg

"You don’t design interfaces anymore—you choreograph intentions."

David Sternberg

Uncovering the hidden forces shaping user behavior

July 17, 2025

Sam Proulx

"Convenience includes accepting multiple payment providers like Apple Pay or PayPal, which can mean the difference between completing and abandoning a purchase."

Sam Proulx

Online Shopping: Designing an Accessible Experience

November 29, 2023

John Cutler

"Patient opportunism means most of the time having the current at your back and only occasionally angling directly against it to avoid burnout."

John Cutler

Oxbows, Rivers, and Estuaries: How to navigate the currents of change (without burning out)

December 3, 2024

Jayne Engle

"Sacred civics requires us to hold higher order accountabilities to ecosystems and future generations."

Jayne Engle Tanya Chung-Tiam-Fook

Civic Design for the Next Seven Generations—A Discussion on Sacred Civics

August 25, 2022