Rosenverse
Who does the math: A designer’s journey in building an AI-based tutoring app

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Who does the math: A designer’s journey in building an AI-based tutoring app

Gold
Tuesday, June 10, 2025 • Designing with AI 2025

This video is featured in the Designing with AI 2025 playlist.

Share the love for this talk
Who does the math: A designer’s journey in building an AI-based tutoring app
Speakers: Aras Bilgen
Link:

Summary

We built a novel math tutoring app for 11-year-olds in the UK. Since this was our first AI project, we expected lots of technical issues. Those happened and on top of it, we ended up questioning the value of designers in AI-driven products.

Key Insights

  • •

    Designing AI products demands a strong understanding of AI’s inner workings to anticipate challenges and create meaningful alternatives.

  • •

    AI model updates can unpredictably impact performance, requiring flexible design solutions and rapid iteration.

  • •

    The Boost 11 Plus app used photography and step-by-step AI tutoring to assist stressed students and their families effectively.

  • •

    Strict SLAs, like 24-hour design comment turnarounds, help teams manage rapid changes and keep alignment in AI projects.

  • •

    Design principles such as avoiding gamification and clarifying the app is a calculator, not a person, were crucial to maintaining ethical clarity.

  • •

    Designers face loss of traditional precision and predictability when designing with large language models due to their inherent opacity.

  • •

    Rapid AI advances demand constant adaptation; designers must create multiple design alternatives to navigate ambiguity.

  • •

    The plastics analogy illustrates how shiny new technologies can deliver powerful capabilities but carry unforeseen long-term harms and ethical risks.

  • •

    AI’s environmental cost, like energy use for generating content, is significant and often overlooked in design and deployment choices.

  • •

    AI systems can diminish critical cognitive skills like memory and critical thinking, highlighting the need for mindful usage and design.

Notable Quotes

"The app reads the question and prepares tutoring material, then helps solve it step by step or through chat if further questions remain."

"We realized designing for AI is very different from other computational mediums we used before."

"Understanding the lifecycle of AI code is essential because AI is essentially code running in constant evolution."

"With LLMs, precision is not possible; no one really knows why it decided what to say."

"AI is like plastics on the surface — it gives amazing powers but has hidden damages we must not repeat."

"Design is an excellent way to navigate chaos, turning ambiguity into direction through alternatives."

"We used design principles like look but don't copy, this is a calculator not a person, and no gamification to guide tough decisions."

"AI companies focus on the shiniest thing that comes without caring about stability or reliability."

"It costs about as much as a bottle of water in energy to generate a single email from an LLM system."

"AI users have reduced critical thinking skills within just two years of using AI-assisted tools."

Ask the Rosenbot
Andrea Gallagher
The Problem Space
2019 • Advancing Research Community
Sam Proulx
Accessibility: An Opportunity to Innovate
2022 • Advancing Research 2022
Gold
Chris Geison
Theme Two Intro
2023 • Advancing Research 2023
Gold
Sara Conklin
A UXer’s 12-Month Journey from Climate Concern to Climate Credibility
2025 • Climate UX Interest Group
Josh Clark
Sentient Design: New Design Patterns for New Experiences (3rd of 3 seminars)
2025 • Rosenfeld Community
Caroline Jarrett
Have fun with statistics?
2024 • Rosenfeld Community
Scott Stephens
The Next Generation in DesignOps Toolsets
2022 • DesignOps Community
Verónica Urzúa
The B-side of the Research Impact
2021 • Advancing Research 2021
Gold
Steve Krug
Don’t Make Me Think 3.0: What Endures and What Evolves in UX
2026 • Advancing Research 2026
Gold
Fredrik Matheson
First-time users, longtime strategies: Why Parkinson’s Law is making you less effective at work – and how to design a fix.
2016 • Enterprise UX 2016
Gold
Catherine Courage
The Enterprise UX Journey: Lessons From the Voyage & The Opportunity Ahead
2015 • Enterprise UX 2015
Gold
World Usability Day Panel Discussion
2022 • DesignOps Community
Sha Hwang
The Lost Year
2021 • Design at Scale 2021
Gold
Johanna Kollmann
Insights-Driven Product Strategy: Get your Research to Count
2022 • Design in Product 2022
Gold
John Mortimer
Panel Discussion
2024 • Advancing Service Design 2024
Gold
Louis Rosenfeld
Discussion: What Operations can teach DesignOps
2017 • DesignOps Summit 2017
Gold

More Videos

Dave Malouf

"A design system that isn't dynamic and doesn't allow contributions from across the company is probably going to become stale quickly."

Dave Malouf Amy Thibodeau

Panel: Design Systems and Documentation

November 7, 2017

John Donmoyer

"Having tight feedback loops and directly controlling the end-to-end experience completely changed how excited I was to do design work."

John Donmoyer

Shipping your code generation experiments to production

June 11, 2025

Clara Kliman-Silver

"There’s a perception that generative AI is gonna change everything, but I think it’s gonna transform, not totally overhaul mine."

Clara Kliman-Silver

UX Futures: The Role of Artificial Intelligence in Design

June 7, 2023

Mark Templeton

"Don’t dress for the job you have, dress for the job you want—this applies to people and companies alike."

Mark Templeton

Creating a Legacy: the ultimate experience

June 9, 2017

Sarah Gallimore

"Every parent we talked to had some variation of the question: this exists, can I use it right now? Where was this when I needed to apply?"

Sarah Gallimore

Inspire Progress with Artifacts from the Future

November 18, 2022

Sam Proulx

"Webflow is an ideal tool for prototypes with code because users can test in the actual browser environment."

Sam Proulx

Prototype Reviews, People With Disabilities, and You

December 8, 2021

Anna Nguyen

"If you have a sense of ownership in the work, you naturally feel more engaged with the outcome and output."

Anna Nguyen Emily Brogan

Why Our Voice of the Customer is Better Than Yours

March 10, 2022

Anna Poznyakov

"Research has layers like an onion; we operate at multiple layers, from discovery to concept evaluation."

Anna Poznyakov Richa Prajapati

Get The Most Out Of Stakeholder Collaboration—and Maximize Your Research Impact

March 12, 2021

Nalini P. Kotamraju

"I don’t exactly even know who I am if not a researcher."

Nalini P. Kotamraju

Two Jobs in One: Being a “Leader who is a Researcher” and a “Researcher who is a Leader"

March 10, 2021