Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Who does the math: A designer’s journey in building an AI-based tutoring app

Gold
Tuesday, June 10, 2025 • Designing with AI 2025

This video is featured in the Designing with AI 2025 playlist.

Share the love for this talk
Who does the math: A designer’s journey in building an AI-based tutoring app
Speakers: Aras Bilgen
Link:

Summary

We built a novel math tutoring app for 11-year-olds in the UK. Since this was our first AI project, we expected lots of technical issues. Those happened and on top of it, we ended up questioning the value of designers in AI-driven products.

Key Insights

  • Designing AI products demands a strong understanding of AI’s inner workings to anticipate challenges and create meaningful alternatives.

  • AI model updates can unpredictably impact performance, requiring flexible design solutions and rapid iteration.

  • The Boost 11 Plus app used photography and step-by-step AI tutoring to assist stressed students and their families effectively.

  • Strict SLAs, like 24-hour design comment turnarounds, help teams manage rapid changes and keep alignment in AI projects.

  • Design principles such as avoiding gamification and clarifying the app is a calculator, not a person, were crucial to maintaining ethical clarity.

  • Designers face loss of traditional precision and predictability when designing with large language models due to their inherent opacity.

  • Rapid AI advances demand constant adaptation; designers must create multiple design alternatives to navigate ambiguity.

  • The plastics analogy illustrates how shiny new technologies can deliver powerful capabilities but carry unforeseen long-term harms and ethical risks.

  • AI’s environmental cost, like energy use for generating content, is significant and often overlooked in design and deployment choices.

  • AI systems can diminish critical cognitive skills like memory and critical thinking, highlighting the need for mindful usage and design.

Notable Quotes

"The app reads the question and prepares tutoring material, then helps solve it step by step or through chat if further questions remain."

"We realized designing for AI is very different from other computational mediums we used before."

"Understanding the lifecycle of AI code is essential because AI is essentially code running in constant evolution."

"With LLMs, precision is not possible; no one really knows why it decided what to say."

"AI is like plastics on the surface — it gives amazing powers but has hidden damages we must not repeat."

"Design is an excellent way to navigate chaos, turning ambiguity into direction through alternatives."

"We used design principles like look but don't copy, this is a calculator not a person, and no gamification to guide tough decisions."

"AI companies focus on the shiniest thing that comes without caring about stability or reliability."

"It costs about as much as a bottle of water in energy to generate a single email from an LLM system."

"AI users have reduced critical thinking skills within just two years of using AI-assisted tools."

Ask the Rosenbot
Milan Guenther
A Shared Language for Co-Creating Ambitious Endeavours
2023 • Enterprise UX 2023
Gold
Mark Interrante
AI for Prioritization (3rd of 3 seminars)
2024 • Rosenfeld Community
Emily DiLeo
Stronger Together: Lessons Learned from UX Research Ops
2024 • DesignOps Summit 2024
Gold
Bria Alexander
Opening Remarks
2024 • Advancing Research 2021
Gold
Sarah Brooks
Theme Three Intro
2022 • Civic Design 2022
Gold
Dean Broadley
Not Black Enough to be White
2024 • DesignOps Summit 2020
Gold
Tamara Kartoziia
Think global, adapt local: how service design accelerated B2B market entry by 6 months
2025 • Advancing Service Design 2025
Gold
Miles Orkin
Creativity and Culture
2018 • DesignOps Summit 2018
Gold
Joseph Meersman
Sweating the Pixel: Scaling Quality through Critique
2021 • Design at Scale 2021
Gold
Brianna Sylver
Lead With Purpose
2020 • Advancing Research 2020
Gold
Kit Unger
Theme 3 Intro
2022 • Design at Scale 2022
Gold
Chris Geison
Theme Two Intro
2023 • Advancing Research 2023
Gold
John Calhoun
Meters, Miles, and Madness: New Frameworks to Measure the (Elusive) Value of DesignOps
2024 • DesignOps Summit 2024
Gold
Nathan Curtis
Beyond the Toolkit: Spreading a System Across People & Products
2016 • Enterprise UX 2016
Gold
Dagmara Kukawka
Tiny team, moonshot impact: Democratizing research across continents
2026 • Advancing Research 2026
Gold
Dante Guintu
How to Crush the Talent Crunch
2022 • DesignOps Summit 2022
Gold

More Videos

Anna Avrekh

"There is no certainty ever in research; qualitative and quantitative approaches complement each other for different purposes."

Anna Avrekh Dr. John Pagonis Klara Pelcl Sina Schreiber

Expert Panel: Leading in and with Research

March 10, 2022

Megan Campos

"Age carries with it obvious visible differences and lived experience, while race often involves less visible but equally impactful structures."

Megan Campos

What Did I Miss? The Hidden Costs of Deprioritizing Diversity in User Research

March 12, 2021

Kat Vellos

"One in five people say they deal with feelings of disconnection and loneliness in the workplace."

Kat Vellos

Opener: The Other L Word

January 8, 2024

Adrian Howard

"Talking about outcomes first is a really powerful technique for people who have had bad experiences."

Adrian Howard

Sturgeon’s Biases

September 25, 2024

Nicole Aleong

"There are over 7 billion futures of right now."

Nicole Aleong

Future Orientations to Everyday Life: Futures Anthropology as a Methodology

March 26, 2024

Tamara Hale

"I’ve done the headscarf when recruiting door to door at the mosques of East London."

Tamara Hale

War Stories LIVE! Tamara Hale

March 30, 2020

Rachael Dietkus, LCSW

"Research should prioritize participant and researcher well-being over institutional convenience."

Rachael Dietkus, LCSW

The power to heal and harm

March 13, 2025

Steve Portigal

"Paper prototyping was the original scrappy; low fidelity tools produce different responses than high fidelity."

Steve Portigal

Looking Back…to Look Ahead

March 26, 2024

Megan Nipe

"We break down overarching messages into pillar messages and key proof points to create digestible, empathetic communication."

Megan Nipe Lyndsay Booth

Human-Centered Design for Engagement: Maturing from Newsletterville to Personalized, One-to-One Messaging

December 8, 2021