Who does the math: A designer’s journey in building an AI-based tutoring app
This video is featured in the Designing with AI 2025 playlist.
Summary
Key Insights
-
•
Designing AI products demands a strong understanding of AI’s inner workings to anticipate challenges and create meaningful alternatives.
-
•
AI model updates can unpredictably impact performance, requiring flexible design solutions and rapid iteration.
-
•
The Boost 11 Plus app used photography and step-by-step AI tutoring to assist stressed students and their families effectively.
-
•
Strict SLAs, like 24-hour design comment turnarounds, help teams manage rapid changes and keep alignment in AI projects.
-
•
Design principles such as avoiding gamification and clarifying the app is a calculator, not a person, were crucial to maintaining ethical clarity.
-
•
Designers face loss of traditional precision and predictability when designing with large language models due to their inherent opacity.
-
•
Rapid AI advances demand constant adaptation; designers must create multiple design alternatives to navigate ambiguity.
-
•
The plastics analogy illustrates how shiny new technologies can deliver powerful capabilities but carry unforeseen long-term harms and ethical risks.
-
•
AI’s environmental cost, like energy use for generating content, is significant and often overlooked in design and deployment choices.
-
•
AI systems can diminish critical cognitive skills like memory and critical thinking, highlighting the need for mindful usage and design.
Notable Quotes
"The app reads the question and prepares tutoring material, then helps solve it step by step or through chat if further questions remain."
"We realized designing for AI is very different from other computational mediums we used before."
"Understanding the lifecycle of AI code is essential because AI is essentially code running in constant evolution."
"With LLMs, precision is not possible; no one really knows why it decided what to say."
"AI is like plastics on the surface — it gives amazing powers but has hidden damages we must not repeat."
"Design is an excellent way to navigate chaos, turning ambiguity into direction through alternatives."
"We used design principles like look but don't copy, this is a calculator not a person, and no gamification to guide tough decisions."
"AI companies focus on the shiniest thing that comes without caring about stability or reliability."
"It costs about as much as a bottle of water in energy to generate a single email from an LLM system."
"AI users have reduced critical thinking skills within just two years of using AI-assisted tools."
Or choose a question:
More Videos
"A design system that isn't dynamic and doesn't allow contributions from across the company is probably going to become stale quickly."
Dave Malouf Amy ThibodeauPanel: Design Systems and Documentation
November 7, 2017
"Having tight feedback loops and directly controlling the end-to-end experience completely changed how excited I was to do design work."
John DonmoyerShipping your code generation experiments to production
June 11, 2025
"There’s a perception that generative AI is gonna change everything, but I think it’s gonna transform, not totally overhaul mine."
Clara Kliman-SilverUX Futures: The Role of Artificial Intelligence in Design
June 7, 2023
"Don’t dress for the job you have, dress for the job you want—this applies to people and companies alike."
Mark TempletonCreating a Legacy: the ultimate experience
June 9, 2017
"Every parent we talked to had some variation of the question: this exists, can I use it right now? Where was this when I needed to apply?"
Sarah GallimoreInspire Progress with Artifacts from the Future
November 18, 2022
"Webflow is an ideal tool for prototypes with code because users can test in the actual browser environment."
Sam ProulxPrototype Reviews, People With Disabilities, and You
December 8, 2021
"If you have a sense of ownership in the work, you naturally feel more engaged with the outcome and output."
Anna Nguyen Emily BroganWhy Our Voice of the Customer is Better Than Yours
March 10, 2022
"Research has layers like an onion; we operate at multiple layers, from discovery to concept evaluation."
Anna Poznyakov Richa PrajapatiGet The Most Out Of Stakeholder Collaboration—and Maximize Your Research Impact
March 12, 2021
"I don’t exactly even know who I am if not a researcher."
Nalini P. KotamrajuTwo Jobs in One: Being a “Leader who is a Researcher” and a “Researcher who is a Leader"
March 10, 2021