The Heart and Brain of the AI Research

Key Insights

• •

  UX research often stays on the surface of usability, missing deeper impacts related to data and AI models beneath the iceberg.

• •

  Natural language processing models require extensive and specific training data to understand diverse user utterances.

• •

  AI systems struggle to identify causality, often confusing correlation with cause and effect in user queries.

• •

  Users often engage in investigative dialogue before reaching their true question or desired outcome.

• •

  Human researchers can pinpoint why users interact with AI in unexpected ways by analyzing behavior beyond simple metrics like button clicks.

• •

  Collaboration between human researchers and AI scientists through shared observations and joint sense-making enhances AI development.

• •

  AI planning, such as the monkey and banana problem, offers a framework connecting user goals with efficient AI action sequences.

• •

  Human-centered research can inform training data selection, helping AI models to better predict and respond to user needs.

• •

  Effective AI product research requires understanding the technology enough to communicate meaningfully with technical teams.

• •

  Human researchers increase impact by shifting from passive observers to active participants in ideation, design, and strategy discussions.

Notable Quotes