Keeping the Body in Mind: What Gestures and Embodied Actions Tell You That Users May Not
Summary
Conventional in-depth interviews and observational research place a premium on what people say and the way they interact with a product or design as a means to understand user needs. However, the bias in Western thought that spoken language is a synonym for expression overshadows the essential role of non-verbal communication to convey meaning. In this talk, Dr. Dane DeSutter will show you that the physical components of our expression—gesture, body posture, gaze etc.—offer researchers a unique perspective on people, our social systems, and the ways we engage with our designed environments. This talk will broaden your awareness of the embodied mind and demonstrate the value of studying the body when untangling high value problems in design and beyond.
Key Insights
-
•
The body shapes the mind and thinking through continuous interaction with the world and social environment.
-
•
Gestures often occur spontaneously and reveal rich sensory-motor experiences tied to memory and mental models.
-
•
Embodied actions tend to be intentional, goal-directed interactions with the physical environment.
-
•
Language alone can be vague and contradictory; gestures provide a complementary, often clearer insight into user intent and thought.
-
•
Analyzing gestures and embodied actions is valuable across scales—from individual cognition to group communication and spatial coordination.
-
•
AI users like Carmen often metaphorically frame AI as an apprentice through gestures suggesting information exchange and dialogue.
-
•
In clinical settings, embodied actions by therapists like Stacy integrate subjective touch, patient feedback, and objective data into diagnosis.
-
•
Many existing product environments hinder fluid embodied interaction, disrupting critical human connections such as clinician-patient rapport.
-
•
Gesture and embodied action analysis can be done with low-tech tools and revisiting existing video data, minimizing resource needs.
-
•
The rise of new technologies beyond screen interfaces demands fresh methods—including gesture analysis—to understand evolving UX.
Notable Quotes
"Our bodies profoundly influence the way that we think about ourselves, others, the world, and everything in it."
"Language can be vague, imprecise, and even contradictory, but the body can be a bridge to understanding."
"Gestures serve as a window into the embodied mind by replaying prior embodied experiences when we communicate."
"The computer metaphor of mind does not do a very good job of explaining what we see people do with their bodies."
"For some users, AI products are not just tools, they are relationships."
"Physical therapists see their hands as a golden resource and tend to resist technology that might replace that."
"The environment can disrupt critical interactions, like when Stacey gets caught up in cords and takes her eyes off the patient."
"You don’t need special software to get started analyzing gestures and embodied actions; you just need video and a notepad."
"Look at your old data again with a new lens; reanalyzing can save money and be less extractive."
"Gesture and embodied actions will be a key tool for understanding user experience as computing moves beyond traditional screen-based interactions."
Or choose a question:
More Videos
"Decision making here is basically forge trading — people argue and withhold support until they get what they want."
Carl TurnerYou Can Do This: Understand and Solve Organizational Problems to Jumpstart a Dead Project
March 28, 2023
"Don’t send your recruiters to spam LinkedIn. That damages your brand and turns off potential candidates."
Karen PascoeDeveloping Experience Teams and Talent in the Enterprise
June 8, 2016
"When you remove nonverbal cues from communication, messages get easily misinterpreted."
Jilanna WilsonDistributed Design Operations Management
October 23, 2019
"Designers contribute experimental patterns back to the design system early, making their work visible even before full validation."
Shawna Hein Kevin HoffmanCreate a Cohesive Civic Design Practice Across Agency, Vendors, and Contracts
November 17, 2022
"Site visits with users don’t just give actionable insight; they give us raw, humbling inspiration to keep going."
Barb SpantonDoing Work That Matters: A Look Beyond The Idealistic Notion of 'Doing Meaningful Work'
June 10, 2022
"Dana is a reliable, solutions-oriented designer who prefers honest feedback but needs clear expectations."
Briana ThomasThe Quiet Force: Uncovering Hidden Leadership in High-Impact Design Teams
September 24, 2024
"Service design is 10% connecting the dots and 90% creating the conditions that bring those dots closer together."
Gina MendoliaTherapists, Coaches, and Grandmas: Techniques for Service Design in Complex Systems
December 3, 2024
"Understanding how assistive technology evolves is crucial because it foretells the future of interface design."
Lija Hogan Milan Mijatovic Sam Proulx Louis RosenfeldThree Years Out: Perspectives on the Near-Term Future of User Research
March 15, 2024
"With our new operating model, partners are more confident funding UX ops because of increased clarity and focus."
John Calhoun Rachel PosmanTwo Sides of the DesignOps Coin: Teams Ops and Product Ops
January 8, 2024
Latest Books All books
Dig deeper with the Rosenbot
How can teams create lightweight visibility systems that improve workload transparency without reducing productivity?
How is the role of research operations evolving with AI and broader data integration?
How can AI agents maintain context and prevent delivering misleading answers when searching research data?