Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Keeping the Body in Mind: What Gestures and Embodied Actions Tell You That Users May Not
Gold
Tuesday, March 26, 2024 • Advancing Research 2024
Share the love for this talk
Keeping the Body in Mind: What Gestures and Embodied Actions Tell You That Users May Not
Speakers: Dane DeSutter
Link:

Summary

Conventional in-depth interviews and observational research place a premium on what people say and the way they interact with a product or design as a means to understand user needs. However, the bias in Western thought that spoken language is a synonym for expression overshadows the essential role of non-verbal communication to convey meaning. In this talk, Dr. Dane DeSutter will show you that the physical components of our expression—gesture, body posture, gaze etc.—offer researchers a unique perspective on people, our social systems, and the ways we engage with our designed environments. This talk will broaden your awareness of the embodied mind and demonstrate the value of studying the body when untangling high value problems in design and beyond.

Key Insights

  • Embodied cognition reframes the mind as shaped by the body’s sensory and motor systems interacting with the physical and social world.

  • Gestures often occur spontaneously and reveal internal mental models, while embodied actions tend to be intentional and goal-directed.

  • Language alone is often vague and contradictory; gestures help triangulate and deepen understanding in research.

  • Dane’s AI study showed users like Carmen anthropomorphize AI as an apprentice they teach, influenced by conversational UI designs.

  • Carmen’s gestures revealed two distinct mental models of machine learning: a reactive input-output model and an active training metaphor.

  • Physical therapists like Stacey rely heavily on embodied actions (touch, gaze) and subjective feedback alongside quantitative device data.

  • Medical device data often captures only part of patient care insights; embodied actions reveal richer, subjective information lost in records.

  • Environmental design can either support or disrupt critical embodied interactions, such as doctor-patient connections.

  • Gesture and embodiment analysis can start with low-tech tools, making it accessible and cost-effective for researchers.

  • As computing moves beyond screens, understanding embodied user interactions will become critical for next-generation UX and product research.

Notable Quotes

"Our bodies profoundly influence the way that we think about ourselves, others, the world, and everything in it."

"The body can be a bridge to understand your users by looking at gestures and embodied actions to get to what people mean."

"The computer metaphor of mind just doesn’t do a very good job of explaining what we see people do with their bodies."

"Embodied cognition reframes the mind from an information processing computer to something grounded in sensory and motor systems."

"Gestures serve as a window into the embodied mind and often replay rich sensory-motor memories when we communicate or reason."

"AI products like ChatGPT are not just tools for some people; they are relationships."

"Physical therapists see their hands as a golden resource in treatment and tend to resist technology that might replace that."

"You want to keep the physician at the center of expertise, integrating multiple data sources, not relying solely on devices."

"Just the interaction with the physical environment can disrupt something as important as a doctor-patient connection."

"Gesture and embodied action is also a way for us to think about the next era of user and product research."

Ask the Rosenbot
Theresa Slate
Why Changing Hearts & Minds Doesn’t Work When Promoting DE&I Efforts, but Checklists Do
2023 • DesignOps Summit 2023
Gold
Dan Hill
Designing for the infrastructures of everyday life
2024 • Designing with AI 2024
Gold
Joi Freeman
A New Vantage Point: Building a Pipeline for Multifaceted Research(ers)
2020 • Advancing Research 2020
Gold
Ignacio Martinez
Fair and Effective Designer Evaluation
2024 • DesignOps 2024
Gold
Bria Alexander
Opening Remarks
2023 • Advancing Research 2023
Gold
Sahibzada Mayed
Cultivating Design Ecologies of Care, Community, and Collaboration
2023 • DesignOps Summit 2023
Gold
Roy Opata Olende
How Zapier Uses ‘All Hands Research’ to Increase Exposure to Users (Videoconference)
2020 • Advancing Research Community
Bria Alexander
Opening Remarks
2024 • Advancing Research 2021
Gold
Neil Barrie
Widening the Aperture: The Case for Taking a Broader Lens to the Dialogue between Products and Culture
2024 • Advancing Research 2024
Gold
Bria Alexander
Opening Remarks
2021 • DesignOps Summit 2021
Gold
Mark Templeton
Creating a Legacy: the ultimate experience
2017 • Enterprise Experience 2017
Gold
Louis Rosenfeld
Do you want to work on climate? (Climate UX Discussion Series)
2023 • Climate UX Interest Group (Rosenfeld Community)
Prayag Narula
How to Empower Your Designers to Do Good Research – And Why You Want To
2022 • Design at Scale 2022
Gold
Sam Proulx
SUS: A System Unusable for Twenty Percent of the Population
2021 • DesignOps Summit 2021
Gold
Landon Barnes
Are My Research Findings Actually Meaningful?
2022 • Advancing Research 2022
Gold
Anat Fintzi
Delivering at Scale: Making Traction with Resistant Partners
2022 • Design at Scale 2022
Gold

More Videos

Adam Cutler

"You need strong regional players with negotiation skills to navigate the split loyalties in global teams."

Adam Cutler Karen Pascoe Ian Swinson Susan Worthman

Discussion

June 8, 2016

Peter Merholz

"Middle managers are responsible for the how—process, coordination, and communication—and you don’t see the value of that until it’s missing."

Peter Merholz

The Trials and Tribulations of Directors of UX (Videoconference)

July 13, 2023

Lisa Welchman

"Everything that has been put online, someone like us made and put there; we bake our own biases into it."

Lisa Welchman

Cleaning Up Our Mess: Digital Governance for Designers

June 14, 2018

Vincent Brathwaite

"Green spaces in cities can greatly enhance our quality of life and resilience."

Vincent Brathwaite

Opener: Past, Present, and Future—Closing the Racial Divide in Design Teams

October 22, 2020

Brenna Fallon

"Growth and learning is your long term change management plan."

Brenna Fallon

Learning Over Outcomes

October 24, 2019

Tricia Wang

"Factory owners manipulated people’s time so much that workers were afraid to carry a watch."

Tricia Wang

Spatial Collapse: Designing for Emergent Culture

January 8, 2024

Edgar Anzaldua Moreno

"Clusters describing demographics and behaviors alone were not enough; we needed emotional personas to find value propositions."

Edgar Anzaldua Moreno

Using Research to Determine Unique Value Proposition

March 11, 2021

"We manage the environment in which knowledge distribution takes place, not the process itself."

Designing Systems at Scale

November 7, 2018

Erin Weigel

"If my experiment made front-page news tomorrow, what would the headline be? Would my mother be proud?"

Erin Weigel

Get Your Whole Team Testing to Design for Impact

July 24, 2024