Electrophysiological and kinematic correlates of communicative intent in the planning and production of pointing gestures and speech

David Peeters, Mingyuan Chu, Judith Holler, Peter Hagoort, Asli Özyürek

Research output: Contribution to journalArticle

7 Citations (Scopus)
4 Downloads (Pure)

Abstract

In everyday human communication, we often express our communicative intentions by manually pointing out referents in the material world around us to an addressee, often in tight synchronization with referential speech. This study investigated whether and how the kinematic form of index finger pointing gestures is shaped by the gesturer's communicative intentions and how this is modulated by the presence of concurrently produced speech. Furthermore, we explored the neural mechanisms underpinning the planning of communicative pointing gestures and speech. Two experiments were carried out in which participants pointed at referents for an addressee while the informativeness of their gestures and speech was varied. Kinematic and electrophysiological data were recorded online. It was found that participants prolonged the duration of the stroke and poststroke hold phase of their gesture to be more communicative, in particular when the gesture was carrying the main informational burden in their multimodal utterance. Frontal and P300 effects in the ERPs suggested the importance of intentional and modality-independent attentional mechanisms during the planning phase of informative pointing gestures. These findings contribute to a better understanding of the complex interplay between action, attention, intention, and language in the production of pointing gestures, a communicative act core to human interaction.
Original languageEnglish
Pages (from-to)2352-2368
Number of pages17
JournalJournal of Cognitive Neuroscience
Volume27
Issue number12
Early online date30 Oct 2015
DOIs
Publication statusPublished - Dec 2015

Fingerprint

Gestures
Biomechanical Phenomena
Fingers
Language
Stroke
Communication

Cite this

Electrophysiological and kinematic correlates of communicative intent in the planning and production of pointing gestures and speech. / Peeters, David; Chu, Mingyuan; Holler, Judith; Hagoort, Peter; Özyürek, Asli.

In: Journal of Cognitive Neuroscience, Vol. 27, No. 12, 12.2015, p. 2352-2368.

Research output: Contribution to journalArticle

@article{c51b5f4b60934add8b87abfaf3a5472e,
title = "Electrophysiological and kinematic correlates of communicative intent in the planning and production of pointing gestures and speech",
abstract = "In everyday human communication, we often express our communicative intentions by manually pointing out referents in the material world around us to an addressee, often in tight synchronization with referential speech. This study investigated whether and how the kinematic form of index finger pointing gestures is shaped by the gesturer's communicative intentions and how this is modulated by the presence of concurrently produced speech. Furthermore, we explored the neural mechanisms underpinning the planning of communicative pointing gestures and speech. Two experiments were carried out in which participants pointed at referents for an addressee while the informativeness of their gestures and speech was varied. Kinematic and electrophysiological data were recorded online. It was found that participants prolonged the duration of the stroke and poststroke hold phase of their gesture to be more communicative, in particular when the gesture was carrying the main informational burden in their multimodal utterance. Frontal and P300 effects in the ERPs suggested the importance of intentional and modality-independent attentional mechanisms during the planning phase of informative pointing gestures. These findings contribute to a better understanding of the complex interplay between action, attention, intention, and language in the production of pointing gestures, a communicative act core to human interaction.",
author = "David Peeters and Mingyuan Chu and Judith Holler and Peter Hagoort and Asli {\"O}zy{\"u}rek",
note = "Acknowledgements We thank Albert Russel for assistance in setting up the experiments, and Charlotte Paulisse for help in data collection.",
year = "2015",
month = "12",
doi = "10.1162/jocn_a_00865",
language = "English",
volume = "27",
pages = "2352--2368",
journal = "Journal of Cognitive Neuroscience",
issn = "0898-929X",
publisher = "MIT Press Journals",
number = "12",

}

TY - JOUR

T1 - Electrophysiological and kinematic correlates of communicative intent in the planning and production of pointing gestures and speech

AU - Peeters, David

AU - Chu, Mingyuan

AU - Holler, Judith

AU - Hagoort, Peter

AU - Özyürek, Asli

N1 - Acknowledgements We thank Albert Russel for assistance in setting up the experiments, and Charlotte Paulisse for help in data collection.

PY - 2015/12

Y1 - 2015/12

N2 - In everyday human communication, we often express our communicative intentions by manually pointing out referents in the material world around us to an addressee, often in tight synchronization with referential speech. This study investigated whether and how the kinematic form of index finger pointing gestures is shaped by the gesturer's communicative intentions and how this is modulated by the presence of concurrently produced speech. Furthermore, we explored the neural mechanisms underpinning the planning of communicative pointing gestures and speech. Two experiments were carried out in which participants pointed at referents for an addressee while the informativeness of their gestures and speech was varied. Kinematic and electrophysiological data were recorded online. It was found that participants prolonged the duration of the stroke and poststroke hold phase of their gesture to be more communicative, in particular when the gesture was carrying the main informational burden in their multimodal utterance. Frontal and P300 effects in the ERPs suggested the importance of intentional and modality-independent attentional mechanisms during the planning phase of informative pointing gestures. These findings contribute to a better understanding of the complex interplay between action, attention, intention, and language in the production of pointing gestures, a communicative act core to human interaction.

AB - In everyday human communication, we often express our communicative intentions by manually pointing out referents in the material world around us to an addressee, often in tight synchronization with referential speech. This study investigated whether and how the kinematic form of index finger pointing gestures is shaped by the gesturer's communicative intentions and how this is modulated by the presence of concurrently produced speech. Furthermore, we explored the neural mechanisms underpinning the planning of communicative pointing gestures and speech. Two experiments were carried out in which participants pointed at referents for an addressee while the informativeness of their gestures and speech was varied. Kinematic and electrophysiological data were recorded online. It was found that participants prolonged the duration of the stroke and poststroke hold phase of their gesture to be more communicative, in particular when the gesture was carrying the main informational burden in their multimodal utterance. Frontal and P300 effects in the ERPs suggested the importance of intentional and modality-independent attentional mechanisms during the planning phase of informative pointing gestures. These findings contribute to a better understanding of the complex interplay between action, attention, intention, and language in the production of pointing gestures, a communicative act core to human interaction.

U2 - 10.1162/jocn_a_00865

DO - 10.1162/jocn_a_00865

M3 - Article

VL - 27

SP - 2352

EP - 2368

JO - Journal of Cognitive Neuroscience

JF - Journal of Cognitive Neuroscience

SN - 0898-929X

IS - 12

ER -