The role of beat gesture and pitch accent in semantic processing

An ERP study

Lin Wang, Mingyuan Chu

Research output: Contribution to journalArticle

25 Citations (Scopus)
51 Downloads (Pure)

Abstract

The present study investigated whether and how beat gesture (small baton-like hand movements used to emphasize information in speech) influences semantic processing as well as its interaction with pitch accent during speech comprehension. Event-related potentials were recorded as participants watched videos of a person gesturing and speaking simultaneously. The critical words in the spoken sentences were accompanied by a beat gesture, a control hand movement, or no hand movement, and were expressed either with or without pitch accent. We found that both beat gesture and control hand movement induced smaller negativities in the N400 time window than when no hand movement was presented. The reduced N400s indicate that both beat gesture and control movement facilitated the semantic integration of the critical word into the sentence context. In addition, the words accompanied by beat gesture elicited smaller negativities in the N400 time window than those accompanied by control hand movement over right posterior electrodes, suggesting that beat gesture has a unique role for enhancing semantic processing during speech comprehension. Finally, no interaction was observed between beat gesture and pitch accent, indicating that they affect semantic processing independently.
Original languageEnglish
Pages (from-to)2847-2855
Number of pages5
JournalNeuropsychologia
Volume51
Issue number13
DOIs
Publication statusPublished - Sep 2013

Fingerprint

Sodium Glutamate
Gestures
Semantics
Hand
Evoked Potentials
Electrodes

Keywords

  • beat gesture
  • pitch accent
  • semantic processing
  • speech comprehension
  • N400

Cite this

The role of beat gesture and pitch accent in semantic processing : An ERP study. / Wang, Lin; Chu, Mingyuan.

In: Neuropsychologia, Vol. 51, No. 13, 09.2013, p. 2847-2855.

Research output: Contribution to journalArticle

@article{ed5152c6d7774377a316118f4ec73d9e,
title = "The role of beat gesture and pitch accent in semantic processing: An ERP study",
abstract = "The present study investigated whether and how beat gesture (small baton-like hand movements used to emphasize information in speech) influences semantic processing as well as its interaction with pitch accent during speech comprehension. Event-related potentials were recorded as participants watched videos of a person gesturing and speaking simultaneously. The critical words in the spoken sentences were accompanied by a beat gesture, a control hand movement, or no hand movement, and were expressed either with or without pitch accent. We found that both beat gesture and control hand movement induced smaller negativities in the N400 time window than when no hand movement was presented. The reduced N400s indicate that both beat gesture and control movement facilitated the semantic integration of the critical word into the sentence context. In addition, the words accompanied by beat gesture elicited smaller negativities in the N400 time window than those accompanied by control hand movement over right posterior electrodes, suggesting that beat gesture has a unique role for enhancing semantic processing during speech comprehension. Finally, no interaction was observed between beat gesture and pitch accent, indicating that they affect semantic processing independently.",
keywords = "beat gesture, pitch accent, semantic processing, speech comprehension, N400",
author = "Lin Wang and Mingyuan Chu",
year = "2013",
month = "9",
doi = "10.1016/j.neuropsychologia.2013.09.027",
language = "English",
volume = "51",
pages = "2847--2855",
journal = "Neuropsychologia",
issn = "0028-3932",
publisher = "Elsevier Limited",
number = "13",

}

TY - JOUR

T1 - The role of beat gesture and pitch accent in semantic processing

T2 - An ERP study

AU - Wang, Lin

AU - Chu, Mingyuan

PY - 2013/9

Y1 - 2013/9

N2 - The present study investigated whether and how beat gesture (small baton-like hand movements used to emphasize information in speech) influences semantic processing as well as its interaction with pitch accent during speech comprehension. Event-related potentials were recorded as participants watched videos of a person gesturing and speaking simultaneously. The critical words in the spoken sentences were accompanied by a beat gesture, a control hand movement, or no hand movement, and were expressed either with or without pitch accent. We found that both beat gesture and control hand movement induced smaller negativities in the N400 time window than when no hand movement was presented. The reduced N400s indicate that both beat gesture and control movement facilitated the semantic integration of the critical word into the sentence context. In addition, the words accompanied by beat gesture elicited smaller negativities in the N400 time window than those accompanied by control hand movement over right posterior electrodes, suggesting that beat gesture has a unique role for enhancing semantic processing during speech comprehension. Finally, no interaction was observed between beat gesture and pitch accent, indicating that they affect semantic processing independently.

AB - The present study investigated whether and how beat gesture (small baton-like hand movements used to emphasize information in speech) influences semantic processing as well as its interaction with pitch accent during speech comprehension. Event-related potentials were recorded as participants watched videos of a person gesturing and speaking simultaneously. The critical words in the spoken sentences were accompanied by a beat gesture, a control hand movement, or no hand movement, and were expressed either with or without pitch accent. We found that both beat gesture and control hand movement induced smaller negativities in the N400 time window than when no hand movement was presented. The reduced N400s indicate that both beat gesture and control movement facilitated the semantic integration of the critical word into the sentence context. In addition, the words accompanied by beat gesture elicited smaller negativities in the N400 time window than those accompanied by control hand movement over right posterior electrodes, suggesting that beat gesture has a unique role for enhancing semantic processing during speech comprehension. Finally, no interaction was observed between beat gesture and pitch accent, indicating that they affect semantic processing independently.

KW - beat gesture

KW - pitch accent

KW - semantic processing

KW - speech comprehension

KW - N400

U2 - 10.1016/j.neuropsychologia.2013.09.027

DO - 10.1016/j.neuropsychologia.2013.09.027

M3 - Article

VL - 51

SP - 2847

EP - 2855

JO - Neuropsychologia

JF - Neuropsychologia

SN - 0028-3932

IS - 13

ER -