The role of beat gesture and pitch accent in semantic processing: An ERP study

Lin Wang, Mingyuan Chu

Research output: Contribution to journalArticle

26 Citations (Scopus)
59 Downloads (Pure)

Abstract

The present study investigated whether and how beat gesture (small baton-like hand movements used to emphasize information in speech) influences semantic processing as well as its interaction with pitch accent during speech comprehension. Event-related potentials were recorded as participants watched videos of a person gesturing and speaking simultaneously. The critical words in the spoken sentences were accompanied by a beat gesture, a control hand movement, or no hand movement, and were expressed either with or without pitch accent. We found that both beat gesture and control hand movement induced smaller negativities in the N400 time window than when no hand movement was presented. The reduced N400s indicate that both beat gesture and control movement facilitated the semantic integration of the critical word into the sentence context. In addition, the words accompanied by beat gesture elicited smaller negativities in the N400 time window than those accompanied by control hand movement over right posterior electrodes, suggesting that beat gesture has a unique role for enhancing semantic processing during speech comprehension. Finally, no interaction was observed between beat gesture and pitch accent, indicating that they affect semantic processing independently.
Original languageEnglish
Pages (from-to)2847-2855
Number of pages5
JournalNeuropsychologia
Volume51
Issue number13
DOIs
Publication statusPublished - Sep 2013

Keywords

  • beat gesture
  • pitch accent
  • semantic processing
  • speech comprehension
  • N400

Fingerprint Dive into the research topics of 'The role of beat gesture and pitch accent in semantic processing: An ERP study'. Together they form a unique fingerprint.

  • Cite this