The contents of predictions in sentence comprehension

Activation of the shape of objects before they are referred to

Joost Rommers (Corresponding Author), Antje S. Meyer, Peter Praamstra, Falk Huettig

Research output: Contribution to journalArticle

41 Citations (Scopus)

Abstract

When comprehending concrete words, listeners and readers can activate specific visual information such as the shape of the words' referents. In two experiments we examined whether such information can be activated in an anticipatory fashion. In Experiment 1, listeners' eye movements were tracked while they were listening to sentences that were predictive of a specific critical word (e.g., “moon” in “In 1969 Neil Armstrong was the first man to set foot on the moon”). 500 ms before the acoustic onset of the critical word, participants were shown four-object displays featuring three unrelated distractor objects and a critical object, which was either the target object (e.g., moon), an object with a similar shape (e.g., tomato), or an unrelated control object (e.g., rice). In a time window before shape information from the spoken target word could be retrieved, participants already tended to fixate both the target and the shape competitors more often than they fixated the control objects, indicating that they had anticipatorily activated the shape of the upcoming word's referent. This was confirmed in Experiment 2, which was an ERP experiment without picture displays. Participants listened to the same lead-in sentences as in Experiment 1. The sentence-final words corresponded to the predictable target, the shape competitor, or the unrelated control object (yielding, for instance, “In 1969 Neil Armstrong was the first man to set foot on the moon/tomato/rice”). N400 amplitude in response to the final words was significantly attenuated in the shape-related compared to the unrelated condition. Taken together, these results suggest that listeners can activate perceptual attributes of objects before they are referred to in an utterance.
Original languageEnglish
Pages (from-to)437-447
Number of pages11
JournalNeuropsychologia
Volume51
Issue number3
Early online date10 Dec 2012
DOIs
Publication statusPublished - Feb 2013

Fingerprint

Lycopersicon esculentum
Foot
Eye Movements
Acoustics
Oryza

Keywords

  • Predictive sentence processing
  • Visual representations
  • Eye-tracking
  • Event-related potentials (ERPs)
  • N400

Cite this

The contents of predictions in sentence comprehension : Activation of the shape of objects before they are referred to. / Rommers, Joost (Corresponding Author); Meyer, Antje S.; Praamstra, Peter; Huettig, Falk.

In: Neuropsychologia, Vol. 51, No. 3, 02.2013, p. 437-447.

Research output: Contribution to journalArticle

Rommers, Joost ; Meyer, Antje S. ; Praamstra, Peter ; Huettig, Falk. / The contents of predictions in sentence comprehension : Activation of the shape of objects before they are referred to. In: Neuropsychologia. 2013 ; Vol. 51, No. 3. pp. 437-447.
@article{33fcf7857fc340d3b48adac087120fe9,
title = "The contents of predictions in sentence comprehension: Activation of the shape of objects before they are referred to",
abstract = "When comprehending concrete words, listeners and readers can activate specific visual information such as the shape of the words' referents. In two experiments we examined whether such information can be activated in an anticipatory fashion. In Experiment 1, listeners' eye movements were tracked while they were listening to sentences that were predictive of a specific critical word (e.g., “moon” in “In 1969 Neil Armstrong was the first man to set foot on the moon”). 500 ms before the acoustic onset of the critical word, participants were shown four-object displays featuring three unrelated distractor objects and a critical object, which was either the target object (e.g., moon), an object with a similar shape (e.g., tomato), or an unrelated control object (e.g., rice). In a time window before shape information from the spoken target word could be retrieved, participants already tended to fixate both the target and the shape competitors more often than they fixated the control objects, indicating that they had anticipatorily activated the shape of the upcoming word's referent. This was confirmed in Experiment 2, which was an ERP experiment without picture displays. Participants listened to the same lead-in sentences as in Experiment 1. The sentence-final words corresponded to the predictable target, the shape competitor, or the unrelated control object (yielding, for instance, “In 1969 Neil Armstrong was the first man to set foot on the moon/tomato/rice”). N400 amplitude in response to the final words was significantly attenuated in the shape-related compared to the unrelated condition. Taken together, these results suggest that listeners can activate perceptual attributes of objects before they are referred to in an utterance.",
keywords = "Predictive sentence processing, Visual representations, Eye-tracking, Event-related potentials (ERPs), N400",
author = "Joost Rommers and Meyer, {Antje S.} and Peter Praamstra and Falk Huettig",
note = "Acknowledgments We thank Alma Veenstra for lending her voice to our materials, Tilman Harpe for drawing pictures for Experiment 1, Marloes Wensink and Sophie Kirkels for help with association norms, and three anonymous reviewers for comments.",
year = "2013",
month = "2",
doi = "10.1016/j.neuropsychologia.2012.12.002",
language = "English",
volume = "51",
pages = "437--447",
journal = "Neuropsychologia",
issn = "0028-3932",
publisher = "Elsevier Limited",
number = "3",

}

TY - JOUR

T1 - The contents of predictions in sentence comprehension

T2 - Activation of the shape of objects before they are referred to

AU - Rommers, Joost

AU - Meyer, Antje S.

AU - Praamstra, Peter

AU - Huettig, Falk

N1 - Acknowledgments We thank Alma Veenstra for lending her voice to our materials, Tilman Harpe for drawing pictures for Experiment 1, Marloes Wensink and Sophie Kirkels for help with association norms, and three anonymous reviewers for comments.

PY - 2013/2

Y1 - 2013/2

N2 - When comprehending concrete words, listeners and readers can activate specific visual information such as the shape of the words' referents. In two experiments we examined whether such information can be activated in an anticipatory fashion. In Experiment 1, listeners' eye movements were tracked while they were listening to sentences that were predictive of a specific critical word (e.g., “moon” in “In 1969 Neil Armstrong was the first man to set foot on the moon”). 500 ms before the acoustic onset of the critical word, participants were shown four-object displays featuring three unrelated distractor objects and a critical object, which was either the target object (e.g., moon), an object with a similar shape (e.g., tomato), or an unrelated control object (e.g., rice). In a time window before shape information from the spoken target word could be retrieved, participants already tended to fixate both the target and the shape competitors more often than they fixated the control objects, indicating that they had anticipatorily activated the shape of the upcoming word's referent. This was confirmed in Experiment 2, which was an ERP experiment without picture displays. Participants listened to the same lead-in sentences as in Experiment 1. The sentence-final words corresponded to the predictable target, the shape competitor, or the unrelated control object (yielding, for instance, “In 1969 Neil Armstrong was the first man to set foot on the moon/tomato/rice”). N400 amplitude in response to the final words was significantly attenuated in the shape-related compared to the unrelated condition. Taken together, these results suggest that listeners can activate perceptual attributes of objects before they are referred to in an utterance.

AB - When comprehending concrete words, listeners and readers can activate specific visual information such as the shape of the words' referents. In two experiments we examined whether such information can be activated in an anticipatory fashion. In Experiment 1, listeners' eye movements were tracked while they were listening to sentences that were predictive of a specific critical word (e.g., “moon” in “In 1969 Neil Armstrong was the first man to set foot on the moon”). 500 ms before the acoustic onset of the critical word, participants were shown four-object displays featuring three unrelated distractor objects and a critical object, which was either the target object (e.g., moon), an object with a similar shape (e.g., tomato), or an unrelated control object (e.g., rice). In a time window before shape information from the spoken target word could be retrieved, participants already tended to fixate both the target and the shape competitors more often than they fixated the control objects, indicating that they had anticipatorily activated the shape of the upcoming word's referent. This was confirmed in Experiment 2, which was an ERP experiment without picture displays. Participants listened to the same lead-in sentences as in Experiment 1. The sentence-final words corresponded to the predictable target, the shape competitor, or the unrelated control object (yielding, for instance, “In 1969 Neil Armstrong was the first man to set foot on the moon/tomato/rice”). N400 amplitude in response to the final words was significantly attenuated in the shape-related compared to the unrelated condition. Taken together, these results suggest that listeners can activate perceptual attributes of objects before they are referred to in an utterance.

KW - Predictive sentence processing

KW - Visual representations

KW - Eye-tracking

KW - Event-related potentials (ERPs)

KW - N400

UR - https://repository.ubn.ru.nl/handle/2066/116713

U2 - 10.1016/j.neuropsychologia.2012.12.002

DO - 10.1016/j.neuropsychologia.2012.12.002

M3 - Article

VL - 51

SP - 437

EP - 447

JO - Neuropsychologia

JF - Neuropsychologia

SN - 0028-3932

IS - 3

ER -