Encoding actions and verbs

Tracking the timecourse of relational encoding during message and sentence formulation

Agnieszka E Konopka (Corresponding Author)

Research output: Contribution to journalArticle

9 Downloads (Pure)

Abstract

Two experiments tracked the encoding of relational information (actions at the level of the pre-linguistic message and verbs at the level of the sentence) during formulation of transitive event descriptions (e.g., The tiger is scratching the photographer). At what point during message and sentence formulation do speakers encode actions and verbs? Participants described pictures of transitive events in response to neutral questions (What is happening?), agent questions (What is [the agent] doing?), and patient questions (What is the happening with [the patient]?). The agent and patient questions were intended to change the message-level focus of speakers’ responses and to induce priority encoding of the event action and the sentence verb. The questions had a nearly categorical effect on speakers’ choice of sentence form in their responses (characters mentioned in the questions were produced in subject position, as expected) and a strong effect on the time-course of sentence formulation: speakers rapidly directed their gaze to the part of the event needed to encode contextually new, task-relevant information – first the event action and the sentence verb, and then the sentence object. The distribution of fixations during the “verb-encoding” window showed that speakers encode relational information by fixating both event characters. Comparing formulation of sentences describing events with action-informative agents and action-informative patients showed a small preference for fixating the more informative character both immediately after picture onset (message-level encoding) and during the “verb-encoding” window (sentence-level encoding). The results identify action-specific and verb-specific eye movement signatures in message and sentence formulation.
Original languageEnglish
Pages (from-to)1486-1510
Number of pages25
JournalJournal of Experimental Psychology: Learning, Memory and Cognition
Volume45
Issue number8
Early online date27 Sep 2018
DOIs
Publication statusPublished - Aug 2019

Fingerprint

Proxy
Tigers
event
Linguistics
Eye Movements
photographer
Time Course
Verbs
Encoding
linguistics
experiment

Keywords

  • message and sentence formulation
  • incrementality
  • discourse
  • gaze-speech coordination
  • eye-tracking

Cite this

@article{23e0652016404b69981bb3a15e4f6930,
title = "Encoding actions and verbs: Tracking the timecourse of relational encoding during message and sentence formulation",
abstract = "Two experiments tracked the encoding of relational information (actions at the level of the pre-linguistic message and verbs at the level of the sentence) during formulation of transitive event descriptions (e.g., The tiger is scratching the photographer). At what point during message and sentence formulation do speakers encode actions and verbs? Participants described pictures of transitive events in response to neutral questions (What is happening?), agent questions (What is [the agent] doing?), and patient questions (What is the happening with [the patient]?). The agent and patient questions were intended to change the message-level focus of speakers’ responses and to induce priority encoding of the event action and the sentence verb. The questions had a nearly categorical effect on speakers’ choice of sentence form in their responses (characters mentioned in the questions were produced in subject position, as expected) and a strong effect on the time-course of sentence formulation: speakers rapidly directed their gaze to the part of the event needed to encode contextually new, task-relevant information – first the event action and the sentence verb, and then the sentence object. The distribution of fixations during the “verb-encoding” window showed that speakers encode relational information by fixating both event characters. Comparing formulation of sentences describing events with action-informative agents and action-informative patients showed a small preference for fixating the more informative character both immediately after picture onset (message-level encoding) and during the “verb-encoding” window (sentence-level encoding). The results identify action-specific and verb-specific eye movement signatures in message and sentence formulation.",
keywords = "message and sentence formulation, incrementality, discourse, gaze-speech coordination, eye-tracking",
author = "Konopka, {Agnieszka E}",
note = "Many thanks to Annelies van Wijngaarden and student assistants from the Psychology of Language Department (in particular Esther Kroese, Marloes Graauwmans, and Ilse Wagemakers) for help with data collection and processing, and Tess Forest and Antje Meyer for helpful discussions.",
year = "2019",
month = "8",
doi = "10.1037/xlm0000650",
language = "English",
volume = "45",
pages = "1486--1510",
journal = "Journal of Experimental Psychology: Learning, Memory and Cognition",
issn = "0278-7393",
publisher = "American Psychological Association Inc.",
number = "8",

}

TY - JOUR

T1 - Encoding actions and verbs

T2 - Tracking the timecourse of relational encoding during message and sentence formulation

AU - Konopka, Agnieszka E

N1 - Many thanks to Annelies van Wijngaarden and student assistants from the Psychology of Language Department (in particular Esther Kroese, Marloes Graauwmans, and Ilse Wagemakers) for help with data collection and processing, and Tess Forest and Antje Meyer for helpful discussions.

PY - 2019/8

Y1 - 2019/8

N2 - Two experiments tracked the encoding of relational information (actions at the level of the pre-linguistic message and verbs at the level of the sentence) during formulation of transitive event descriptions (e.g., The tiger is scratching the photographer). At what point during message and sentence formulation do speakers encode actions and verbs? Participants described pictures of transitive events in response to neutral questions (What is happening?), agent questions (What is [the agent] doing?), and patient questions (What is the happening with [the patient]?). The agent and patient questions were intended to change the message-level focus of speakers’ responses and to induce priority encoding of the event action and the sentence verb. The questions had a nearly categorical effect on speakers’ choice of sentence form in their responses (characters mentioned in the questions were produced in subject position, as expected) and a strong effect on the time-course of sentence formulation: speakers rapidly directed their gaze to the part of the event needed to encode contextually new, task-relevant information – first the event action and the sentence verb, and then the sentence object. The distribution of fixations during the “verb-encoding” window showed that speakers encode relational information by fixating both event characters. Comparing formulation of sentences describing events with action-informative agents and action-informative patients showed a small preference for fixating the more informative character both immediately after picture onset (message-level encoding) and during the “verb-encoding” window (sentence-level encoding). The results identify action-specific and verb-specific eye movement signatures in message and sentence formulation.

AB - Two experiments tracked the encoding of relational information (actions at the level of the pre-linguistic message and verbs at the level of the sentence) during formulation of transitive event descriptions (e.g., The tiger is scratching the photographer). At what point during message and sentence formulation do speakers encode actions and verbs? Participants described pictures of transitive events in response to neutral questions (What is happening?), agent questions (What is [the agent] doing?), and patient questions (What is the happening with [the patient]?). The agent and patient questions were intended to change the message-level focus of speakers’ responses and to induce priority encoding of the event action and the sentence verb. The questions had a nearly categorical effect on speakers’ choice of sentence form in their responses (characters mentioned in the questions were produced in subject position, as expected) and a strong effect on the time-course of sentence formulation: speakers rapidly directed their gaze to the part of the event needed to encode contextually new, task-relevant information – first the event action and the sentence verb, and then the sentence object. The distribution of fixations during the “verb-encoding” window showed that speakers encode relational information by fixating both event characters. Comparing formulation of sentences describing events with action-informative agents and action-informative patients showed a small preference for fixating the more informative character both immediately after picture onset (message-level encoding) and during the “verb-encoding” window (sentence-level encoding). The results identify action-specific and verb-specific eye movement signatures in message and sentence formulation.

KW - message and sentence formulation

KW - incrementality

KW - discourse

KW - gaze-speech coordination

KW - eye-tracking

UR - http://www.scopus.com/inward/record.url?scp=85054034564&partnerID=8YFLogxK

UR - http://www.mendeley.com/research/encoding-actions-verbs-tracking-timecourse-relational-encoding-during-message-sentence-formulation

U2 - 10.1037/xlm0000650

DO - 10.1037/xlm0000650

M3 - Article

VL - 45

SP - 1486

EP - 1510

JO - Journal of Experimental Psychology: Learning, Memory and Cognition

JF - Journal of Experimental Psychology: Learning, Memory and Cognition

SN - 0278-7393

IS - 8

ER -