Giving Good Directions

Order of Mention Reflects Visual Salience

Alasdair D F Clarke, Micha Elsner, Hannah Rohde

Research output: Contribution to journalArticle

6 Citations (Scopus)
4 Downloads (Pure)

Abstract

In complex stimuli, there are many different possible ways to refer to a specified target. Previous studies have shown that when people are faced with such a task, the content of their referring expression reflects visual properties such as size, salience, and clutter. Here, we extend these findings and present evidence that (i) the influence of visual perception on sentence construction goes beyond content selection and in part determines the order in which different objects are mentioned and (ii) order of mention influences comprehension. Study 1 (a corpus study of reference productions) shows that when a speaker uses a relational description to mention a salient object, that object is treated as being in the common ground and is more likely to be mentioned first. Study 2 (a visual search study) asks participants to listen to referring expressions and find the specified target; in keeping with the above result, we find that search for easy-to-find targets is faster when the target is mentioned first, while search for harder-to-find targets is facilitated by mentioning the target later, after a landmark in a relational description. Our findings show that seemingly low-level and disparate mental "modules" like perception and sentence planning interact at a high level and in task-dependent ways.

Original languageEnglish
Article number01793
Number of pages10
JournalFrontiers in Psychology
Volume6
Early online date9 Dec 2015
DOIs
Publication statusPublished - 9 Dec 2015

Fingerprint

Visual Perception
Direction compound

Keywords

  • referring expressions
  • visual searc
  • visual salience

Cite this

Giving Good Directions : Order of Mention Reflects Visual Salience. / Clarke, Alasdair D F; Elsner, Micha; Rohde, Hannah.

In: Frontiers in Psychology, Vol. 6, 01793, 09.12.2015.

Research output: Contribution to journalArticle

Clarke, Alasdair D F ; Elsner, Micha ; Rohde, Hannah. / Giving Good Directions : Order of Mention Reflects Visual Salience. In: Frontiers in Psychology. 2015 ; Vol. 6.
@article{473f91db39004bf7a9d324dd8da57eb5,
title = "Giving Good Directions: Order of Mention Reflects Visual Salience",
abstract = "In complex stimuli, there are many different possible ways to refer to a specified target. Previous studies have shown that when people are faced with such a task, the content of their referring expression reflects visual properties such as size, salience, and clutter. Here, we extend these findings and present evidence that (i) the influence of visual perception on sentence construction goes beyond content selection and in part determines the order in which different objects are mentioned and (ii) order of mention influences comprehension. Study 1 (a corpus study of reference productions) shows that when a speaker uses a relational description to mention a salient object, that object is treated as being in the common ground and is more likely to be mentioned first. Study 2 (a visual search study) asks participants to listen to referring expressions and find the specified target; in keeping with the above result, we find that search for easy-to-find targets is faster when the target is mentioned first, while search for harder-to-find targets is facilitated by mentioning the target later, after a landmark in a relational description. Our findings show that seemingly low-level and disparate mental {"}modules{"} like perception and sentence planning interact at a high level and in task-dependent ways.",
keywords = "referring expressions, visual searc, visual salience",
author = "Clarke, {Alasdair D F} and Micha Elsner and Hannah Rohde",
note = "Date of Acceptance: 06/11/2015 The open access publication of this work was generously supported by the College of Humanities and Social Sciences at the University of Edinburgh.",
year = "2015",
month = "12",
day = "9",
doi = "10.3389/fpsyg.2015.01793",
language = "English",
volume = "6",
journal = "Frontiers in Psychology",
issn = "1664-1078",
publisher = "Frontiers Media S.A.",

}

TY - JOUR

T1 - Giving Good Directions

T2 - Order of Mention Reflects Visual Salience

AU - Clarke, Alasdair D F

AU - Elsner, Micha

AU - Rohde, Hannah

N1 - Date of Acceptance: 06/11/2015 The open access publication of this work was generously supported by the College of Humanities and Social Sciences at the University of Edinburgh.

PY - 2015/12/9

Y1 - 2015/12/9

N2 - In complex stimuli, there are many different possible ways to refer to a specified target. Previous studies have shown that when people are faced with such a task, the content of their referring expression reflects visual properties such as size, salience, and clutter. Here, we extend these findings and present evidence that (i) the influence of visual perception on sentence construction goes beyond content selection and in part determines the order in which different objects are mentioned and (ii) order of mention influences comprehension. Study 1 (a corpus study of reference productions) shows that when a speaker uses a relational description to mention a salient object, that object is treated as being in the common ground and is more likely to be mentioned first. Study 2 (a visual search study) asks participants to listen to referring expressions and find the specified target; in keeping with the above result, we find that search for easy-to-find targets is faster when the target is mentioned first, while search for harder-to-find targets is facilitated by mentioning the target later, after a landmark in a relational description. Our findings show that seemingly low-level and disparate mental "modules" like perception and sentence planning interact at a high level and in task-dependent ways.

AB - In complex stimuli, there are many different possible ways to refer to a specified target. Previous studies have shown that when people are faced with such a task, the content of their referring expression reflects visual properties such as size, salience, and clutter. Here, we extend these findings and present evidence that (i) the influence of visual perception on sentence construction goes beyond content selection and in part determines the order in which different objects are mentioned and (ii) order of mention influences comprehension. Study 1 (a corpus study of reference productions) shows that when a speaker uses a relational description to mention a salient object, that object is treated as being in the common ground and is more likely to be mentioned first. Study 2 (a visual search study) asks participants to listen to referring expressions and find the specified target; in keeping with the above result, we find that search for easy-to-find targets is faster when the target is mentioned first, while search for harder-to-find targets is facilitated by mentioning the target later, after a landmark in a relational description. Our findings show that seemingly low-level and disparate mental "modules" like perception and sentence planning interact at a high level and in task-dependent ways.

KW - referring expressions

KW - visual searc

KW - visual salience

U2 - 10.3389/fpsyg.2015.01793

DO - 10.3389/fpsyg.2015.01793

M3 - Article

VL - 6

JO - Frontiers in Psychology

JF - Frontiers in Psychology

SN - 1664-1078

M1 - 01793

ER -