Reference Production as Search: The Impact of Domain Size on the Production of Distinguishing Descriptions

Albert Gatt, Emiel Krahmer, Kees Van Deemter, Roger P. G. van Gompel

Research output: Contribution to journalArticle

7 Citations (Scopus)

Abstract

When producing a description of a target referent in a visual context, speakers need to choose a set of properties that distinguish it from its distractors. Computational models of language production/generation usually model this as a search process and predict that the time taken will increase both with the number of distractors in a scene and with the number of properties required to distinguish the target. These predictions are reminiscent of classic fndings in visual search; however, unlike models of reference production, visual search models also predict that search can become very ecient under certain conditions, something that reference production models do not consider. This paper investigates the predictions of these models empirically. In two experiments, we show that the time taken to plan a referring expression (as reflected by speech onset latencies) is influenced by distractor set size and by the number of properties required, but this crucially depends on the discriminability of the properties under consideration. We discuss the implications for current models of reference production and recent work on the role of salience in visual search.
Original languageEnglish
Pages (from-to)1457-1492
Number of pages36
JournalCognitive Science
Volume41
Issue numberS6
Early online date6 Jun 2016
DOIs
Publication statusPublished - May 2017

Fingerprint

Language
Distractor
Visual Search
Experiments
Prediction
Referring Expressions
Onset
Computational Model
Experiment
Language Production
Referent
Latency

Keywords

  • reference
  • language production
  • visual search
  • salience
  • computational models

ASJC Scopus subject areas

  • Arts and Humanities(all)
  • Computer Science(all)
  • Neuroscience(all)
  • Psychology(all)

Cite this

Reference Production as Search : The Impact of Domain Size on the Production of Distinguishing Descriptions. / Gatt, Albert; Krahmer, Emiel; Van Deemter, Kees ; van Gompel, Roger P. G.

In: Cognitive Science, Vol. 41, No. S6, 05.2017, p. 1457-1492.

Research output: Contribution to journalArticle

Gatt, Albert ; Krahmer, Emiel ; Van Deemter, Kees ; van Gompel, Roger P. G. / Reference Production as Search : The Impact of Domain Size on the Production of Distinguishing Descriptions. In: Cognitive Science. 2017 ; Vol. 41, No. S6. pp. 1457-1492.
@article{2f61e9d6ade94f6f8b3b4e2755560690,
title = "Reference Production as Search: The Impact of Domain Size on the Production of Distinguishing Descriptions",
abstract = "When producing a description of a target referent in a visual context, speakers need to choose a set of properties that distinguish it from its distractors. Computational models of language production/generation usually model this as a search process and predict that the time taken will increase both with the number of distractors in a scene and with the number of properties required to distinguish the target. These predictions are reminiscent of classic fndings in visual search; however, unlike models of reference production, visual search models also predict that search can become very ecient under certain conditions, something that reference production models do not consider. This paper investigates the predictions of these models empirically. In two experiments, we show that the time taken to plan a referring expression (as reflected by speech onset latencies) is influenced by distractor set size and by the number of properties required, but this crucially depends on the discriminability of the properties under consideration. We discuss the implications for current models of reference production and recent work on the role of salience in visual search.",
keywords = "reference, language production, visual search, salience , computational models",
author = "Albert Gatt and Emiel Krahmer and {Van Deemter}, Kees and {van Gompel}, {Roger P. G.}",
note = "The authors thank the anonymous reviewers of this manuscript for many insightful comments and discussion. AG and EK received financial support from The Netherlands Organization for Scientific Research, via a Vici Grant (NWO Grant 27770007), which is gratefully acknowledged. KvD was supported by the RefNet project (EPSRC award EP/J019615/1). Thanks are also due to Ms. Manon Yassa and Ms. Kristel Bartels for their help in conducting the experiments and transcription of the data.",
year = "2017",
month = "5",
doi = "10.1111/cogs.12375",
language = "English",
volume = "41",
pages = "1457--1492",
journal = "Cognitive Science",
issn = "0364-0213",
publisher = "Wiley-Blackwell",
number = "S6",

}

TY - JOUR

T1 - Reference Production as Search

T2 - The Impact of Domain Size on the Production of Distinguishing Descriptions

AU - Gatt, Albert

AU - Krahmer, Emiel

AU - Van Deemter, Kees

AU - van Gompel, Roger P. G.

N1 - The authors thank the anonymous reviewers of this manuscript for many insightful comments and discussion. AG and EK received financial support from The Netherlands Organization for Scientific Research, via a Vici Grant (NWO Grant 27770007), which is gratefully acknowledged. KvD was supported by the RefNet project (EPSRC award EP/J019615/1). Thanks are also due to Ms. Manon Yassa and Ms. Kristel Bartels for their help in conducting the experiments and transcription of the data.

PY - 2017/5

Y1 - 2017/5

N2 - When producing a description of a target referent in a visual context, speakers need to choose a set of properties that distinguish it from its distractors. Computational models of language production/generation usually model this as a search process and predict that the time taken will increase both with the number of distractors in a scene and with the number of properties required to distinguish the target. These predictions are reminiscent of classic fndings in visual search; however, unlike models of reference production, visual search models also predict that search can become very ecient under certain conditions, something that reference production models do not consider. This paper investigates the predictions of these models empirically. In two experiments, we show that the time taken to plan a referring expression (as reflected by speech onset latencies) is influenced by distractor set size and by the number of properties required, but this crucially depends on the discriminability of the properties under consideration. We discuss the implications for current models of reference production and recent work on the role of salience in visual search.

AB - When producing a description of a target referent in a visual context, speakers need to choose a set of properties that distinguish it from its distractors. Computational models of language production/generation usually model this as a search process and predict that the time taken will increase both with the number of distractors in a scene and with the number of properties required to distinguish the target. These predictions are reminiscent of classic fndings in visual search; however, unlike models of reference production, visual search models also predict that search can become very ecient under certain conditions, something that reference production models do not consider. This paper investigates the predictions of these models empirically. In two experiments, we show that the time taken to plan a referring expression (as reflected by speech onset latencies) is influenced by distractor set size and by the number of properties required, but this crucially depends on the discriminability of the properties under consideration. We discuss the implications for current models of reference production and recent work on the role of salience in visual search.

KW - reference

KW - language production

KW - visual search

KW - salience

KW - computational models

U2 - 10.1111/cogs.12375

DO - 10.1111/cogs.12375

M3 - Article

VL - 41

SP - 1457

EP - 1492

JO - Cognitive Science

JF - Cognitive Science

SN - 0364-0213

IS - S6

ER -