The Elephant in the Room

Inconsistency in Scene Viewing and Representation

Sara Spotorno, Benjamin W. Tatler (Corresponding Author)

Research output: Contribution to journalArticle

3 Citations (Scopus)
7 Downloads (Pure)

Abstract

We examined the extent to which semantic informativeness, consistency with expectations and perceptual salience contribute to object prioritisation in scene viewing and representation. In scene viewing (Experiments 1-2), semantic guidance overshadowed perceptual guidance in determining fixation order, with the greatest prioritisation for objects that were diagnostic of the scene’s depicted event. Perceptual properties affected selection of consistent objects (regardless of their informativeness) but not of inconsistent objects. Semantic and perceptual properties also interacted in influencing foveal inspection, as inconsistent objects were fixated longer than low but not high salience diagnostic objects. While not studied in direct competition with each other (each studied in competition with diagnostic objects), we found that inconsistent objects were fixated earlier and for longer than consistent but marginally informative objects. In change detection (Experiment 3), perceptual guidance overshadowed semantic guidance, promoting detection of highly salient changes. A residual advantage for diagnosticity over inconsistency emerged only when selection prioritisation could not be based on low-level features. Overall these findings show that semantic inconsistency is not prioritised within a scene when competing with other relevant information that is essential to scene understanding and respects observers’ expectations. Moreover, they reveal that the relative dominance of semantic or perceptual properties during selection depends on ongoing task requirements.
Original languageEnglish
Pages (from-to)1717-1743
Number of pages27
JournalJournal of Experimental Psychology: Human Perception and Performance
Volume43
Issue number10
DOIs
Publication statusPublished - 31 Oct 2017

Fingerprint

Semantics
Inconsistency
Guidance

Keywords

  • Semantic Consistency
  • Perceptual Salience
  • Scene Viewing
  • Change Detection
  • Eye Movements

Cite this

@article{876d0dfe2b3e4c29b9c0cef8ffcb2509,
title = "The Elephant in the Room: Inconsistency in Scene Viewing and Representation",
abstract = "We examined the extent to which semantic informativeness, consistency with expectations and perceptual salience contribute to object prioritisation in scene viewing and representation. In scene viewing (Experiments 1-2), semantic guidance overshadowed perceptual guidance in determining fixation order, with the greatest prioritisation for objects that were diagnostic of the scene’s depicted event. Perceptual properties affected selection of consistent objects (regardless of their informativeness) but not of inconsistent objects. Semantic and perceptual properties also interacted in influencing foveal inspection, as inconsistent objects were fixated longer than low but not high salience diagnostic objects. While not studied in direct competition with each other (each studied in competition with diagnostic objects), we found that inconsistent objects were fixated earlier and for longer than consistent but marginally informative objects. In change detection (Experiment 3), perceptual guidance overshadowed semantic guidance, promoting detection of highly salient changes. A residual advantage for diagnosticity over inconsistency emerged only when selection prioritisation could not be based on low-level features. Overall these findings show that semantic inconsistency is not prioritised within a scene when competing with other relevant information that is essential to scene understanding and respects observers’ expectations. Moreover, they reveal that the relative dominance of semantic or perceptual properties during selection depends on ongoing task requirements.",
keywords = "Semantic Consistency , Perceptual Salience, Scene Viewing, Change Detection, Eye Movements",
author = "Sara Spotorno and Tatler, {Benjamin W.}",
note = "We are very grateful to Andrew McKechnie for conducting a pilot study that informed the design and analysis of the data presented in Experiment 3 of the present study. For assistance with data collection for Experiments 1 and 2 we thank Ilaria Dal Lago, Anais Leroy, Teodor Nikolov, Hannah Nsiah-Amoako, Hanane Ramzaoui, Lara Wilson and Radia Zaghari. We also thank Monica Castelhano, Carrick Williams and an anonymous reviewer for thorough and helpful suggestions to improve this manuscript.",
year = "2017",
month = "10",
day = "31",
doi = "10.1037/xhp0000456",
language = "English",
volume = "43",
pages = "1717--1743",
journal = "Journal of Experimental Psychology: Human Perception and Performance",
issn = "0096-1523",
publisher = "American Psychological Association Inc.",
number = "10",

}

TY - JOUR

T1 - The Elephant in the Room

T2 - Inconsistency in Scene Viewing and Representation

AU - Spotorno, Sara

AU - Tatler, Benjamin W.

N1 - We are very grateful to Andrew McKechnie for conducting a pilot study that informed the design and analysis of the data presented in Experiment 3 of the present study. For assistance with data collection for Experiments 1 and 2 we thank Ilaria Dal Lago, Anais Leroy, Teodor Nikolov, Hannah Nsiah-Amoako, Hanane Ramzaoui, Lara Wilson and Radia Zaghari. We also thank Monica Castelhano, Carrick Williams and an anonymous reviewer for thorough and helpful suggestions to improve this manuscript.

PY - 2017/10/31

Y1 - 2017/10/31

N2 - We examined the extent to which semantic informativeness, consistency with expectations and perceptual salience contribute to object prioritisation in scene viewing and representation. In scene viewing (Experiments 1-2), semantic guidance overshadowed perceptual guidance in determining fixation order, with the greatest prioritisation for objects that were diagnostic of the scene’s depicted event. Perceptual properties affected selection of consistent objects (regardless of their informativeness) but not of inconsistent objects. Semantic and perceptual properties also interacted in influencing foveal inspection, as inconsistent objects were fixated longer than low but not high salience diagnostic objects. While not studied in direct competition with each other (each studied in competition with diagnostic objects), we found that inconsistent objects were fixated earlier and for longer than consistent but marginally informative objects. In change detection (Experiment 3), perceptual guidance overshadowed semantic guidance, promoting detection of highly salient changes. A residual advantage for diagnosticity over inconsistency emerged only when selection prioritisation could not be based on low-level features. Overall these findings show that semantic inconsistency is not prioritised within a scene when competing with other relevant information that is essential to scene understanding and respects observers’ expectations. Moreover, they reveal that the relative dominance of semantic or perceptual properties during selection depends on ongoing task requirements.

AB - We examined the extent to which semantic informativeness, consistency with expectations and perceptual salience contribute to object prioritisation in scene viewing and representation. In scene viewing (Experiments 1-2), semantic guidance overshadowed perceptual guidance in determining fixation order, with the greatest prioritisation for objects that were diagnostic of the scene’s depicted event. Perceptual properties affected selection of consistent objects (regardless of their informativeness) but not of inconsistent objects. Semantic and perceptual properties also interacted in influencing foveal inspection, as inconsistent objects were fixated longer than low but not high salience diagnostic objects. While not studied in direct competition with each other (each studied in competition with diagnostic objects), we found that inconsistent objects were fixated earlier and for longer than consistent but marginally informative objects. In change detection (Experiment 3), perceptual guidance overshadowed semantic guidance, promoting detection of highly salient changes. A residual advantage for diagnosticity over inconsistency emerged only when selection prioritisation could not be based on low-level features. Overall these findings show that semantic inconsistency is not prioritised within a scene when competing with other relevant information that is essential to scene understanding and respects observers’ expectations. Moreover, they reveal that the relative dominance of semantic or perceptual properties during selection depends on ongoing task requirements.

KW - Semantic Consistency

KW - Perceptual Salience

KW - Scene Viewing

KW - Change Detection

KW - Eye Movements

U2 - 10.1037/xhp0000456

DO - 10.1037/xhp0000456

M3 - Article

VL - 43

SP - 1717

EP - 1743

JO - Journal of Experimental Psychology: Human Perception and Performance

JF - Journal of Experimental Psychology: Human Perception and Performance

SN - 0096-1523

IS - 10

ER -