Hearing brighter

Changing in-depth visual perception through looming sounds

Clare AM Sutherland, Gregor Thut, Vincenzo Romei (Corresponding Author)

Research output: Contribution to journalArticle

11 Citations (Scopus)

Abstract

Rapidly approaching (looming) sounds are ecologically salient stimuli that are perceived as nearer than they are due to overestimation of their loudness change and underestimation of their distance (Neuhoff, 1998; Seifritz et al., 2002). Despite evidence for crossmodal influence by looming sounds onto visual areas (Romei, Murray, Cappe, & Thut, 2009, 2013; Tyll et al., 2013), it is unknown whether such sounds bias visual percepts in similar ways. Nearer objects appear to be larger and brighter than distant objects. If looming sounds impact visual processing, then visual stimuli paired with looming sounds should be perceived as brighter and larger, even when the visual stimuli do not provide motion cues, i.e. are static. In Experiment 1 we found that static visual objects paired with looming tones (but not static or receding tones) were perceived as larger and brighter than their actual physical properties, as if they appear closer to the observer. In a second experiment, we replicate and extend the findings of Experiment 1. Crucially, we did not find evidence of such bias by looming sounds when visual processing was disrupted via masking or when catch trials were presented, ruling out simple response bias. Finally, in a third experiment we found that looming tones do not bias visual stimulus characteristics that do not carry visual depth information such as shape, providing further evidence that they specifically impact in-depth visual processing. We conclude that looming sounds impact visual perception through a mechanism transferring in-depth sound motion information onto the relevant in-depth visual dimensions (such as size and luminance but not shape) in a crossmodal remapping of information for a genuine, evolutionary advantage in stimulus detection.

Original languageEnglish
Pages (from-to)312-323
Number of pages11
JournalCognition
Volume132
Issue number3
Early online date22 May 2014
DOIs
Publication statusPublished - Sep 2014

Fingerprint

Depth Perception
visual perception
Visual Perception
Hearing
stimulus
experiment
trend
evidence
Sound
Cues
Experiment

Keywords

  • crossmodal perception
  • looming sounds
  • audio-visual integration

Cite this

Hearing brighter : Changing in-depth visual perception through looming sounds. / Sutherland, Clare AM; Thut, Gregor; Romei, Vincenzo (Corresponding Author).

In: Cognition, Vol. 132, No. 3, 09.2014, p. 312-323.

Research output: Contribution to journalArticle

Sutherland, Clare AM ; Thut, Gregor ; Romei, Vincenzo. / Hearing brighter : Changing in-depth visual perception through looming sounds. In: Cognition. 2014 ; Vol. 132, No. 3. pp. 312-323.
@article{cf21195d8b1b4668b41da7e64c713f29,
title = "Hearing brighter: Changing in-depth visual perception through looming sounds",
abstract = "Rapidly approaching (looming) sounds are ecologically salient stimuli that are perceived as nearer than they are due to overestimation of their loudness change and underestimation of their distance (Neuhoff, 1998; Seifritz et al., 2002). Despite evidence for crossmodal influence by looming sounds onto visual areas (Romei, Murray, Cappe, & Thut, 2009, 2013; Tyll et al., 2013), it is unknown whether such sounds bias visual percepts in similar ways. Nearer objects appear to be larger and brighter than distant objects. If looming sounds impact visual processing, then visual stimuli paired with looming sounds should be perceived as brighter and larger, even when the visual stimuli do not provide motion cues, i.e. are static. In Experiment 1 we found that static visual objects paired with looming tones (but not static or receding tones) were perceived as larger and brighter than their actual physical properties, as if they appear closer to the observer. In a second experiment, we replicate and extend the findings of Experiment 1. Crucially, we did not find evidence of such bias by looming sounds when visual processing was disrupted via masking or when catch trials were presented, ruling out simple response bias. Finally, in a third experiment we found that looming tones do not bias visual stimulus characteristics that do not carry visual depth information such as shape, providing further evidence that they specifically impact in-depth visual processing. We conclude that looming sounds impact visual perception through a mechanism transferring in-depth sound motion information onto the relevant in-depth visual dimensions (such as size and luminance but not shape) in a crossmodal remapping of information for a genuine, evolutionary advantage in stimulus detection.",
keywords = "crossmodal perception, looming sounds, audio-visual integration",
author = "Sutherland, {Clare AM} and Gregor Thut and Vincenzo Romei",
note = "Portions of this research were carried out by the first author as partial fulfilment of a B.Sc in Psychology at the University of Glasgow. This work has been supported by the University of Essex Research Promotion Fund grant to VR. The authors report no actual or potential conflicts of interest.",
year = "2014",
month = "9",
doi = "10.1016/j.cognition.2014.04.011",
language = "English",
volume = "132",
pages = "312--323",
journal = "Cognition",
issn = "0010-0277",
publisher = "Elsevier",
number = "3",

}

TY - JOUR

T1 - Hearing brighter

T2 - Changing in-depth visual perception through looming sounds

AU - Sutherland, Clare AM

AU - Thut, Gregor

AU - Romei, Vincenzo

N1 - Portions of this research were carried out by the first author as partial fulfilment of a B.Sc in Psychology at the University of Glasgow. This work has been supported by the University of Essex Research Promotion Fund grant to VR. The authors report no actual or potential conflicts of interest.

PY - 2014/9

Y1 - 2014/9

N2 - Rapidly approaching (looming) sounds are ecologically salient stimuli that are perceived as nearer than they are due to overestimation of their loudness change and underestimation of their distance (Neuhoff, 1998; Seifritz et al., 2002). Despite evidence for crossmodal influence by looming sounds onto visual areas (Romei, Murray, Cappe, & Thut, 2009, 2013; Tyll et al., 2013), it is unknown whether such sounds bias visual percepts in similar ways. Nearer objects appear to be larger and brighter than distant objects. If looming sounds impact visual processing, then visual stimuli paired with looming sounds should be perceived as brighter and larger, even when the visual stimuli do not provide motion cues, i.e. are static. In Experiment 1 we found that static visual objects paired with looming tones (but not static or receding tones) were perceived as larger and brighter than their actual physical properties, as if they appear closer to the observer. In a second experiment, we replicate and extend the findings of Experiment 1. Crucially, we did not find evidence of such bias by looming sounds when visual processing was disrupted via masking or when catch trials were presented, ruling out simple response bias. Finally, in a third experiment we found that looming tones do not bias visual stimulus characteristics that do not carry visual depth information such as shape, providing further evidence that they specifically impact in-depth visual processing. We conclude that looming sounds impact visual perception through a mechanism transferring in-depth sound motion information onto the relevant in-depth visual dimensions (such as size and luminance but not shape) in a crossmodal remapping of information for a genuine, evolutionary advantage in stimulus detection.

AB - Rapidly approaching (looming) sounds are ecologically salient stimuli that are perceived as nearer than they are due to overestimation of their loudness change and underestimation of their distance (Neuhoff, 1998; Seifritz et al., 2002). Despite evidence for crossmodal influence by looming sounds onto visual areas (Romei, Murray, Cappe, & Thut, 2009, 2013; Tyll et al., 2013), it is unknown whether such sounds bias visual percepts in similar ways. Nearer objects appear to be larger and brighter than distant objects. If looming sounds impact visual processing, then visual stimuli paired with looming sounds should be perceived as brighter and larger, even when the visual stimuli do not provide motion cues, i.e. are static. In Experiment 1 we found that static visual objects paired with looming tones (but not static or receding tones) were perceived as larger and brighter than their actual physical properties, as if they appear closer to the observer. In a second experiment, we replicate and extend the findings of Experiment 1. Crucially, we did not find evidence of such bias by looming sounds when visual processing was disrupted via masking or when catch trials were presented, ruling out simple response bias. Finally, in a third experiment we found that looming tones do not bias visual stimulus characteristics that do not carry visual depth information such as shape, providing further evidence that they specifically impact in-depth visual processing. We conclude that looming sounds impact visual perception through a mechanism transferring in-depth sound motion information onto the relevant in-depth visual dimensions (such as size and luminance but not shape) in a crossmodal remapping of information for a genuine, evolutionary advantage in stimulus detection.

KW - crossmodal perception

KW - looming sounds

KW - audio-visual integration

UR - http://research-repository.uwa.edu.au/en/publications/hearing-brighter(0e012e46-7999-4d7b-ba06-b250c5f21e62).html

U2 - 10.1016/j.cognition.2014.04.011

DO - 10.1016/j.cognition.2014.04.011

M3 - Article

VL - 132

SP - 312

EP - 323

JO - Cognition

JF - Cognition

SN - 0010-0277

IS - 3

ER -