Crowding in humans is unlike that in convolutional neural networks

Ben Lonnqvist*, Alasdair D. F. Clarke, Ramakrishna Chakravarthi

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

7 Citations (Scopus)
5 Downloads (Pure)

Abstract

Object recognition is a primary function of the human visual system. It has recently been claimed that the highly successful ability to recognise objects in a set of emergent computer vision systems—Deep Convolutional Neural Networks (DCNNs)—can form a useful guide to recognition in humans. To test this assertion, we systematically evaluated visual crowding, a dramatic breakdown of recognition in clutter, in DCNNs and compared their performance to extant research in humans. We examined crowding in three architectures of DCNNs with the same methodology as that used among humans. We manipulated multiple stimulus factors including inter-letter spacing, letter colour, size, and flanker location to assess the extent and shape of crowding in DCNNs. We found that crowding followed a predictable pattern across architectures that was different from that in humans. Some characteristic hallmarks of human crowding, such as invariance to size, the effect of target-flanker similarity, and confusions between target and flanker identities, were completely missing, minimised or even reversed. These data show that DCNNs, while proficient in object recognition, likely achieve this competence through a set of mechanisms that are distinct from those in humans. They are not necessarily equivalent models of human or primate object recognition and caution must be exercised when inferring mechanisms derived from their operation.
Original languageEnglish
Pages (from-to)262-274
Number of pages13
JournalNeural Networks
Volume126
Early online date27 Mar 2020
DOIs
Publication statusPublished - Jun 2020

Bibliographical note

Acknowledgements
We would like to acknowledge the use of a Tesla K40 GPU card that has been donated to Dr M. S. Baptista by Nvidia. We would also like to thank Dr Micha Elsner for helpful discussions.

Keywords

  • convolutional neural networks
  • object recognition
  • crowding
  • OBJECT RECOGNITION
  • MASKING
  • SPATIAL INTERACTION
  • Convolutional neural networks
  • Object recognition
  • Crowding

Fingerprint

Dive into the research topics of 'Crowding in humans is unlike that in convolutional neural networks'. Together they form a unique fingerprint.

Cite this