Representation of Maximally Regular Textures in Human Visual Cortex

Peter J. Kohler, Alasdair Clarke, Alexandra Yakovleva, Yanxi Liu, Anthony M. Norcia

Research output: Contribution to journalArticle

28 Citations (Scopus)
4 Downloads (Pure)

Abstract

Naturalistic textures with an intermediate degree of statistical regularity can capture key structural features of natural images (Freeman and Simoncelli, 2011). V2 and later visual areas are sensitive to these features, while primary visual cortex is not (Freeman et al., 2013). Here we expand on this work by investigating a class of textures that have maximal formal regularity, the 17 crystallographic wallpaper groups (Fedorov, 1891). We used texture stimuli from four of the groups that differ in the maximum order of rotation symmetry they contain, and measured neural responses in human participants using functional MRI and high-density EEG. We found that cortical area V3 has a parametric representation of the rotation symmetries in the textures that is not present in either V1 or V2, the first discovery of a stimulus property that differentiates processing in V3 from that of lower-level areas. Parametric responses were also seen in higher-order ventral stream areas V4, VO1, and lateral occipital complex (LOC), but not in dorsal stream areas. The parametric response pattern was replicated in the EEG data, and source localization indicated that responses in V3 and V4 lead responses in LOC, which is consistent with a feedforward mechanism. Finally, we presented our stimuli to four well developed feedforward models and found that none of them were able to account for our results. Our results highlight structural regularity as an important stimulus dimension for distinguishing the early stages of visual processing, and suggest a previously unrecognized role for V3 in the visual form-processing hierarchy.

SIGNIFICANCE STATEMENT: Hierarchical processing is a fundamental organizing principle in visual neuroscience, with each successive processing stage being sensitive to increasingly complex stimulus properties. Here, we probe the encoding hierarchy in human visual cortex using a class of visual textures-wallpaper patterns-that are maximally regular. Through a combination of fMRI and EEG source imaging, we find specific responses to texture regularity that depend parametrically on the maximum order of rotation symmetry in the textures. These parametric responses are seen in several areas of the ventral visual processing stream, as well as in area V3, but not in V1 or V2. This is the first demonstration of a stimulus property that differentiates processing in V3 from that of lower-level visual areas.

Original languageEnglish
Pages (from-to)714-729
Number of pages16
JournalJournal of Neuroscience
Volume36
Issue number3
DOIs
Publication statusPublished - 20 Jan 2016

Fingerprint

Visual Cortex
Electroencephalography
Magnetic Resonance Imaging
Information Storage and Retrieval
Neurosciences

Keywords

  • hierarchical processing
  • mid-level vision
  • perceptual organization
  • symmetry
  • texture
  • ventral stream

Cite this

Kohler, P. J., Clarke, A., Yakovleva, A., Liu, Y., & Norcia, A. M. (2016). Representation of Maximally Regular Textures in Human Visual Cortex. Journal of Neuroscience, 36(3), 714-729. https://doi.org/10.1523/JNEUROSCI.2962-15.2016

Representation of Maximally Regular Textures in Human Visual Cortex. / Kohler, Peter J.; Clarke, Alasdair; Yakovleva, Alexandra; Liu, Yanxi; Norcia, Anthony M.

In: Journal of Neuroscience, Vol. 36, No. 3, 20.01.2016, p. 714-729.

Research output: Contribution to journalArticle

Kohler, PJ, Clarke, A, Yakovleva, A, Liu, Y & Norcia, AM 2016, 'Representation of Maximally Regular Textures in Human Visual Cortex', Journal of Neuroscience, vol. 36, no. 3, pp. 714-729. https://doi.org/10.1523/JNEUROSCI.2962-15.2016
Kohler, Peter J. ; Clarke, Alasdair ; Yakovleva, Alexandra ; Liu, Yanxi ; Norcia, Anthony M. / Representation of Maximally Regular Textures in Human Visual Cortex. In: Journal of Neuroscience. 2016 ; Vol. 36, No. 3. pp. 714-729.
@article{cc72c0c23f484406aae249ad64f7307e,
title = "Representation of Maximally Regular Textures in Human Visual Cortex",
abstract = "Naturalistic textures with an intermediate degree of statistical regularity can capture key structural features of natural images (Freeman and Simoncelli, 2011). V2 and later visual areas are sensitive to these features, while primary visual cortex is not (Freeman et al., 2013). Here we expand on this work by investigating a class of textures that have maximal formal regularity, the 17 crystallographic wallpaper groups (Fedorov, 1891). We used texture stimuli from four of the groups that differ in the maximum order of rotation symmetry they contain, and measured neural responses in human participants using functional MRI and high-density EEG. We found that cortical area V3 has a parametric representation of the rotation symmetries in the textures that is not present in either V1 or V2, the first discovery of a stimulus property that differentiates processing in V3 from that of lower-level areas. Parametric responses were also seen in higher-order ventral stream areas V4, VO1, and lateral occipital complex (LOC), but not in dorsal stream areas. The parametric response pattern was replicated in the EEG data, and source localization indicated that responses in V3 and V4 lead responses in LOC, which is consistent with a feedforward mechanism. Finally, we presented our stimuli to four well developed feedforward models and found that none of them were able to account for our results. Our results highlight structural regularity as an important stimulus dimension for distinguishing the early stages of visual processing, and suggest a previously unrecognized role for V3 in the visual form-processing hierarchy.SIGNIFICANCE STATEMENT: Hierarchical processing is a fundamental organizing principle in visual neuroscience, with each successive processing stage being sensitive to increasingly complex stimulus properties. Here, we probe the encoding hierarchy in human visual cortex using a class of visual textures-wallpaper patterns-that are maximally regular. Through a combination of fMRI and EEG source imaging, we find specific responses to texture regularity that depend parametrically on the maximum order of rotation symmetry in the textures. These parametric responses are seen in several areas of the ventral visual processing stream, as well as in area V3, but not in V1 or V2. This is the first demonstration of a stimulus property that differentiates processing in V3 from that of lower-level visual areas.",
keywords = "hierarchical processing, mid-level vision, perceptual organization, symmetry , texture, ventral stream",
author = "Kohler, {Peter J.} and Alasdair Clarke and Alexandra Yakovleva and Yanxi Liu and Norcia, {Anthony M.}",
note = "This research was supported by National Science Foundation INSPIRE Grant 1248076, which was awarded to Y.L. and A.M.N.",
year = "2016",
month = "1",
day = "20",
doi = "10.1523/JNEUROSCI.2962-15.2016",
language = "English",
volume = "36",
pages = "714--729",
journal = "Journal of Neuroscience",
issn = "0270-6474",
publisher = "Society for Neuroscience",
number = "3",

}

TY - JOUR

T1 - Representation of Maximally Regular Textures in Human Visual Cortex

AU - Kohler, Peter J.

AU - Clarke, Alasdair

AU - Yakovleva, Alexandra

AU - Liu, Yanxi

AU - Norcia, Anthony M.

N1 - This research was supported by National Science Foundation INSPIRE Grant 1248076, which was awarded to Y.L. and A.M.N.

PY - 2016/1/20

Y1 - 2016/1/20

N2 - Naturalistic textures with an intermediate degree of statistical regularity can capture key structural features of natural images (Freeman and Simoncelli, 2011). V2 and later visual areas are sensitive to these features, while primary visual cortex is not (Freeman et al., 2013). Here we expand on this work by investigating a class of textures that have maximal formal regularity, the 17 crystallographic wallpaper groups (Fedorov, 1891). We used texture stimuli from four of the groups that differ in the maximum order of rotation symmetry they contain, and measured neural responses in human participants using functional MRI and high-density EEG. We found that cortical area V3 has a parametric representation of the rotation symmetries in the textures that is not present in either V1 or V2, the first discovery of a stimulus property that differentiates processing in V3 from that of lower-level areas. Parametric responses were also seen in higher-order ventral stream areas V4, VO1, and lateral occipital complex (LOC), but not in dorsal stream areas. The parametric response pattern was replicated in the EEG data, and source localization indicated that responses in V3 and V4 lead responses in LOC, which is consistent with a feedforward mechanism. Finally, we presented our stimuli to four well developed feedforward models and found that none of them were able to account for our results. Our results highlight structural regularity as an important stimulus dimension for distinguishing the early stages of visual processing, and suggest a previously unrecognized role for V3 in the visual form-processing hierarchy.SIGNIFICANCE STATEMENT: Hierarchical processing is a fundamental organizing principle in visual neuroscience, with each successive processing stage being sensitive to increasingly complex stimulus properties. Here, we probe the encoding hierarchy in human visual cortex using a class of visual textures-wallpaper patterns-that are maximally regular. Through a combination of fMRI and EEG source imaging, we find specific responses to texture regularity that depend parametrically on the maximum order of rotation symmetry in the textures. These parametric responses are seen in several areas of the ventral visual processing stream, as well as in area V3, but not in V1 or V2. This is the first demonstration of a stimulus property that differentiates processing in V3 from that of lower-level visual areas.

AB - Naturalistic textures with an intermediate degree of statistical regularity can capture key structural features of natural images (Freeman and Simoncelli, 2011). V2 and later visual areas are sensitive to these features, while primary visual cortex is not (Freeman et al., 2013). Here we expand on this work by investigating a class of textures that have maximal formal regularity, the 17 crystallographic wallpaper groups (Fedorov, 1891). We used texture stimuli from four of the groups that differ in the maximum order of rotation symmetry they contain, and measured neural responses in human participants using functional MRI and high-density EEG. We found that cortical area V3 has a parametric representation of the rotation symmetries in the textures that is not present in either V1 or V2, the first discovery of a stimulus property that differentiates processing in V3 from that of lower-level areas. Parametric responses were also seen in higher-order ventral stream areas V4, VO1, and lateral occipital complex (LOC), but not in dorsal stream areas. The parametric response pattern was replicated in the EEG data, and source localization indicated that responses in V3 and V4 lead responses in LOC, which is consistent with a feedforward mechanism. Finally, we presented our stimuli to four well developed feedforward models and found that none of them were able to account for our results. Our results highlight structural regularity as an important stimulus dimension for distinguishing the early stages of visual processing, and suggest a previously unrecognized role for V3 in the visual form-processing hierarchy.SIGNIFICANCE STATEMENT: Hierarchical processing is a fundamental organizing principle in visual neuroscience, with each successive processing stage being sensitive to increasingly complex stimulus properties. Here, we probe the encoding hierarchy in human visual cortex using a class of visual textures-wallpaper patterns-that are maximally regular. Through a combination of fMRI and EEG source imaging, we find specific responses to texture regularity that depend parametrically on the maximum order of rotation symmetry in the textures. These parametric responses are seen in several areas of the ventral visual processing stream, as well as in area V3, but not in V1 or V2. This is the first demonstration of a stimulus property that differentiates processing in V3 from that of lower-level visual areas.

KW - hierarchical processing

KW - mid-level vision

KW - perceptual organization

KW - symmetry

KW - texture

KW - ventral stream

U2 - 10.1523/JNEUROSCI.2962-15.2016

DO - 10.1523/JNEUROSCI.2962-15.2016

M3 - Article

VL - 36

SP - 714

EP - 729

JO - Journal of Neuroscience

JF - Journal of Neuroscience

SN - 0270-6474

IS - 3

ER -