Linguistic experience and audio-visual perception of non-native fricatives

Yue Wang, Dawn Behne, Haisheng Jiang

    Research output: Contribution to journalArticle

    28 Citations (Scopus)

    Abstract

    This study examined the effects of linguistic experience on audio-visual (AV) perception of non-native (L2) speech. Canadian English natives and Mandarin Chinese natives differing in degree of English exposure [long and short length of residence (LOR) in Canada] were presented with English fricatives of three visually distinct places of articulation: interdentals nonexistent in Mandarin and labiodentals and alveolars common in both languages. Stimuli were presented in quiet and in a café-noise background in four ways: audio only (A), visual only (V), congruent AV (AVc), and incongruent AV (AVi). Identification results showed that overall performance was better in the AVc than in the A or V condition and better in quiet than in café noise. While the Mandarin long LOR group approximated the native English patterns, the short LOR group showed poorer interdental identification, more reliance on visual information, and greater AV-fusion with the AVi materials, indicating the failure of L2 visual speech category formation with the short LOR non-natives and the positive effects of linguistic experience with the long LOR non-natives. These results point to an integrated network in AV speech processing as a function of linguistic background and provide evidence to extend auditory-based L2 speech learning theories to the visual domain
    Original languageEnglish
    Pages (from-to)1716-1726
    Number of pages10
    JournalJournal of the Acoustical Society of America
    Volume124
    Issue number3
    DOIs
    Publication statusPublished - Sep 2008

    Fingerprint

    linguistics
    visual perception
    learning theory
    background noise
    Canada
    stimuli
    fusion
    Length of Residence
    Visual Perception
    Fricatives

    Keywords

    • linguistics
    • speech
    • speech processing
    • visual perception

    Cite this

    Linguistic experience and audio-visual perception of non-native fricatives. / Wang, Yue; Behne, Dawn; Jiang, Haisheng.

    In: Journal of the Acoustical Society of America, Vol. 124, No. 3, 09.2008, p. 1716-1726.

    Research output: Contribution to journalArticle

    Wang, Yue ; Behne, Dawn ; Jiang, Haisheng. / Linguistic experience and audio-visual perception of non-native fricatives. In: Journal of the Acoustical Society of America. 2008 ; Vol. 124, No. 3. pp. 1716-1726.
    @article{f999c2ee3d024246bcc91726105daf49,
    title = "Linguistic experience and audio-visual perception of non-native fricatives",
    abstract = "This study examined the effects of linguistic experience on audio-visual (AV) perception of non-native (L2) speech. Canadian English natives and Mandarin Chinese natives differing in degree of English exposure [long and short length of residence (LOR) in Canada] were presented with English fricatives of three visually distinct places of articulation: interdentals nonexistent in Mandarin and labiodentals and alveolars common in both languages. Stimuli were presented in quiet and in a caf{\'e}-noise background in four ways: audio only (A), visual only (V), congruent AV (AVc), and incongruent AV (AVi). Identification results showed that overall performance was better in the AVc than in the A or V condition and better in quiet than in caf{\'e} noise. While the Mandarin long LOR group approximated the native English patterns, the short LOR group showed poorer interdental identification, more reliance on visual information, and greater AV-fusion with the AVi materials, indicating the failure of L2 visual speech category formation with the short LOR non-natives and the positive effects of linguistic experience with the long LOR non-natives. These results point to an integrated network in AV speech processing as a function of linguistic background and provide evidence to extend auditory-based L2 speech learning theories to the visual domain",
    keywords = "linguistics , speech, speech processing, visual perception",
    author = "Yue Wang and Dawn Behne and Haisheng Jiang",
    year = "2008",
    month = "9",
    doi = "10.1121/1.2956483",
    language = "English",
    volume = "124",
    pages = "1716--1726",
    journal = "Journal of the Acoustical Society of America",
    issn = "0001-4966",
    publisher = "ACOUSTICAL SOC AMER AMER INST PHYSICS",
    number = "3",

    }

    TY - JOUR

    T1 - Linguistic experience and audio-visual perception of non-native fricatives

    AU - Wang, Yue

    AU - Behne, Dawn

    AU - Jiang, Haisheng

    PY - 2008/9

    Y1 - 2008/9

    N2 - This study examined the effects of linguistic experience on audio-visual (AV) perception of non-native (L2) speech. Canadian English natives and Mandarin Chinese natives differing in degree of English exposure [long and short length of residence (LOR) in Canada] were presented with English fricatives of three visually distinct places of articulation: interdentals nonexistent in Mandarin and labiodentals and alveolars common in both languages. Stimuli were presented in quiet and in a café-noise background in four ways: audio only (A), visual only (V), congruent AV (AVc), and incongruent AV (AVi). Identification results showed that overall performance was better in the AVc than in the A or V condition and better in quiet than in café noise. While the Mandarin long LOR group approximated the native English patterns, the short LOR group showed poorer interdental identification, more reliance on visual information, and greater AV-fusion with the AVi materials, indicating the failure of L2 visual speech category formation with the short LOR non-natives and the positive effects of linguistic experience with the long LOR non-natives. These results point to an integrated network in AV speech processing as a function of linguistic background and provide evidence to extend auditory-based L2 speech learning theories to the visual domain

    AB - This study examined the effects of linguistic experience on audio-visual (AV) perception of non-native (L2) speech. Canadian English natives and Mandarin Chinese natives differing in degree of English exposure [long and short length of residence (LOR) in Canada] were presented with English fricatives of three visually distinct places of articulation: interdentals nonexistent in Mandarin and labiodentals and alveolars common in both languages. Stimuli were presented in quiet and in a café-noise background in four ways: audio only (A), visual only (V), congruent AV (AVc), and incongruent AV (AVi). Identification results showed that overall performance was better in the AVc than in the A or V condition and better in quiet than in café noise. While the Mandarin long LOR group approximated the native English patterns, the short LOR group showed poorer interdental identification, more reliance on visual information, and greater AV-fusion with the AVi materials, indicating the failure of L2 visual speech category formation with the short LOR non-natives and the positive effects of linguistic experience with the long LOR non-natives. These results point to an integrated network in AV speech processing as a function of linguistic background and provide evidence to extend auditory-based L2 speech learning theories to the visual domain

    KW - linguistics

    KW - speech

    KW - speech processing

    KW - visual perception

    U2 - 10.1121/1.2956483

    DO - 10.1121/1.2956483

    M3 - Article

    VL - 124

    SP - 1716

    EP - 1726

    JO - Journal of the Acoustical Society of America

    JF - Journal of the Acoustical Society of America

    SN - 0001-4966

    IS - 3

    ER -