Influence of native language phonetic system on audio-visual speech perception

Yue Wang, Dawn M Behne, Haisheng Jiang

Research output: Contribution to journalArticle

22 Citations (Scopus)

Abstract

This study examines how native language (L1) experience affects auditory–visual (AV) perception of nonnative (L2) speech. Korean, Mandarin and English perceivers were presented with English CV syllables containing fricatives with three places of articulation: labiodentals nonexistent in Korean, interdentals nonexistent in Korean and Mandarin, and alveolars occurring in all three L1s. The stimuli were presented as auditory-only, visual-only, congruent AV and incongruent AV. Results show that for the labiodentals which are nonnative in Korean, the Koreans had lower accuracy for the visual domain than the English and the Mandarin perceivers, but they nevertheless achieved native-level perception in the auditory and AV domains. For the interdentals nonexistent in Korean and Mandarin, while both nonnative groups had lower accuracy in the auditory domain than the native English group, they benefited from the visual information with improved performance in AV perception. Comparing the two nonnative groups, the Mandarin perceivers showed poorer auditory and AV identification for the interdentals and greater AV-fusion with the incongruent AV material than did the Koreans. These results indicate that nonnative perceivers are able to use visual speech information in L2 perception, although acquiring accurate use of the auditory and visual domains may not be similarly achieved across native groups, a process influenced by L1 experience.
Original languageEnglish
Pages (from-to)344-356
Number of pages13
JournalJournal of Phonetics
Volume37
Issue number3
DOIs
Publication statusPublished - Jul 2009

Fingerprint

Speech Perception
Visual Perception
Phonetics
phonetics
Language
language
Auditory Perception
Group Processes
Group
stimulus
experience
Native Language
Audiovisual Speech
Hearing
performance
Interdentals

Cite this

Influence of native language phonetic system on audio-visual speech perception. / Wang, Yue; Behne, Dawn M; Jiang, Haisheng.

In: Journal of Phonetics, Vol. 37, No. 3, 07.2009, p. 344-356.

Research output: Contribution to journalArticle

Wang, Yue ; Behne, Dawn M ; Jiang, Haisheng. / Influence of native language phonetic system on audio-visual speech perception. In: Journal of Phonetics. 2009 ; Vol. 37, No. 3. pp. 344-356.
@article{baeb07af0cbb462a98e24ef2747439c9,
title = "Influence of native language phonetic system on audio-visual speech perception",
abstract = "This study examines how native language (L1) experience affects auditory–visual (AV) perception of nonnative (L2) speech. Korean, Mandarin and English perceivers were presented with English CV syllables containing fricatives with three places of articulation: labiodentals nonexistent in Korean, interdentals nonexistent in Korean and Mandarin, and alveolars occurring in all three L1s. The stimuli were presented as auditory-only, visual-only, congruent AV and incongruent AV. Results show that for the labiodentals which are nonnative in Korean, the Koreans had lower accuracy for the visual domain than the English and the Mandarin perceivers, but they nevertheless achieved native-level perception in the auditory and AV domains. For the interdentals nonexistent in Korean and Mandarin, while both nonnative groups had lower accuracy in the auditory domain than the native English group, they benefited from the visual information with improved performance in AV perception. Comparing the two nonnative groups, the Mandarin perceivers showed poorer auditory and AV identification for the interdentals and greater AV-fusion with the incongruent AV material than did the Koreans. These results indicate that nonnative perceivers are able to use visual speech information in L2 perception, although acquiring accurate use of the auditory and visual domains may not be similarly achieved across native groups, a process influenced by L1 experience.",
author = "Yue Wang and Behne, {Dawn M} and Haisheng Jiang",
year = "2009",
month = "7",
doi = "10.1016/j.wocn.2009.04.002",
language = "English",
volume = "37",
pages = "344--356",
journal = "Journal of Phonetics",
issn = "0095-4470",
publisher = "Academic Press Inc.",
number = "3",

}

TY - JOUR

T1 - Influence of native language phonetic system on audio-visual speech perception

AU - Wang, Yue

AU - Behne, Dawn M

AU - Jiang, Haisheng

PY - 2009/7

Y1 - 2009/7

N2 - This study examines how native language (L1) experience affects auditory–visual (AV) perception of nonnative (L2) speech. Korean, Mandarin and English perceivers were presented with English CV syllables containing fricatives with three places of articulation: labiodentals nonexistent in Korean, interdentals nonexistent in Korean and Mandarin, and alveolars occurring in all three L1s. The stimuli were presented as auditory-only, visual-only, congruent AV and incongruent AV. Results show that for the labiodentals which are nonnative in Korean, the Koreans had lower accuracy for the visual domain than the English and the Mandarin perceivers, but they nevertheless achieved native-level perception in the auditory and AV domains. For the interdentals nonexistent in Korean and Mandarin, while both nonnative groups had lower accuracy in the auditory domain than the native English group, they benefited from the visual information with improved performance in AV perception. Comparing the two nonnative groups, the Mandarin perceivers showed poorer auditory and AV identification for the interdentals and greater AV-fusion with the incongruent AV material than did the Koreans. These results indicate that nonnative perceivers are able to use visual speech information in L2 perception, although acquiring accurate use of the auditory and visual domains may not be similarly achieved across native groups, a process influenced by L1 experience.

AB - This study examines how native language (L1) experience affects auditory–visual (AV) perception of nonnative (L2) speech. Korean, Mandarin and English perceivers were presented with English CV syllables containing fricatives with three places of articulation: labiodentals nonexistent in Korean, interdentals nonexistent in Korean and Mandarin, and alveolars occurring in all three L1s. The stimuli were presented as auditory-only, visual-only, congruent AV and incongruent AV. Results show that for the labiodentals which are nonnative in Korean, the Koreans had lower accuracy for the visual domain than the English and the Mandarin perceivers, but they nevertheless achieved native-level perception in the auditory and AV domains. For the interdentals nonexistent in Korean and Mandarin, while both nonnative groups had lower accuracy in the auditory domain than the native English group, they benefited from the visual information with improved performance in AV perception. Comparing the two nonnative groups, the Mandarin perceivers showed poorer auditory and AV identification for the interdentals and greater AV-fusion with the incongruent AV material than did the Koreans. These results indicate that nonnative perceivers are able to use visual speech information in L2 perception, although acquiring accurate use of the auditory and visual domains may not be similarly achieved across native groups, a process influenced by L1 experience.

U2 - 10.1016/j.wocn.2009.04.002

DO - 10.1016/j.wocn.2009.04.002

M3 - Article

VL - 37

SP - 344

EP - 356

JO - Journal of Phonetics

JF - Journal of Phonetics

SN - 0095-4470

IS - 3

ER -