Speaker alignment in synthesised, machine translated communication

Anne H. Schneider, Saturnino Luz

Research output: Contribution to conferencePaper

Abstract

The effect of mistranslations on the verbal behaviour of users of speech-to-speech translation is investigated through a question answering experiment in which users were presented with machine translated questions through synthesised speech. Results show that people are likely to align their verbal behaviour to the output of a system that combines machine translation, speech recognition and speech synthesis in an interactive dialogue context, even when the system produces erroneous output. The alignment phenomenon has been previously considered by dialogue system designers from the perspective of the benefits it might bring to the interaction (e.g. by making the user more likely to employ terms contained in the system’s vocabulary). In contrast, our results reveal that in speech-to-speech translation systems alignment can in fact be detrimental to the interaction (e.g. by priming the user to align with non-existing lexical items produced by mistranslation). The implications of these findings are discussed with respect to the design of such systems
Original languageEnglish
Pages254-260
Number of pages7
Publication statusPublished - Dec 2011
EventInternational Workshop on Spoken Language Translation 2011 (IWSLT'11) - San Francisco, United States
Duration: 8 Dec 20119 Dec 2011

Workshop

WorkshopInternational Workshop on Spoken Language Translation 2011 (IWSLT'11)
CountryUnited States
CitySan Francisco
Period8/12/119/12/11

Fingerprint

Communication
Speech synthesis
Speech recognition
Experiments

ASJC Scopus subject areas

  • Computer Science(all)

Cite this

Schneider, A. H., & Luz, S. (2011). Speaker alignment in synthesised, machine translated communication. 254-260. Paper presented at International Workshop on Spoken Language Translation 2011 (IWSLT'11), San Francisco, United States.

Speaker alignment in synthesised, machine translated communication. / Schneider, Anne H.; Luz, Saturnino.

2011. 254-260 Paper presented at International Workshop on Spoken Language Translation 2011 (IWSLT'11), San Francisco, United States.

Research output: Contribution to conferencePaper

Schneider, AH & Luz, S 2011, 'Speaker alignment in synthesised, machine translated communication' Paper presented at International Workshop on Spoken Language Translation 2011 (IWSLT'11), San Francisco, United States, 8/12/11 - 9/12/11, pp. 254-260.
Schneider AH, Luz S. Speaker alignment in synthesised, machine translated communication. 2011. Paper presented at International Workshop on Spoken Language Translation 2011 (IWSLT'11), San Francisco, United States.
Schneider, Anne H. ; Luz, Saturnino. / Speaker alignment in synthesised, machine translated communication. Paper presented at International Workshop on Spoken Language Translation 2011 (IWSLT'11), San Francisco, United States.7 p.
@conference{ae9c2f66ecf74fa6b720bf0b9a4cbd32,
title = "Speaker alignment in synthesised, machine translated communication",
abstract = "The effect of mistranslations on the verbal behaviour of users of speech-to-speech translation is investigated through a question answering experiment in which users were presented with machine translated questions through synthesised speech. Results show that people are likely to align their verbal behaviour to the output of a system that combines machine translation, speech recognition and speech synthesis in an interactive dialogue context, even when the system produces erroneous output. The alignment phenomenon has been previously considered by dialogue system designers from the perspective of the benefits it might bring to the interaction (e.g. by making the user more likely to employ terms contained in the system’s vocabulary). In contrast, our results reveal that in speech-to-speech translation systems alignment can in fact be detrimental to the interaction (e.g. by priming the user to align with non-existing lexical items produced by mistranslation). The implications of these findings are discussed with respect to the design of such systems",
author = "Schneider, {Anne H.} and Saturnino Luz",
year = "2011",
month = "12",
language = "English",
pages = "254--260",
note = "International Workshop on Spoken Language Translation 2011 (IWSLT'11) ; Conference date: 08-12-2011 Through 09-12-2011",

}

TY - CONF

T1 - Speaker alignment in synthesised, machine translated communication

AU - Schneider, Anne H.

AU - Luz, Saturnino

PY - 2011/12

Y1 - 2011/12

N2 - The effect of mistranslations on the verbal behaviour of users of speech-to-speech translation is investigated through a question answering experiment in which users were presented with machine translated questions through synthesised speech. Results show that people are likely to align their verbal behaviour to the output of a system that combines machine translation, speech recognition and speech synthesis in an interactive dialogue context, even when the system produces erroneous output. The alignment phenomenon has been previously considered by dialogue system designers from the perspective of the benefits it might bring to the interaction (e.g. by making the user more likely to employ terms contained in the system’s vocabulary). In contrast, our results reveal that in speech-to-speech translation systems alignment can in fact be detrimental to the interaction (e.g. by priming the user to align with non-existing lexical items produced by mistranslation). The implications of these findings are discussed with respect to the design of such systems

AB - The effect of mistranslations on the verbal behaviour of users of speech-to-speech translation is investigated through a question answering experiment in which users were presented with machine translated questions through synthesised speech. Results show that people are likely to align their verbal behaviour to the output of a system that combines machine translation, speech recognition and speech synthesis in an interactive dialogue context, even when the system produces erroneous output. The alignment phenomenon has been previously considered by dialogue system designers from the perspective of the benefits it might bring to the interaction (e.g. by making the user more likely to employ terms contained in the system’s vocabulary). In contrast, our results reveal that in speech-to-speech translation systems alignment can in fact be detrimental to the interaction (e.g. by priming the user to align with non-existing lexical items produced by mistranslation). The implications of these findings are discussed with respect to the design of such systems

M3 - Paper

SP - 254

EP - 260

ER -