Speaker alignment in synthesised, machine translated communication

Anne H. Schneider, Saturnino Luz

Research output: Contribution to conferencePaper

Abstract

The effect of mistranslations on the verbal behaviour of users of speech-to-speech translation is investigated through a question answering experiment in which users were presented with machine translated questions through synthesised speech. Results show that people are likely to align their verbal behaviour to the output of a system that combines machine translation, speech recognition and speech synthesis in an interactive dialogue context, even when the system produces erroneous output. The alignment phenomenon has been previously considered by dialogue system designers from the perspective of the benefits it might bring to the interaction (e.g. by making the user more likely to employ terms contained in the system’s vocabulary). In contrast, our results reveal that in speech-to-speech translation systems alignment can in fact be detrimental to the interaction (e.g. by priming the user to align with non-existing lexical items produced by mistranslation). The implications of these findings are discussed with respect to the design of such systems
Original languageEnglish
Pages254-260
Number of pages7
Publication statusPublished - Dec 2011
EventInternational Workshop on Spoken Language Translation 2011 (IWSLT'11) - San Francisco, United States
Duration: 8 Dec 20119 Dec 2011

Workshop

WorkshopInternational Workshop on Spoken Language Translation 2011 (IWSLT'11)
CountryUnited States
CitySan Francisco
Period8/12/119/12/11

ASJC Scopus subject areas

  • Computer Science(all)

Fingerprint Dive into the research topics of 'Speaker alignment in synthesised, machine translated communication'. Together they form a unique fingerprint.

  • Cite this

    Schneider, A. H., & Luz, S. (2011). Speaker alignment in synthesised, machine translated communication. 254-260. Paper presented at International Workshop on Spoken Language Translation 2011 (IWSLT'11), San Francisco, United States. http://iwslt2011.org/doku.php?id=08_proceedings