Fully generated scripted dialogue for embodied agents

Kees van Deemter, Brigitte Krenn, Paul Piwek, Martin Klesen, Marc Schroeder, Stefan Baumann

Research output: Contribution to journalArticle

36 Citations (Scopus)

Abstract

This paper presents the NECA approach to the generation of dialogues between Embodied Conversational Agents (ECAs). This approach consist of the automated construction of an abstract script for an entire dialogue (cast in terms of dialogue acts), which is incrementally enhanced by a series of modules and finally "performed" by means of text, speech and body language, by a cast of ECAs. The approach makes it possible to automatically produce a large variety of highly expressive dialogues, some of whose essential properties are under the control of a user. The paper discusses the advantages and disadvantages of NECA's approach to Fully Generated Scripted Dialogue (FGSD), and explains the main techniques used in the two demonstrators that were built. The paper can be read as a survey of issues and techniques in the construction of ECAs, focusing on the generation of behaviour (i.e., focusing on information presentation) rather than on interpretation. (c) 2008 Published by Elsevier B.V.

Original languageEnglish
Pages (from-to)1219-1244
Number of pages26
JournalArtificial Intelligence
Volume172
Issue number10
Early online date29 Feb 2008
DOIs
Publication statusPublished - Jun 2008

Keywords

  • embodied conversational agents
  • fully generated scripted dialogue
  • multimodal interfaces
  • emotion modelling
  • affective reasoning
  • natural language generation
  • speech synthesis
  • body language
  • facial expressions
  • speech
  • intonation
  • language
  • context

Cite this

van Deemter, K., Krenn, B., Piwek, P., Klesen, M., Schroeder, M., & Baumann, S. (2008). Fully generated scripted dialogue for embodied agents. Artificial Intelligence, 172(10), 1219-1244. https://doi.org/10.1016/j.artint.2008.02.002

Fully generated scripted dialogue for embodied agents. / van Deemter, Kees; Krenn, Brigitte; Piwek, Paul; Klesen, Martin; Schroeder, Marc; Baumann, Stefan.

In: Artificial Intelligence, Vol. 172, No. 10, 06.2008, p. 1219-1244.

Research output: Contribution to journalArticle

van Deemter, K, Krenn, B, Piwek, P, Klesen, M, Schroeder, M & Baumann, S 2008, 'Fully generated scripted dialogue for embodied agents', Artificial Intelligence, vol. 172, no. 10, pp. 1219-1244. https://doi.org/10.1016/j.artint.2008.02.002
van Deemter K, Krenn B, Piwek P, Klesen M, Schroeder M, Baumann S. Fully generated scripted dialogue for embodied agents. Artificial Intelligence. 2008 Jun;172(10):1219-1244. https://doi.org/10.1016/j.artint.2008.02.002
van Deemter, Kees ; Krenn, Brigitte ; Piwek, Paul ; Klesen, Martin ; Schroeder, Marc ; Baumann, Stefan. / Fully generated scripted dialogue for embodied agents. In: Artificial Intelligence. 2008 ; Vol. 172, No. 10. pp. 1219-1244.
@article{578caf00d09f4f919c3e3ca1c400505a,
title = "Fully generated scripted dialogue for embodied agents",
abstract = "This paper presents the NECA approach to the generation of dialogues between Embodied Conversational Agents (ECAs). This approach consist of the automated construction of an abstract script for an entire dialogue (cast in terms of dialogue acts), which is incrementally enhanced by a series of modules and finally {"}performed{"} by means of text, speech and body language, by a cast of ECAs. The approach makes it possible to automatically produce a large variety of highly expressive dialogues, some of whose essential properties are under the control of a user. The paper discusses the advantages and disadvantages of NECA's approach to Fully Generated Scripted Dialogue (FGSD), and explains the main techniques used in the two demonstrators that were built. The paper can be read as a survey of issues and techniques in the construction of ECAs, focusing on the generation of behaviour (i.e., focusing on information presentation) rather than on interpretation. (c) 2008 Published by Elsevier B.V.",
keywords = "embodied conversational agents, fully generated scripted dialogue, multimodal interfaces, emotion modelling, affective reasoning, natural language generation, speech synthesis, body language, facial expressions, speech, intonation, language, context",
author = "{van Deemter}, Kees and Brigitte Krenn and Paul Piwek and Martin Klesen and Marc Schroeder and Stefan Baumann",
note = "A paid open access option is available for this journal. Voluntary deposit by author of pre-print allowed on Institutions open scholarly website and pre-print servers Voluntary deposit by author of authors post-print allowed on institutions open scholarly website including Institutional Repository Deposit due to Funding Body, Institutional and Governmental mandate only allowed where separate agreement between repository and publisher exists Set statement to accompany deposit Published source must be acknowledged Must link to journal home page or articles' DOI Publisher's version/PDF cannot be used Articles in some journals can be made Open Access on payment of additional charge NIH Authors articles will be submitted to PMC after 12 months Authors who are required to deposit in subject repositories may also use Sponsorship Option Pre-print can not be deposited for The Lancet",
year = "2008",
month = "6",
doi = "10.1016/j.artint.2008.02.002",
language = "English",
volume = "172",
pages = "1219--1244",
journal = "Artificial Intelligence",
issn = "0004-3702",
publisher = "Elsevier",
number = "10",

}

TY - JOUR

T1 - Fully generated scripted dialogue for embodied agents

AU - van Deemter, Kees

AU - Krenn, Brigitte

AU - Piwek, Paul

AU - Klesen, Martin

AU - Schroeder, Marc

AU - Baumann, Stefan

N1 - A paid open access option is available for this journal. Voluntary deposit by author of pre-print allowed on Institutions open scholarly website and pre-print servers Voluntary deposit by author of authors post-print allowed on institutions open scholarly website including Institutional Repository Deposit due to Funding Body, Institutional and Governmental mandate only allowed where separate agreement between repository and publisher exists Set statement to accompany deposit Published source must be acknowledged Must link to journal home page or articles' DOI Publisher's version/PDF cannot be used Articles in some journals can be made Open Access on payment of additional charge NIH Authors articles will be submitted to PMC after 12 months Authors who are required to deposit in subject repositories may also use Sponsorship Option Pre-print can not be deposited for The Lancet

PY - 2008/6

Y1 - 2008/6

N2 - This paper presents the NECA approach to the generation of dialogues between Embodied Conversational Agents (ECAs). This approach consist of the automated construction of an abstract script for an entire dialogue (cast in terms of dialogue acts), which is incrementally enhanced by a series of modules and finally "performed" by means of text, speech and body language, by a cast of ECAs. The approach makes it possible to automatically produce a large variety of highly expressive dialogues, some of whose essential properties are under the control of a user. The paper discusses the advantages and disadvantages of NECA's approach to Fully Generated Scripted Dialogue (FGSD), and explains the main techniques used in the two demonstrators that were built. The paper can be read as a survey of issues and techniques in the construction of ECAs, focusing on the generation of behaviour (i.e., focusing on information presentation) rather than on interpretation. (c) 2008 Published by Elsevier B.V.

AB - This paper presents the NECA approach to the generation of dialogues between Embodied Conversational Agents (ECAs). This approach consist of the automated construction of an abstract script for an entire dialogue (cast in terms of dialogue acts), which is incrementally enhanced by a series of modules and finally "performed" by means of text, speech and body language, by a cast of ECAs. The approach makes it possible to automatically produce a large variety of highly expressive dialogues, some of whose essential properties are under the control of a user. The paper discusses the advantages and disadvantages of NECA's approach to Fully Generated Scripted Dialogue (FGSD), and explains the main techniques used in the two demonstrators that were built. The paper can be read as a survey of issues and techniques in the construction of ECAs, focusing on the generation of behaviour (i.e., focusing on information presentation) rather than on interpretation. (c) 2008 Published by Elsevier B.V.

KW - embodied conversational agents

KW - fully generated scripted dialogue

KW - multimodal interfaces

KW - emotion modelling

KW - affective reasoning

KW - natural language generation

KW - speech synthesis

KW - body language

KW - facial expressions

KW - speech

KW - intonation

KW - language

KW - context

U2 - 10.1016/j.artint.2008.02.002

DO - 10.1016/j.artint.2008.02.002

M3 - Article

VL - 172

SP - 1219

EP - 1244

JO - Artificial Intelligence

JF - Artificial Intelligence

SN - 0004-3702

IS - 10

ER -