Fully generated scripted dialogue for embodied agents

Kees van Deemter; Brigitte Krenn; Paul Piwek; Martin Klesen; Marc Schroeder; Stefan Baumann

doi:10.1016/j.artint.2008.02.002

Fully generated scripted dialogue for embodied agents

Kees van Deemter, Brigitte Krenn, Paul Piwek, Martin Klesen, Marc Schroeder, Stefan Baumann

Computing Science

Research output: Contribution to journal › Article

37 Citations (Scopus)

Abstract

This paper presents the NECA approach to the generation of dialogues between Embodied Conversational Agents (ECAs). This approach consist of the automated construction of an abstract script for an entire dialogue (cast in terms of dialogue acts), which is incrementally enhanced by a series of modules and finally "performed" by means of text, speech and body language, by a cast of ECAs. The approach makes it possible to automatically produce a large variety of highly expressive dialogues, some of whose essential properties are under the control of a user. The paper discusses the advantages and disadvantages of NECA's approach to Fully Generated Scripted Dialogue (FGSD), and explains the main techniques used in the two demonstrators that were built. The paper can be read as a survey of issues and techniques in the construction of ECAs, focusing on the generation of behaviour (i.e., focusing on information presentation) rather than on interpretation. (c) 2008 Published by Elsevier B.V.

Original language	English
Pages (from-to)	1219-1244
Number of pages	26
Journal	Artificial Intelligence
Volume	172
Issue number	10
Early online date	29 Feb 2008
DOIs	https://doi.org/10.1016/j.artint.2008.02.002
Publication status	Published - Jun 2008

Keywords

embodied conversational agents
fully generated scripted dialogue
multimodal interfaces
emotion modelling
affective reasoning
natural language generation
speech synthesis
body language
facial expressions
speech
intonation
language
context

Access to Document

10.1016/j.artint.2008.02.002

Cite this

@article{578caf00d09f4f919c3e3ca1c400505a,

title = "Fully generated scripted dialogue for embodied agents",

abstract = "This paper presents the NECA approach to the generation of dialogues between Embodied Conversational Agents (ECAs). This approach consist of the automated construction of an abstract script for an entire dialogue (cast in terms of dialogue acts), which is incrementally enhanced by a series of modules and finally {"}performed{"} by means of text, speech and body language, by a cast of ECAs. The approach makes it possible to automatically produce a large variety of highly expressive dialogues, some of whose essential properties are under the control of a user. The paper discusses the advantages and disadvantages of NECA's approach to Fully Generated Scripted Dialogue (FGSD), and explains the main techniques used in the two demonstrators that were built. The paper can be read as a survey of issues and techniques in the construction of ECAs, focusing on the generation of behaviour (i.e., focusing on information presentation) rather than on interpretation. (c) 2008 Published by Elsevier B.V.",

keywords = "embodied conversational agents, fully generated scripted dialogue, multimodal interfaces, emotion modelling, affective reasoning, natural language generation, speech synthesis, body language, facial expressions, speech, intonation, language, context",

author = "{van Deemter}, Kees and Brigitte Krenn and Paul Piwek and Martin Klesen and Marc Schroeder and Stefan Baumann",

note = "A paid open access option is available for this journal. Voluntary deposit by author of pre-print allowed on Institutions open scholarly website and pre-print servers Voluntary deposit by author of authors post-print allowed on institutions open scholarly website including Institutional Repository Deposit due to Funding Body, Institutional and Governmental mandate only allowed where separate agreement between repository and publisher exists Set statement to accompany deposit Published source must be acknowledged Must link to journal home page or articles' DOI Publisher's version/PDF cannot be used Articles in some journals can be made Open Access on payment of additional charge NIH Authors articles will be submitted to PMC after 12 months Authors who are required to deposit in subject repositories may also use Sponsorship Option Pre-print can not be deposited for The Lancet",

year = "2008",

month = jun,

doi = "10.1016/j.artint.2008.02.002",

language = "English",

volume = "172",

pages = "1219--1244",

journal = "Artificial Intelligence",

issn = "0004-3702",

publisher = "Elsevier",

number = "10",

}

TY - JOUR

T1 - Fully generated scripted dialogue for embodied agents

AU - van Deemter, Kees

AU - Krenn, Brigitte

AU - Piwek, Paul

AU - Klesen, Martin

AU - Schroeder, Marc

AU - Baumann, Stefan

N1 - A paid open access option is available for this journal. Voluntary deposit by author of pre-print allowed on Institutions open scholarly website and pre-print servers Voluntary deposit by author of authors post-print allowed on institutions open scholarly website including Institutional Repository Deposit due to Funding Body, Institutional and Governmental mandate only allowed where separate agreement between repository and publisher exists Set statement to accompany deposit Published source must be acknowledged Must link to journal home page or articles' DOI Publisher's version/PDF cannot be used Articles in some journals can be made Open Access on payment of additional charge NIH Authors articles will be submitted to PMC after 12 months Authors who are required to deposit in subject repositories may also use Sponsorship Option Pre-print can not be deposited for The Lancet

PY - 2008/6

Y1 - 2008/6

N2 - This paper presents the NECA approach to the generation of dialogues between Embodied Conversational Agents (ECAs). This approach consist of the automated construction of an abstract script for an entire dialogue (cast in terms of dialogue acts), which is incrementally enhanced by a series of modules and finally "performed" by means of text, speech and body language, by a cast of ECAs. The approach makes it possible to automatically produce a large variety of highly expressive dialogues, some of whose essential properties are under the control of a user. The paper discusses the advantages and disadvantages of NECA's approach to Fully Generated Scripted Dialogue (FGSD), and explains the main techniques used in the two demonstrators that were built. The paper can be read as a survey of issues and techniques in the construction of ECAs, focusing on the generation of behaviour (i.e., focusing on information presentation) rather than on interpretation. (c) 2008 Published by Elsevier B.V.

AB - This paper presents the NECA approach to the generation of dialogues between Embodied Conversational Agents (ECAs). This approach consist of the automated construction of an abstract script for an entire dialogue (cast in terms of dialogue acts), which is incrementally enhanced by a series of modules and finally "performed" by means of text, speech and body language, by a cast of ECAs. The approach makes it possible to automatically produce a large variety of highly expressive dialogues, some of whose essential properties are under the control of a user. The paper discusses the advantages and disadvantages of NECA's approach to Fully Generated Scripted Dialogue (FGSD), and explains the main techniques used in the two demonstrators that were built. The paper can be read as a survey of issues and techniques in the construction of ECAs, focusing on the generation of behaviour (i.e., focusing on information presentation) rather than on interpretation. (c) 2008 Published by Elsevier B.V.

KW - embodied conversational agents

KW - fully generated scripted dialogue

KW - multimodal interfaces

KW - emotion modelling

KW - affective reasoning

KW - natural language generation

KW - speech synthesis

KW - body language

KW - facial expressions

KW - speech

KW - intonation

KW - language

KW - context

U2 - 10.1016/j.artint.2008.02.002

DO - 10.1016/j.artint.2008.02.002

M3 - Article

VL - 172

SP - 1219

EP - 1244

JO - Artificial Intelligence

JF - Artificial Intelligence

SN - 0004-3702

IS - 10

ER -