Natural language generation for augmentative and assistive technologies

Nava Tintarev*, Ehud Reiter, Rolf Black, Annalu Waller

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingChapter

1 Citation (Scopus)

Abstract

Many people are not able to communicate easily, because of diversity in their physical and/or intellectual abilities. For example, someone with cerebral palsy may not have enough control over their vocal tract and mouth to speak (or enough manual dexterity control to use sign language); and someone with autism may be physically capable, but unable to speak because of their cognitive profile.

Augmentative and alternative communication (AAC) is a sub-field of assistive technology focusing on tools to help people with major motor and/or cognitive impairments communicate better. Traditionally, AAC has used technology to provide speech output for non-speaking users, either by converting text to speech or speaking out pre-stored phrases. The initial focus of computer-based AAC systems was on giving users access to a broad set of symbols/pictures (by using some kind of menu or search system), and on using speech synthesis to automatically speak out phrases corresponding to the selected symbols. However, computers can in principle do much more than this.

In particular, since many AAC systems are intended to help users produce utterances, there seems to be a natural role for Natural Language Generation (NLG) to play, as it is after all a technology for producing language. However, the use of NLG in AAC is somewhat different from most uses of NLG. Since the goal of AAC is to help the user communicate, the NLG system must be used interactively, under the user’s control; we want to assist the user in communication, not replace the user with an automatic communicator. Also, since most human communication is social, NLG AAC systems often need to generate texts whose communicative goal is social interaction. Hence, NLG AAC systems are very different from systems that summarize information in a task-oriented context, which has been the focus of most NLG research for interactive systems.
Original languageEnglish
Title of host publicationNatural Language Generation in Interactive Systems
EditorsA Stent, S Bangalore
Place of PublicationCambridge
PublisherCambridge University Press
Pages252-277
Number of pages26
ISBN (Electronic)9780511844492
ISBN (Print)9781107010024
DOIs
Publication statusPublished - Jul 2014

Keywords

  • communication
  • AAC
  • communications and signal processing
  • artificial Intelligence and Natural Language Processing

Cite this

Tintarev, N., Reiter, E., Black, R., & Waller, A. (2014). Natural language generation for augmentative and assistive technologies. In A. Stent, & S. Bangalore (Eds.), Natural Language Generation in Interactive Systems (pp. 252-277). Cambridge: Cambridge University Press. https://doi.org/10.1017/CBO9780511844492.011

Natural language generation for augmentative and assistive technologies. / Tintarev, Nava; Reiter, Ehud; Black, Rolf; Waller, Annalu.

Natural Language Generation in Interactive Systems. ed. / A Stent; S Bangalore. Cambridge : Cambridge University Press, 2014. p. 252-277.

Research output: Chapter in Book/Report/Conference proceedingChapter

Tintarev, N, Reiter, E, Black, R & Waller, A 2014, Natural language generation for augmentative and assistive technologies. in A Stent & S Bangalore (eds), Natural Language Generation in Interactive Systems. Cambridge University Press, Cambridge, pp. 252-277. https://doi.org/10.1017/CBO9780511844492.011
Tintarev N, Reiter E, Black R, Waller A. Natural language generation for augmentative and assistive technologies. In Stent A, Bangalore S, editors, Natural Language Generation in Interactive Systems. Cambridge: Cambridge University Press. 2014. p. 252-277 https://doi.org/10.1017/CBO9780511844492.011
Tintarev, Nava ; Reiter, Ehud ; Black, Rolf ; Waller, Annalu. / Natural language generation for augmentative and assistive technologies. Natural Language Generation in Interactive Systems. editor / A Stent ; S Bangalore. Cambridge : Cambridge University Press, 2014. pp. 252-277
@inbook{8b2bc25d3b4f4e06a2ddbdb916bf567a,
title = "Natural language generation for augmentative and assistive technologies",
abstract = "Many people are not able to communicate easily, because of diversity in their physical and/or intellectual abilities. For example, someone with cerebral palsy may not have enough control over their vocal tract and mouth to speak (or enough manual dexterity control to use sign language); and someone with autism may be physically capable, but unable to speak because of their cognitive profile.Augmentative and alternative communication (AAC) is a sub-field of assistive technology focusing on tools to help people with major motor and/or cognitive impairments communicate better. Traditionally, AAC has used technology to provide speech output for non-speaking users, either by converting text to speech or speaking out pre-stored phrases. The initial focus of computer-based AAC systems was on giving users access to a broad set of symbols/pictures (by using some kind of menu or search system), and on using speech synthesis to automatically speak out phrases corresponding to the selected symbols. However, computers can in principle do much more than this.In particular, since many AAC systems are intended to help users produce utterances, there seems to be a natural role for Natural Language Generation (NLG) to play, as it is after all a technology for producing language. However, the use of NLG in AAC is somewhat different from most uses of NLG. Since the goal of AAC is to help the user communicate, the NLG system must be used interactively, under the user’s control; we want to assist the user in communication, not replace the user with an automatic communicator. Also, since most human communication is social, NLG AAC systems often need to generate texts whose communicative goal is social interaction. Hence, NLG AAC systems are very different from systems that summarize information in a task-oriented context, which has been the focus of most NLG research for interactive systems.",
keywords = "communication, AAC, communications and signal processing, artificial Intelligence and Natural Language Processing",
author = "Nava Tintarev and Ehud Reiter and Rolf Black and Annalu Waller",
year = "2014",
month = "7",
doi = "10.1017/CBO9780511844492.011",
language = "English",
isbn = "9781107010024",
pages = "252--277",
editor = "A Stent and S Bangalore",
booktitle = "Natural Language Generation in Interactive Systems",
publisher = "Cambridge University Press",

}

TY - CHAP

T1 - Natural language generation for augmentative and assistive technologies

AU - Tintarev, Nava

AU - Reiter, Ehud

AU - Black, Rolf

AU - Waller, Annalu

PY - 2014/7

Y1 - 2014/7

N2 - Many people are not able to communicate easily, because of diversity in their physical and/or intellectual abilities. For example, someone with cerebral palsy may not have enough control over their vocal tract and mouth to speak (or enough manual dexterity control to use sign language); and someone with autism may be physically capable, but unable to speak because of their cognitive profile.Augmentative and alternative communication (AAC) is a sub-field of assistive technology focusing on tools to help people with major motor and/or cognitive impairments communicate better. Traditionally, AAC has used technology to provide speech output for non-speaking users, either by converting text to speech or speaking out pre-stored phrases. The initial focus of computer-based AAC systems was on giving users access to a broad set of symbols/pictures (by using some kind of menu or search system), and on using speech synthesis to automatically speak out phrases corresponding to the selected symbols. However, computers can in principle do much more than this.In particular, since many AAC systems are intended to help users produce utterances, there seems to be a natural role for Natural Language Generation (NLG) to play, as it is after all a technology for producing language. However, the use of NLG in AAC is somewhat different from most uses of NLG. Since the goal of AAC is to help the user communicate, the NLG system must be used interactively, under the user’s control; we want to assist the user in communication, not replace the user with an automatic communicator. Also, since most human communication is social, NLG AAC systems often need to generate texts whose communicative goal is social interaction. Hence, NLG AAC systems are very different from systems that summarize information in a task-oriented context, which has been the focus of most NLG research for interactive systems.

AB - Many people are not able to communicate easily, because of diversity in their physical and/or intellectual abilities. For example, someone with cerebral palsy may not have enough control over their vocal tract and mouth to speak (or enough manual dexterity control to use sign language); and someone with autism may be physically capable, but unable to speak because of their cognitive profile.Augmentative and alternative communication (AAC) is a sub-field of assistive technology focusing on tools to help people with major motor and/or cognitive impairments communicate better. Traditionally, AAC has used technology to provide speech output for non-speaking users, either by converting text to speech or speaking out pre-stored phrases. The initial focus of computer-based AAC systems was on giving users access to a broad set of symbols/pictures (by using some kind of menu or search system), and on using speech synthesis to automatically speak out phrases corresponding to the selected symbols. However, computers can in principle do much more than this.In particular, since many AAC systems are intended to help users produce utterances, there seems to be a natural role for Natural Language Generation (NLG) to play, as it is after all a technology for producing language. However, the use of NLG in AAC is somewhat different from most uses of NLG. Since the goal of AAC is to help the user communicate, the NLG system must be used interactively, under the user’s control; we want to assist the user in communication, not replace the user with an automatic communicator. Also, since most human communication is social, NLG AAC systems often need to generate texts whose communicative goal is social interaction. Hence, NLG AAC systems are very different from systems that summarize information in a task-oriented context, which has been the focus of most NLG research for interactive systems.

KW - communication

KW - AAC

KW - communications and signal processing

KW - artificial Intelligence and Natural Language Processing

U2 - 10.1017/CBO9780511844492.011

DO - 10.1017/CBO9780511844492.011

M3 - Chapter

SN - 9781107010024

SP - 252

EP - 277

BT - Natural Language Generation in Interactive Systems

A2 - Stent, A

A2 - Bangalore, S

PB - Cambridge University Press

CY - Cambridge

ER -