Task-Based Evaluation of NLG Systems: Control vs Real-World Context

Research output: Chapter in Book/Report/Conference proceedingPublished conference contribution

Abstract

Currently there is little agreement about, or even discussion of, methodologies for taskbased evaluation of NLG systems. I discuss one specific issue in this area, namely the importance of control vs the importance of ecological validity (real-world context), and suggest that perhaps we need to put more emphasis on ecological validity in NLG evaluations.
Original languageEnglish
Title of host publicationProceedings of UCNLG+Eval 2011
PublisherAssociation for Computational Linguistics
Pages28-32
Number of pages5
Publication statusPublished - 2011
EventUCNLG+Eval: Language Generation and Evaluation Workshop - Edinburgh, United Kingdom
Duration: 21 Jul 201121 Jul 2011

Conference

ConferenceUCNLG+Eval: Language Generation and Evaluation Workshop
Country/TerritoryUnited Kingdom
CityEdinburgh
Period21/07/1121/07/11

Fingerprint

Dive into the research topics of 'Task-Based Evaluation of NLG Systems: Control vs Real-World Context'. Together they form a unique fingerprint.

Cite this