The Importance of Narrative and Other Lessons from an Evaluation of an NLG System that Summarises Clinical Data

Ehud Baruch Reiter; Albert Gatt; Francois Portet; Marian van der Meulen

The Importance of Narrative and Other Lessons from an Evaluation of an NLG System that Summarises Clinical Data

Ehud Baruch Reiter, Albert Gatt, Francois Portet, Marian van der Meulen

Computing Science

Research output: Chapter in Book/Report/Conference proceeding › Published conference contribution

24 Citations (Scopus)

5 Downloads (Pure)

Abstract

The BABYTALK BT-45 system generates textual summaries of clinical data about babies in a neonatal intensive care unit. A recent task-based evaluation of the system suggested that these summaries are useful, but not as effective as they could be. In this paper we present a qualitative analysis of problems that the evaluation highlighted in BT-45 texts. Many of these problems are due to the fact that BT45 does not generate good narrative texts; this is a topic which has not previously received much attention from the NLG research community, but seems to be quite important for creating good data-to-text systems.

Original language	English
Title of host publication	Proceedings of the Fifth International Natural Language Generation Conference
Publisher	Association for Computational Linguistics (ACL)
Pages	147-156
Number of pages	9
Publication status	Published - 12 Jun 2008
Event	5th International Natural Language Generation Conference (INLG 2008) - Salt Fork, Ohio, United States Duration: 12 Jun 2008 → 14 Jun 2008

Conference

Conference	5th International Natural Language Generation Conference (INLG 2008)
Country/Territory	United States
City	Salt Fork, Ohio
Period	12/06/08 → 14/06/08

Bibliographical note

This research was funded by the UK Engineering and Physical Sciences Research Council, under grant EP/D049520/1.

Access to Document

Reiter_etal_ACLA_The_Importance_Of_VoR
Materials prior to 2016 here are licensed under the Creative Commons Attribution-NonCommercial-ShareAlike 3.0 International License. Permission is granted to make copies for the purposes of teaching and research. https://creativecommons.org/licenses/by-nc-sa/3.0/
Final published version, 467 KBLicence: CC BY-NC-SA

https://aclanthology.org/W08-1119/Licence: CC BY-NC-SA

Cite this

The Importance of Narrative and Other Lessons from an Evaluation of an NLG System that Summarises Clinical Data. / Reiter, Ehud Baruch; Gatt, Albert; Portet, Francois et al.
Proceedings of the Fifth International Natural Language Generation Conference. Association for Computational Linguistics (ACL), 2008. p. 147-156.

Research output: Chapter in Book/Report/Conference proceeding › Published conference contribution

Reiter, EB, Gatt, A, Portet, F & van der Meulen, M 2008, The Importance of Narrative and Other Lessons from an Evaluation of an NLG System that Summarises Clinical Data. in Proceedings of the Fifth International Natural Language Generation Conference. Association for Computational Linguistics (ACL), pp. 147-156, 5th International Natural Language Generation Conference (INLG 2008) , Salt Fork, Ohio, United States, 12/06/08. <https://aclanthology.org/W08-1119/>

@inproceedings{d824da2300564b3ba5934c6e437fc81c,

title = "The Importance of Narrative and Other Lessons from an Evaluation of an NLG System that Summarises Clinical Data",

abstract = "The BABYTALK BT-45 system generates textual summaries of clinical data about babies in a neonatal intensive care unit. A recent task-based evaluation of the system suggested that these summaries are useful, but not as effective as they could be. In this paper we present a qualitative analysis of problems that the evaluation highlighted in BT-45 texts. Many of these problems are due to the fact that BT45 does not generate good narrative texts; this is a topic which has not previously received much attention from the NLG research community, but seems to be quite important for creating good data-to-text systems.",

author = "Reiter, {Ehud Baruch} and Albert Gatt and Francois Portet and {van der Meulen}, Marian",

note = "This research was funded by the UK Engineering and Physical Sciences Research Council, under grant EP/D049520/1.; 5th International Natural Language Generation Conference (INLG 2008) ; Conference date: 12-06-2008 Through 14-06-2008",

year = "2008",

month = jun,

day = "12",

language = "English",

pages = "147--156",

booktitle = "Proceedings of the Fifth International Natural Language Generation Conference",

publisher = "Association for Computational Linguistics (ACL)",

}

TY - GEN

T1 - The Importance of Narrative and Other Lessons from an Evaluation of an NLG System that Summarises Clinical Data

AU - Reiter, Ehud Baruch

AU - Gatt, Albert

AU - Portet, Francois

AU - van der Meulen, Marian

N1 - This research was funded by the UK Engineering and Physical Sciences Research Council, under grant EP/D049520/1.

PY - 2008/6/12

Y1 - 2008/6/12

N2 - The BABYTALK BT-45 system generates textual summaries of clinical data about babies in a neonatal intensive care unit. A recent task-based evaluation of the system suggested that these summaries are useful, but not as effective as they could be. In this paper we present a qualitative analysis of problems that the evaluation highlighted in BT-45 texts. Many of these problems are due to the fact that BT45 does not generate good narrative texts; this is a topic which has not previously received much attention from the NLG research community, but seems to be quite important for creating good data-to-text systems.

AB - The BABYTALK BT-45 system generates textual summaries of clinical data about babies in a neonatal intensive care unit. A recent task-based evaluation of the system suggested that these summaries are useful, but not as effective as they could be. In this paper we present a qualitative analysis of problems that the evaluation highlighted in BT-45 texts. Many of these problems are due to the fact that BT45 does not generate good narrative texts; this is a topic which has not previously received much attention from the NLG research community, but seems to be quite important for creating good data-to-text systems.

M3 - Published conference contribution

SP - 147

EP - 156

BT - Proceedings of the Fifth International Natural Language Generation Conference

PB - Association for Computational Linguistics (ACL)

T2 - 5th International Natural Language Generation Conference (INLG 2008)

Y2 - 12 June 2008 through 14 June 2008

ER -

The Importance of Narrative and Other Lessons from an Evaluation of an NLG System that Summarises Clinical Data

Abstract

Conference

Bibliographical note

Access to Document

Fingerprint

Cite this