Abstract
We describe a corpus-based evaluation methodology, applied to a number of classic algorithms in the generation of referring expressions. Following up on earlier work involving very simple domains, this paper deals with the issues associated with domains that contain ‘real-life’ objects of some complexity. Results indicate that state of the art algorithms perform very differently when applied to a complex domain. Moreover, if a version of the Incremental Algorithm is used then it becomes of huge importance to select a good preference order. These results should contribute to a growing debate on the evaluation of nlg systems, arguing in favour of carefully constructed balanced and semantically transparent corpora.
| Original language | English |
|---|---|
| Title of host publication | Proceedings of Recent Advances in Natural Language Processing International Conference 2007 |
| Place of Publication | Borovets, Bulgaria |
| Publisher | RANLP |
| Pages | 541-547 |
| Number of pages | 7 |
| ISBN (Electronic) | 978-954-91743-7-3 |
| Publication status | Published - 2007 |
| Event | Recent Advances in Language Processing International Conference 2007 - Borovets, Russian Federation Duration: 27 Sep 2007 → 29 Sep 2007 https://lml.bas.bg/ranlp2007/ |
Conference
| Conference | Recent Advances in Language Processing International Conference 2007 |
|---|---|
| Abbreviated title | RANLP 2007 |
| Country/Territory | Russian Federation |
| City | Borovets |
| Period | 27/09/07 → 29/09/07 |
| Internet address |
Keywords
- generation of referring expressions
- corpus-based evaluation of algorithms
- Natural Language Generation