Beyond DICE

measuring the quality of a referring expression

Kees van Deemter, Albert Gatt

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper discusses ways in which the similarity between the contents of two referring expressions can be measured. Similarity metrics of this kind are essential when expressions generated by an algoritm are compared against the ones produced by human speakers, for example as part of an experiment in which referring expressions are elicitated. We discuss arguments for and against different metrics, taking our departure from the well-known Dice metric.
Original languageEnglish
Title of host publicationProceedings of "Production of Referring Expressions''
PublisherCognitive Science Society
Number of pages3
Publication statusPublished - Jul 2009
EventPRE-CogSci 2009 - Amsterdam, Netherlands
Duration: 29 Jul 2009 → …

Conference

ConferencePRE-CogSci 2009
CountryNetherlands
CityAmsterdam
Period29/07/09 → …

Keywords

  • DICE
  • generation of referring expressions
  • evaluation metrics

Cite this

van Deemter, K., & Gatt, A. (2009). Beyond DICE: measuring the quality of a referring expression. In Proceedings of "Production of Referring Expressions'' Cognitive Science Society.

Beyond DICE : measuring the quality of a referring expression. / van Deemter, Kees; Gatt, Albert.

Proceedings of "Production of Referring Expressions''. Cognitive Science Society, 2009.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

van Deemter, K & Gatt, A 2009, Beyond DICE: measuring the quality of a referring expression. in Proceedings of "Production of Referring Expressions''. Cognitive Science Society, PRE-CogSci 2009, Amsterdam, Netherlands, 29/07/09.
van Deemter K, Gatt A. Beyond DICE: measuring the quality of a referring expression. In Proceedings of "Production of Referring Expressions''. Cognitive Science Society. 2009
van Deemter, Kees ; Gatt, Albert. / Beyond DICE : measuring the quality of a referring expression. Proceedings of "Production of Referring Expressions''. Cognitive Science Society, 2009.
@inproceedings{d6cf672943324e53a67a1c3286067535,
title = "Beyond DICE: measuring the quality of a referring expression",
abstract = "This paper discusses ways in which the similarity between the contents of two referring expressions can be measured. Similarity metrics of this kind are essential when expressions generated by an algoritm are compared against the ones produced by human speakers, for example as part of an experiment in which referring expressions are elicitated. We discuss arguments for and against different metrics, taking our departure from the well-known Dice metric.",
keywords = "DICE, generation of referring expressions, evaluation metrics",
author = "{van Deemter}, Kees and Albert Gatt",
year = "2009",
month = "7",
language = "English",
booktitle = "Proceedings of {"}Production of Referring Expressions''",
publisher = "Cognitive Science Society",

}

TY - GEN

T1 - Beyond DICE

T2 - measuring the quality of a referring expression

AU - van Deemter, Kees

AU - Gatt, Albert

PY - 2009/7

Y1 - 2009/7

N2 - This paper discusses ways in which the similarity between the contents of two referring expressions can be measured. Similarity metrics of this kind are essential when expressions generated by an algoritm are compared against the ones produced by human speakers, for example as part of an experiment in which referring expressions are elicitated. We discuss arguments for and against different metrics, taking our departure from the well-known Dice metric.

AB - This paper discusses ways in which the similarity between the contents of two referring expressions can be measured. Similarity metrics of this kind are essential when expressions generated by an algoritm are compared against the ones produced by human speakers, for example as part of an experiment in which referring expressions are elicitated. We discuss arguments for and against different metrics, taking our departure from the well-known Dice metric.

KW - DICE

KW - generation of referring expressions

KW - evaluation metrics

M3 - Conference contribution

BT - Proceedings of "Production of Referring Expressions''

PB - Cognitive Science Society

ER -