How to evaluate objective video quality metrics reliably

Jari Korhonen*, Nino Burini, Junyong You, Ehsan Nadernejad

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingPublished conference contribution

17 Citations (Scopus)

Abstract

The typical procedure for evaluating the performance of different objective quality metrics and indices involves comparisons between subjective quality ratings and the quality indices obtained using the objective metrics in question on the known video sequences. Several correlation indicators can be employed to assess how well the subjective ratings can be predicted from the objective values. In this paper, we give an overview of the potential sources for uncertainties and inaccuracies in such studies, related both to the method of comparison, possible inaccuracies in the subjective data, as well as processing of subjective data. We also suggest some general guidelines for researchers to make comparison studies of objective video quality metrics more reliable and useful for the practitioners in the field.

Original languageEnglish
Title of host publication2012 4th International Workshop on Quality of Multimedia Experience, QoMEX 2012
Pages57-62
Number of pages6
DOIs
Publication statusPublished - 2012
Event2012 4th International Workshop on Quality of Multimedia Experience, QoMEX 2012 - Melbourne, VIC, Australia
Duration: 5 Jul 20127 Jul 2012

Conference

Conference2012 4th International Workshop on Quality of Multimedia Experience, QoMEX 2012
Country/TerritoryAustralia
CityMelbourne, VIC
Period5/07/127/07/12

Keywords

  • Objective metrics
  • Reliability
  • Video quality assessment

Fingerprint

Dive into the research topics of 'How to evaluate objective video quality metrics reliably'. Together they form a unique fingerprint.

Cite this