Accuracy of three commercial automatic emotion recognition systems across different individuals and their facial expressions

Damien Dupré, Nicole Andelic, Gawain Morrison, Gary McKeown

Research output: Chapter in Book/Report/Conference proceedingChapter (peer-reviewed)

2 Citations (Scopus)

Abstract

Automatic facial expression recognition systems can provide information about our emotions and how they change over time. However, based on different statistical methods the results of automatic systems have not yet been compared. In the current paper we evaluate the emotion detection between three different commercial systems (i.e.Affectiva, Kairos and Microsoft) when detecting dynamic and spontaneous facial expressions. Even if the study was performed on a limited sample of videos, the results show significant differences between the systems for the same video and per system across comparable facial expressions. Finally, we reflect on the implications according the generalization of the results provided by automatic emotion detection.
Original languageEnglish
Title of host publicationPervasive Computing and Communications Workshops (PerCom)
Subtitle of host publicationIEEE Annual Conference
PublisherIEEE Press
Number of pages6
ISBN (Print)978-1-5386-3228-4
DOIs
Publication statusPublished - 8 Oct 2018
Event2018 IEEE International Conference on Pervasive Computing and Communications Workshops : PerCom Workshops 2018 - Athens, Greece
Duration: 19 Mar 201823 Mar 2018

Conference

Conference2018 IEEE International Conference on Pervasive Computing and Communications Workshops
CountryGreece
CityAthens
Period19/03/1823/03/18

Fingerprint

Statistical methods

Keywords

  • emotion
  • facial expression
  • automatic recognition

Cite this

Dupré, D., Andelic, N., Morrison, G., & McKeown, G. (2018). Accuracy of three commercial automatic emotion recognition systems across different individuals and their facial expressions. In Pervasive Computing and Communications Workshops (PerCom): IEEE Annual Conference IEEE Press. https://doi.org/10.1109/PERCOMW.2018.8480127

Accuracy of three commercial automatic emotion recognition systems across different individuals and their facial expressions. / Dupré, Damien; Andelic, Nicole; Morrison, Gawain; McKeown, Gary.

Pervasive Computing and Communications Workshops (PerCom): IEEE Annual Conference. IEEE Press, 2018.

Research output: Chapter in Book/Report/Conference proceedingChapter (peer-reviewed)

Dupré, D, Andelic, N, Morrison, G & McKeown, G 2018, Accuracy of three commercial automatic emotion recognition systems across different individuals and their facial expressions. in Pervasive Computing and Communications Workshops (PerCom): IEEE Annual Conference. IEEE Press, 2018 IEEE International Conference on Pervasive Computing and Communications Workshops , Athens, Greece, 19/03/18. https://doi.org/10.1109/PERCOMW.2018.8480127
Dupré D, Andelic N, Morrison G, McKeown G. Accuracy of three commercial automatic emotion recognition systems across different individuals and their facial expressions. In Pervasive Computing and Communications Workshops (PerCom): IEEE Annual Conference. IEEE Press. 2018 https://doi.org/10.1109/PERCOMW.2018.8480127
Dupré, Damien ; Andelic, Nicole ; Morrison, Gawain ; McKeown, Gary. / Accuracy of three commercial automatic emotion recognition systems across different individuals and their facial expressions. Pervasive Computing and Communications Workshops (PerCom): IEEE Annual Conference. IEEE Press, 2018.
@inbook{f49a9f48d4494b6ca9d75480cbb1bfd4,
title = "Accuracy of three commercial automatic emotion recognition systems across different individuals and their facial expressions",
abstract = "Automatic facial expression recognition systems can provide information about our emotions and how they change over time. However, based on different statistical methods the results of automatic systems have not yet been compared. In the current paper we evaluate the emotion detection between three different commercial systems (i.e.Affectiva, Kairos and Microsoft) when detecting dynamic and spontaneous facial expressions. Even if the study was performed on a limited sample of videos, the results show significant differences between the systems for the same video and per system across comparable facial expressions. Finally, we reflect on the implications according the generalization of the results provided by automatic emotion detection.",
keywords = "emotion, facial expression, automatic recognition",
author = "Damien Dupr{\'e} and Nicole Andelic and Gawain Morrison and Gary McKeown",
note = "We thank the representatives of Affectiva, Kairos and Microsoft who agreed for the communication of the data presented in this paper.",
year = "2018",
month = "10",
day = "8",
doi = "10.1109/PERCOMW.2018.8480127",
language = "English",
isbn = "978-1-5386-3228-4",
booktitle = "Pervasive Computing and Communications Workshops (PerCom)",
publisher = "IEEE Press",

}

TY - CHAP

T1 - Accuracy of three commercial automatic emotion recognition systems across different individuals and their facial expressions

AU - Dupré, Damien

AU - Andelic, Nicole

AU - Morrison, Gawain

AU - McKeown, Gary

N1 - We thank the representatives of Affectiva, Kairos and Microsoft who agreed for the communication of the data presented in this paper.

PY - 2018/10/8

Y1 - 2018/10/8

N2 - Automatic facial expression recognition systems can provide information about our emotions and how they change over time. However, based on different statistical methods the results of automatic systems have not yet been compared. In the current paper we evaluate the emotion detection between three different commercial systems (i.e.Affectiva, Kairos and Microsoft) when detecting dynamic and spontaneous facial expressions. Even if the study was performed on a limited sample of videos, the results show significant differences between the systems for the same video and per system across comparable facial expressions. Finally, we reflect on the implications according the generalization of the results provided by automatic emotion detection.

AB - Automatic facial expression recognition systems can provide information about our emotions and how they change over time. However, based on different statistical methods the results of automatic systems have not yet been compared. In the current paper we evaluate the emotion detection between three different commercial systems (i.e.Affectiva, Kairos and Microsoft) when detecting dynamic and spontaneous facial expressions. Even if the study was performed on a limited sample of videos, the results show significant differences between the systems for the same video and per system across comparable facial expressions. Finally, we reflect on the implications according the generalization of the results provided by automatic emotion detection.

KW - emotion

KW - facial expression

KW - automatic recognition

U2 - 10.1109/PERCOMW.2018.8480127

DO - 10.1109/PERCOMW.2018.8480127

M3 - Chapter (peer-reviewed)

SN - 978-1-5386-3228-4

BT - Pervasive Computing and Communications Workshops (PerCom)

PB - IEEE Press

ER -