Areas of Interest as a Signal Detection Problem in Behavioral Eye-Tracking Research

Jacob L. Orquin*, Nathaniel J. S. Ashby, Alasdair D. F. Clarke

*Corresponding author for this work

Research output: Contribution to journalArticle

43 Citations (Scopus)

Abstract

Decision researchers frequently analyze attention to individual objects to test hypotheses about underlying cognitive processes. Generally, fixations are assigned to objects using a method known as area of interest (AOI). Ideally, an AOI includes all fixations belonging to an object while fixations to other objects are excluded. Unfortunately, due to measurement inaccuracy and insufficient distance between objects, the distributions of fixations to objects may overlap, resulting in a signal detection problem. If the AOI is to include all fixations to an object, it will also likely include fixations belonging to other objects (false positives). In a survey, we find that many researchers report testing multiple AOI sizes when performing analyses, presumably trying to balance the proportion of true and false positive fixations. To test whether AOI size influences the measurement of object attention and conclusions drawn about cognitive processes, we reanalyze four published studies and conduct a fifth tailored to our purpose. We find that in studies in which we expected overlapping fixation distributions, analyses benefited from smaller AOI sizes (0 degrees visual angle margin). In studies where we expected no overlap, analyses benefited from larger AOI sizes (>.5 degrees visual angle margins). We conclude with a guideline for the use of AOIs in behavioral eye-tracking research. Copyright (c) 2015 John Wiley & Sons, Ltd.

Original languageEnglish
Pages (from-to)103-115
Number of pages13
JournalJournal of Behavioral Decision Making
Volume29
Issue number2-3
Early online date20 Mar 2015
DOIs
Publication statusPublished - Apr 2016

Keywords

  • eye-tracking
  • areas of interest
  • signal detection
  • data fishing
  • information processing
  • decision-making
  • visual-search
  • movements
  • perception
  • attention

Cite this

Areas of Interest as a Signal Detection Problem in Behavioral Eye-Tracking Research. / Orquin, Jacob L.; Ashby, Nathaniel J. S.; Clarke, Alasdair D. F.

In: Journal of Behavioral Decision Making, Vol. 29, No. 2-3, 04.2016, p. 103-115.

Research output: Contribution to journalArticle

Orquin, Jacob L. ; Ashby, Nathaniel J. S. ; Clarke, Alasdair D. F. / Areas of Interest as a Signal Detection Problem in Behavioral Eye-Tracking Research. In: Journal of Behavioral Decision Making. 2016 ; Vol. 29, No. 2-3. pp. 103-115.
@article{7de3f9e644154d6088e4e08b433d5813,
title = "Areas of Interest as a Signal Detection Problem in Behavioral Eye-Tracking Research",
abstract = "Decision researchers frequently analyze attention to individual objects to test hypotheses about underlying cognitive processes. Generally, fixations are assigned to objects using a method known as area of interest (AOI). Ideally, an AOI includes all fixations belonging to an object while fixations to other objects are excluded. Unfortunately, due to measurement inaccuracy and insufficient distance between objects, the distributions of fixations to objects may overlap, resulting in a signal detection problem. If the AOI is to include all fixations to an object, it will also likely include fixations belonging to other objects (false positives). In a survey, we find that many researchers report testing multiple AOI sizes when performing analyses, presumably trying to balance the proportion of true and false positive fixations. To test whether AOI size influences the measurement of object attention and conclusions drawn about cognitive processes, we reanalyze four published studies and conduct a fifth tailored to our purpose. We find that in studies in which we expected overlapping fixation distributions, analyses benefited from smaller AOI sizes (0 degrees visual angle margin). In studies where we expected no overlap, analyses benefited from larger AOI sizes (>.5 degrees visual angle margins). We conclude with a guideline for the use of AOIs in behavioral eye-tracking research. Copyright (c) 2015 John Wiley & Sons, Ltd.",
keywords = "eye-tracking, areas of interest, signal detection, data fishing, information processing, decision-making, visual-search, movements, perception, attention",
author = "Orquin, {Jacob L.} and Ashby, {Nathaniel J. S.} and Clarke, {Alasdair D. F.}",
note = "Acknowledgements The authors wish to thank Martin Bagger, Susann Fiedler, Kenneth Holmqvist, Martin Meissner, and Rebecca Wright for lending their time (data).",
year = "2016",
month = "4",
doi = "10.1002/bdm.1867",
language = "English",
volume = "29",
pages = "103--115",
journal = "Journal of Behavioral Decision Making",
issn = "1099-0771",
publisher = "John Wiley and Sons Ltd",
number = "2-3",

}

TY - JOUR

T1 - Areas of Interest as a Signal Detection Problem in Behavioral Eye-Tracking Research

AU - Orquin, Jacob L.

AU - Ashby, Nathaniel J. S.

AU - Clarke, Alasdair D. F.

N1 - Acknowledgements The authors wish to thank Martin Bagger, Susann Fiedler, Kenneth Holmqvist, Martin Meissner, and Rebecca Wright for lending their time (data).

PY - 2016/4

Y1 - 2016/4

N2 - Decision researchers frequently analyze attention to individual objects to test hypotheses about underlying cognitive processes. Generally, fixations are assigned to objects using a method known as area of interest (AOI). Ideally, an AOI includes all fixations belonging to an object while fixations to other objects are excluded. Unfortunately, due to measurement inaccuracy and insufficient distance between objects, the distributions of fixations to objects may overlap, resulting in a signal detection problem. If the AOI is to include all fixations to an object, it will also likely include fixations belonging to other objects (false positives). In a survey, we find that many researchers report testing multiple AOI sizes when performing analyses, presumably trying to balance the proportion of true and false positive fixations. To test whether AOI size influences the measurement of object attention and conclusions drawn about cognitive processes, we reanalyze four published studies and conduct a fifth tailored to our purpose. We find that in studies in which we expected overlapping fixation distributions, analyses benefited from smaller AOI sizes (0 degrees visual angle margin). In studies where we expected no overlap, analyses benefited from larger AOI sizes (>.5 degrees visual angle margins). We conclude with a guideline for the use of AOIs in behavioral eye-tracking research. Copyright (c) 2015 John Wiley & Sons, Ltd.

AB - Decision researchers frequently analyze attention to individual objects to test hypotheses about underlying cognitive processes. Generally, fixations are assigned to objects using a method known as area of interest (AOI). Ideally, an AOI includes all fixations belonging to an object while fixations to other objects are excluded. Unfortunately, due to measurement inaccuracy and insufficient distance between objects, the distributions of fixations to objects may overlap, resulting in a signal detection problem. If the AOI is to include all fixations to an object, it will also likely include fixations belonging to other objects (false positives). In a survey, we find that many researchers report testing multiple AOI sizes when performing analyses, presumably trying to balance the proportion of true and false positive fixations. To test whether AOI size influences the measurement of object attention and conclusions drawn about cognitive processes, we reanalyze four published studies and conduct a fifth tailored to our purpose. We find that in studies in which we expected overlapping fixation distributions, analyses benefited from smaller AOI sizes (0 degrees visual angle margin). In studies where we expected no overlap, analyses benefited from larger AOI sizes (>.5 degrees visual angle margins). We conclude with a guideline for the use of AOIs in behavioral eye-tracking research. Copyright (c) 2015 John Wiley & Sons, Ltd.

KW - eye-tracking

KW - areas of interest

KW - signal detection

KW - data fishing

KW - information processing

KW - decision-making

KW - visual-search

KW - movements

KW - perception

KW - attention

U2 - 10.1002/bdm.1867

DO - 10.1002/bdm.1867

M3 - Article

VL - 29

SP - 103

EP - 115

JO - Journal of Behavioral Decision Making

JF - Journal of Behavioral Decision Making

SN - 1099-0771

IS - 2-3

ER -