Measuring target detection performance in paradigms with high event rates

Alexandra Bendixen, Søren K Andersen

Research output: Contribution to journalArticle

16 Citations (Scopus)

Abstract

OBJECTIVES: Combining behavioral and neurophysiological measurements inevitably implies mutual constraints, such as when the neurophysiological measurement requires fast-paced stimulus presentation and hence the attribution of a behavioral response to a particular preceding stimulus becomes ambiguous. We develop and test a method for validly assessing behavioral detection performance in spite of this ambiguity. METHODS: We examine four approaches taken in the literature to treat such situations. We analytically derive a new variant of computing the classical parameters of signal detection theory, hit and false alarm rates, adapted to fast-paced paradigms. RESULTS: Each of the previous approaches shows specific shortcomings (susceptibility towards response window choice, biased estimates of behavioral detection performance). Superior performance of our new approach is demonstrated for both simulated and empirical behavioral data. Further evidence is provided by reliable correspondence between behavioral performance and the N2b component as an electrophysiological indicator of target detection. CONCLUSIONS: The appropriateness of our approach is substantiated by both theoretical and empirical arguments. SIGNIFICANCE: We demonstrate an easy-to-implement solution for measuring target detection performance independent of the rate of event presentation. Thus overcoming the measurement bias of previous approaches, our method will help to clarify the behavioral relevance of different measures of cortical activation.
Original languageEnglish
Pages (from-to)928-940
Number of pages13
JournalClinical Neurophysiology
Volume124
Issue number5
Early online date21 Dec 2012
DOIs
Publication statusPublished - May 2013

Fingerprint

Psychological Signal Detection

Keywords

  • signal detection theory (SDT)
  • continuous simulus presentation
  • discrimination
  • sensitivity (d)
  • response bias
  • undefined observation interval

Cite this

Measuring target detection performance in paradigms with high event rates. / Bendixen, Alexandra; Andersen, Søren K.

In: Clinical Neurophysiology, Vol. 124, No. 5, 05.2013, p. 928-940.

Research output: Contribution to journalArticle

@article{c8eea125e28a4c19a0abea9a0f9a92b8,
title = "Measuring target detection performance in paradigms with high event rates",
abstract = "OBJECTIVES: Combining behavioral and neurophysiological measurements inevitably implies mutual constraints, such as when the neurophysiological measurement requires fast-paced stimulus presentation and hence the attribution of a behavioral response to a particular preceding stimulus becomes ambiguous. We develop and test a method for validly assessing behavioral detection performance in spite of this ambiguity. METHODS: We examine four approaches taken in the literature to treat such situations. We analytically derive a new variant of computing the classical parameters of signal detection theory, hit and false alarm rates, adapted to fast-paced paradigms. RESULTS: Each of the previous approaches shows specific shortcomings (susceptibility towards response window choice, biased estimates of behavioral detection performance). Superior performance of our new approach is demonstrated for both simulated and empirical behavioral data. Further evidence is provided by reliable correspondence between behavioral performance and the N2b component as an electrophysiological indicator of target detection. CONCLUSIONS: The appropriateness of our approach is substantiated by both theoretical and empirical arguments. SIGNIFICANCE: We demonstrate an easy-to-implement solution for measuring target detection performance independent of the rate of event presentation. Thus overcoming the measurement bias of previous approaches, our method will help to clarify the behavioral relevance of different measures of cortical activation.",
keywords = "signal detection theory (SDT), continuous simulus presentation, discrimination , sensitivity (d), response bias, undefined observation interval",
author = "Alexandra Bendixen and Andersen, {S{\o}ren K}",
note = "Copyright {\circledC} 2012 International Federation of Clinical Neurophysiology. Published by Elsevier Ireland Ltd. All rights reserved.",
year = "2013",
month = "5",
doi = "10.1016/j.clinph.2012.11.012",
language = "English",
volume = "124",
pages = "928--940",
journal = "Clinical Neurophysiology",
issn = "1388-2457",
publisher = "Elsevier Ireland Ltd",
number = "5",

}

TY - JOUR

T1 - Measuring target detection performance in paradigms with high event rates

AU - Bendixen, Alexandra

AU - Andersen, Søren K

N1 - Copyright © 2012 International Federation of Clinical Neurophysiology. Published by Elsevier Ireland Ltd. All rights reserved.

PY - 2013/5

Y1 - 2013/5

N2 - OBJECTIVES: Combining behavioral and neurophysiological measurements inevitably implies mutual constraints, such as when the neurophysiological measurement requires fast-paced stimulus presentation and hence the attribution of a behavioral response to a particular preceding stimulus becomes ambiguous. We develop and test a method for validly assessing behavioral detection performance in spite of this ambiguity. METHODS: We examine four approaches taken in the literature to treat such situations. We analytically derive a new variant of computing the classical parameters of signal detection theory, hit and false alarm rates, adapted to fast-paced paradigms. RESULTS: Each of the previous approaches shows specific shortcomings (susceptibility towards response window choice, biased estimates of behavioral detection performance). Superior performance of our new approach is demonstrated for both simulated and empirical behavioral data. Further evidence is provided by reliable correspondence between behavioral performance and the N2b component as an electrophysiological indicator of target detection. CONCLUSIONS: The appropriateness of our approach is substantiated by both theoretical and empirical arguments. SIGNIFICANCE: We demonstrate an easy-to-implement solution for measuring target detection performance independent of the rate of event presentation. Thus overcoming the measurement bias of previous approaches, our method will help to clarify the behavioral relevance of different measures of cortical activation.

AB - OBJECTIVES: Combining behavioral and neurophysiological measurements inevitably implies mutual constraints, such as when the neurophysiological measurement requires fast-paced stimulus presentation and hence the attribution of a behavioral response to a particular preceding stimulus becomes ambiguous. We develop and test a method for validly assessing behavioral detection performance in spite of this ambiguity. METHODS: We examine four approaches taken in the literature to treat such situations. We analytically derive a new variant of computing the classical parameters of signal detection theory, hit and false alarm rates, adapted to fast-paced paradigms. RESULTS: Each of the previous approaches shows specific shortcomings (susceptibility towards response window choice, biased estimates of behavioral detection performance). Superior performance of our new approach is demonstrated for both simulated and empirical behavioral data. Further evidence is provided by reliable correspondence between behavioral performance and the N2b component as an electrophysiological indicator of target detection. CONCLUSIONS: The appropriateness of our approach is substantiated by both theoretical and empirical arguments. SIGNIFICANCE: We demonstrate an easy-to-implement solution for measuring target detection performance independent of the rate of event presentation. Thus overcoming the measurement bias of previous approaches, our method will help to clarify the behavioral relevance of different measures of cortical activation.

KW - signal detection theory (SDT)

KW - continuous simulus presentation

KW - discrimination

KW - sensitivity (d)

KW - response bias

KW - undefined observation interval

U2 - 10.1016/j.clinph.2012.11.012

DO - 10.1016/j.clinph.2012.11.012

M3 - Article

VL - 124

SP - 928

EP - 940

JO - Clinical Neurophysiology

JF - Clinical Neurophysiology

SN - 1388-2457

IS - 5

ER -