Detecting dissociations in single-case studies: Type I errors, statistical power and the classical versus strong distinction

John Robertson Crawford, P. H. Garthwaite

Research output: Contribution to journalArticle

22 Citations (Scopus)

Abstract

Dissociations observed in single-case studies play an important role in building and testing theory in neuropsychology; therefore the criteria used to identify their presence should be subjected to empirical scrutiny. Extending work on classical dissociations, Monte Carlo simulation is used to examine the Type I error rate for two methods of detecting strong dissociations. When a Type I error was defined as misclassifying a healthy control, error rates were low for both methods. When Type I errors were defined as misclassifying patients with strictly equivalent deficits on two tasks, error rates for strong dissociations were high for the "conventional" criteria and were very high when cases misclassified as exhibiting either form of dissociation (strong or classical) were combined (maximum= 55.1%). The power to detect strong and classical dissociations was generally low-to-moderate, but was moderate-to-high in most scenarios when power was defined as the ability to detect either form of dissociation. In most scenarios patients with strong dissociations were more likely to be classified as exhibiting classical dissociations. The results question the practical utility of the distinction between strong and classical dissociations regardless of the criteria employed to test for their presence. (c) 2006 Elsevier Ltd. All rights reserved.

Original languageEnglish
Pages (from-to)2249-2258
Number of pages9
JournalNeuropsychologia
Volume44
DOIs
Publication statusPublished - 2006

Keywords

  • single-case studies
  • statistical methods
  • strong dissociations
  • classical dissociations
  • Monte Carlo simulation
  • COGNITIVE NEUROPSYCHOLOGY

Cite this

@article{3912b5f289354f26916ea09dcd55aa1f,
title = "Detecting dissociations in single-case studies: Type I errors, statistical power and the classical versus strong distinction",
abstract = "Dissociations observed in single-case studies play an important role in building and testing theory in neuropsychology; therefore the criteria used to identify their presence should be subjected to empirical scrutiny. Extending work on classical dissociations, Monte Carlo simulation is used to examine the Type I error rate for two methods of detecting strong dissociations. When a Type I error was defined as misclassifying a healthy control, error rates were low for both methods. When Type I errors were defined as misclassifying patients with strictly equivalent deficits on two tasks, error rates for strong dissociations were high for the {"}conventional{"} criteria and were very high when cases misclassified as exhibiting either form of dissociation (strong or classical) were combined (maximum= 55.1{\%}). The power to detect strong and classical dissociations was generally low-to-moderate, but was moderate-to-high in most scenarios when power was defined as the ability to detect either form of dissociation. In most scenarios patients with strong dissociations were more likely to be classified as exhibiting classical dissociations. The results question the practical utility of the distinction between strong and classical dissociations regardless of the criteria employed to test for their presence. (c) 2006 Elsevier Ltd. All rights reserved.",
keywords = "single-case studies, statistical methods, strong dissociations, classical dissociations, Monte Carlo simulation, COGNITIVE NEUROPSYCHOLOGY",
author = "Crawford, {John Robertson} and Garthwaite, {P. H.}",
year = "2006",
doi = "10.1016/j.neuropsychologia.2006.05.019",
language = "English",
volume = "44",
pages = "2249--2258",
journal = "Neuropsychologia",
issn = "0028-3932",
publisher = "Elsevier Limited",

}

TY - JOUR

T1 - Detecting dissociations in single-case studies: Type I errors, statistical power and the classical versus strong distinction

AU - Crawford, John Robertson

AU - Garthwaite, P. H.

PY - 2006

Y1 - 2006

N2 - Dissociations observed in single-case studies play an important role in building and testing theory in neuropsychology; therefore the criteria used to identify their presence should be subjected to empirical scrutiny. Extending work on classical dissociations, Monte Carlo simulation is used to examine the Type I error rate for two methods of detecting strong dissociations. When a Type I error was defined as misclassifying a healthy control, error rates were low for both methods. When Type I errors were defined as misclassifying patients with strictly equivalent deficits on two tasks, error rates for strong dissociations were high for the "conventional" criteria and were very high when cases misclassified as exhibiting either form of dissociation (strong or classical) were combined (maximum= 55.1%). The power to detect strong and classical dissociations was generally low-to-moderate, but was moderate-to-high in most scenarios when power was defined as the ability to detect either form of dissociation. In most scenarios patients with strong dissociations were more likely to be classified as exhibiting classical dissociations. The results question the practical utility of the distinction between strong and classical dissociations regardless of the criteria employed to test for their presence. (c) 2006 Elsevier Ltd. All rights reserved.

AB - Dissociations observed in single-case studies play an important role in building and testing theory in neuropsychology; therefore the criteria used to identify their presence should be subjected to empirical scrutiny. Extending work on classical dissociations, Monte Carlo simulation is used to examine the Type I error rate for two methods of detecting strong dissociations. When a Type I error was defined as misclassifying a healthy control, error rates were low for both methods. When Type I errors were defined as misclassifying patients with strictly equivalent deficits on two tasks, error rates for strong dissociations were high for the "conventional" criteria and were very high when cases misclassified as exhibiting either form of dissociation (strong or classical) were combined (maximum= 55.1%). The power to detect strong and classical dissociations was generally low-to-moderate, but was moderate-to-high in most scenarios when power was defined as the ability to detect either form of dissociation. In most scenarios patients with strong dissociations were more likely to be classified as exhibiting classical dissociations. The results question the practical utility of the distinction between strong and classical dissociations regardless of the criteria employed to test for their presence. (c) 2006 Elsevier Ltd. All rights reserved.

KW - single-case studies

KW - statistical methods

KW - strong dissociations

KW - classical dissociations

KW - Monte Carlo simulation

KW - COGNITIVE NEUROPSYCHOLOGY

U2 - 10.1016/j.neuropsychologia.2006.05.019

DO - 10.1016/j.neuropsychologia.2006.05.019

M3 - Article

VL - 44

SP - 2249

EP - 2258

JO - Neuropsychologia

JF - Neuropsychologia

SN - 0028-3932

ER -