Testing for a deficit in single case studies: Effects of departures from normality

John Robertson Crawford, P. H. Garthwaite, A. Azzalini, D. C. Howell, K. R. Laws

Research output: Contribution to journalArticle

65 Citations (Scopus)

Abstract

In neuropsychological single-case research inferences concerning a patient's cognitive status are often based on referring the patient's test score to those obtained from a modestly sized control sample. Two methods of testing for a deficit (z and a method proposed by Crawford and Howell [Crawford, J. R. & Howell, D. C. (1998). Comparing an individual's test score against norms derived from small samples. The Clinical Neuropsychologist, 12, 482-486]) both assume the control distribution is normal but this assumption will often be violated in practice. Monte Carlo simulation was employed to study the effects of leptokurtosis and the combination of skew and leptokurtosis on the Type I error rates for these two methods. For Crawford and Howell's method, leptokurtosis produced only a modest inflation of the Type I error rate when the control sample N was small-to-modest in size and error rates were lower than the specified rates at larger N. In contrast, the combination of leptokurtosis and skew produced marked inflation of error rates for small Ns. With a specified error rate of 5%, actual error rates as high as 14.31% and 9.96% were observed for z and Crawford and Howell's method respectively. Potential solutions to the problem of non-normal data are evaluated. (c) 2005 Elsevier Ltd. All rights reserved.

Original languageEnglish
Pages (from-to)666-677
Number of pages11
JournalNeuropsychologia
Volume44
DOIs
Publication statusPublished - 2006

Keywords

  • neuropsychology
  • single-case methods
  • statistical methods
  • non-normality
  • robustness
  • Monte Carlo simulation
  • SKEW-NORMAL-DISTRIBUTION
  • ALZHEIMERS-DISEASE
  • T-DISTRIBUTION
  • TEST SCORE
  • NEUROPSYCHOLOGY
  • DISSOCIATIONS
  • MEMORY

Cite this

Crawford, J. R., Garthwaite, P. H., Azzalini, A., Howell, D. C., & Laws, K. R. (2006). Testing for a deficit in single case studies: Effects of departures from normality. Neuropsychologia, 44, 666-677. https://doi.org/10.1016/j.neuropsychologia.2005.06.001