Estimating the percentage of the population with abnormally low scores (or abnormally large score differences) on standardized neuropsychological test batteries

A generic method with applications

J.R. Crawford, Paul H. Garthwaite, Catherine B. Gault

Research output: Contribution to journalArticle

82 Citations (Scopus)

Abstract

Information on the rarity or abnormality of an individual's test scores (or test score differences) is fundamental in interpreting the results of a neuropsychological assessment. If a standardized battery of tests is administered, the question arises as to what percentage of the healthy population would be expected to exhibit one or more abnormally low test scores (and, in general, j or more abnormally low scores). Similar issues arise when the concern is with the number of abnormal pairwise differences between an individual's scores on the battery, or when an individual's scores on each component of the battery are compared with the individual's mean score. A generic Monte Carlo simulation method for tackling such problems is described (it requires only that the matrix of correlations between tests be available) and is contrasted with the use of binomial probabilities. The method is then applied to Index scores for the Wechsler Adult Intelligence Scale-Third Edition (WAIS-III; D. Wechsler, 1997) and Wechsler Intelligence Scale for Children-Fourth Edition (WISC-IV; D. Wechsler, 2003). Three computer programs that implement the methods are made available.

Original languageEnglish
Pages (from-to)419-430
Number of pages12
JournalNeuropsychology
Volume21
Issue number4
DOIs
Publication statusPublished - Jul 2007

Keywords

  • neuropsychological assessment
  • multiple tests
  • single-case inference
  • Monte Carlo methods
  • prevalence of deficits
  • postoperative cognitive dysfunction
  • bypass graft-surgery
  • base-rate data
  • subtest scatter
  • performance
  • issues

Cite this

@article{5b2ed8a22099423d87eebb1b818b6a8d,
title = "Estimating the percentage of the population with abnormally low scores (or abnormally large score differences) on standardized neuropsychological test batteries: A generic method with applications",
abstract = "Information on the rarity or abnormality of an individual's test scores (or test score differences) is fundamental in interpreting the results of a neuropsychological assessment. If a standardized battery of tests is administered, the question arises as to what percentage of the healthy population would be expected to exhibit one or more abnormally low test scores (and, in general, j or more abnormally low scores). Similar issues arise when the concern is with the number of abnormal pairwise differences between an individual's scores on the battery, or when an individual's scores on each component of the battery are compared with the individual's mean score. A generic Monte Carlo simulation method for tackling such problems is described (it requires only that the matrix of correlations between tests be available) and is contrasted with the use of binomial probabilities. The method is then applied to Index scores for the Wechsler Adult Intelligence Scale-Third Edition (WAIS-III; D. Wechsler, 1997) and Wechsler Intelligence Scale for Children-Fourth Edition (WISC-IV; D. Wechsler, 2003). Three computer programs that implement the methods are made available.",
keywords = "neuropsychological assessment, multiple tests, single-case inference, Monte Carlo methods, prevalence of deficits, postoperative cognitive dysfunction, bypass graft-surgery, base-rate data, subtest scatter, performance, issues",
author = "J.R. Crawford and Garthwaite, {Paul H.} and Gault, {Catherine B.}",
year = "2007",
month = "7",
doi = "10.1037/0894-4105.21.4.419",
language = "English",
volume = "21",
pages = "419--430",
journal = "Neuropsychology",
issn = "0894-4105",
publisher = "American Psychological Association Inc.",
number = "4",

}

TY - JOUR

T1 - Estimating the percentage of the population with abnormally low scores (or abnormally large score differences) on standardized neuropsychological test batteries

T2 - A generic method with applications

AU - Crawford, J.R.

AU - Garthwaite, Paul H.

AU - Gault, Catherine B.

PY - 2007/7

Y1 - 2007/7

N2 - Information on the rarity or abnormality of an individual's test scores (or test score differences) is fundamental in interpreting the results of a neuropsychological assessment. If a standardized battery of tests is administered, the question arises as to what percentage of the healthy population would be expected to exhibit one or more abnormally low test scores (and, in general, j or more abnormally low scores). Similar issues arise when the concern is with the number of abnormal pairwise differences between an individual's scores on the battery, or when an individual's scores on each component of the battery are compared with the individual's mean score. A generic Monte Carlo simulation method for tackling such problems is described (it requires only that the matrix of correlations between tests be available) and is contrasted with the use of binomial probabilities. The method is then applied to Index scores for the Wechsler Adult Intelligence Scale-Third Edition (WAIS-III; D. Wechsler, 1997) and Wechsler Intelligence Scale for Children-Fourth Edition (WISC-IV; D. Wechsler, 2003). Three computer programs that implement the methods are made available.

AB - Information on the rarity or abnormality of an individual's test scores (or test score differences) is fundamental in interpreting the results of a neuropsychological assessment. If a standardized battery of tests is administered, the question arises as to what percentage of the healthy population would be expected to exhibit one or more abnormally low test scores (and, in general, j or more abnormally low scores). Similar issues arise when the concern is with the number of abnormal pairwise differences between an individual's scores on the battery, or when an individual's scores on each component of the battery are compared with the individual's mean score. A generic Monte Carlo simulation method for tackling such problems is described (it requires only that the matrix of correlations between tests be available) and is contrasted with the use of binomial probabilities. The method is then applied to Index scores for the Wechsler Adult Intelligence Scale-Third Edition (WAIS-III; D. Wechsler, 1997) and Wechsler Intelligence Scale for Children-Fourth Edition (WISC-IV; D. Wechsler, 2003). Three computer programs that implement the methods are made available.

KW - neuropsychological assessment

KW - multiple tests

KW - single-case inference

KW - Monte Carlo methods

KW - prevalence of deficits

KW - postoperative cognitive dysfunction

KW - bypass graft-surgery

KW - base-rate data

KW - subtest scatter

KW - performance

KW - issues

UR - http://www.scopus.com/inward/record.url?scp=34548151810&partnerID=8YFLogxK

U2 - 10.1037/0894-4105.21.4.419

DO - 10.1037/0894-4105.21.4.419

M3 - Article

VL - 21

SP - 419

EP - 430

JO - Neuropsychology

JF - Neuropsychology

SN - 0894-4105

IS - 4

ER -