On the reliability and standard errors of measurement of contrast measures from the D-KEFS

Research output: Contribution to journalArticle

32 Citations (Scopus)

Abstract

A formula for the reliability of difference scores was used to estimate the reliability of Delis-Kaplan Executive Function System (D-KEFS; Delis et al., 2001) contrast measures from the reliabilities and correlations of their components. In turn these reliabilities were used to calculate standard errors of measurement. The majority of contrast measures had low reliabilities: of the 5 1 reliability coefficients calculated in the present study, none exceeded 0.7 and hence all failed to meet any of the criteria for acceptable reliability proposed by various experts in psychological measurement. The mean reliability of the contrast scores was 0.27, the median reliability was 0.30. The standard errors of measurement were large and, in many cases, equaled or were only marginally smaller than the contrast scores' standard deviations. The results Suggest that, at present, D-KEFS contrast measures should not be used in neuropsychological decision making. (JINS, 2008, 14, 1069-1073.)

Original languageEnglish
Pages (from-to)1069-1073
Number of pages5
JournalJournal of the International Neuropsychological Society
Volume14
Issue number6
Early online date27 Oct 2008
DOIs
Publication statusPublished - Nov 2008

Keywords

  • executive functioning
  • neuropsychological assessment
  • difference scores
  • psychometrics
  • measurement error
  • quantitative methods
  • executive function system

Cite this

@article{e5f6ea77e2e94edfaa9ea69291e30278,
title = "On the reliability and standard errors of measurement of contrast measures from the D-KEFS",
abstract = "A formula for the reliability of difference scores was used to estimate the reliability of Delis-Kaplan Executive Function System (D-KEFS; Delis et al., 2001) contrast measures from the reliabilities and correlations of their components. In turn these reliabilities were used to calculate standard errors of measurement. The majority of contrast measures had low reliabilities: of the 5 1 reliability coefficients calculated in the present study, none exceeded 0.7 and hence all failed to meet any of the criteria for acceptable reliability proposed by various experts in psychological measurement. The mean reliability of the contrast scores was 0.27, the median reliability was 0.30. The standard errors of measurement were large and, in many cases, equaled or were only marginally smaller than the contrast scores' standard deviations. The results Suggest that, at present, D-KEFS contrast measures should not be used in neuropsychological decision making. (JINS, 2008, 14, 1069-1073.)",
keywords = "executive functioning, neuropsychological assessment, difference scores, psychometrics, measurement error, quantitative methods, executive function system",
author = "Crawford, {John Robertson} and Sutherland, {David McGregor} and Garthwaite, {Paul H.}",
year = "2008",
month = "11",
doi = "10.1017/S1355617708081228",
language = "English",
volume = "14",
pages = "1069--1073",
journal = "Journal of the International Neuropsychological Society",
issn = "1355-6177",
publisher = "Cambridge University Press",
number = "6",

}

TY - JOUR

T1 - On the reliability and standard errors of measurement of contrast measures from the D-KEFS

AU - Crawford, John Robertson

AU - Sutherland, David McGregor

AU - Garthwaite, Paul H.

PY - 2008/11

Y1 - 2008/11

N2 - A formula for the reliability of difference scores was used to estimate the reliability of Delis-Kaplan Executive Function System (D-KEFS; Delis et al., 2001) contrast measures from the reliabilities and correlations of their components. In turn these reliabilities were used to calculate standard errors of measurement. The majority of contrast measures had low reliabilities: of the 5 1 reliability coefficients calculated in the present study, none exceeded 0.7 and hence all failed to meet any of the criteria for acceptable reliability proposed by various experts in psychological measurement. The mean reliability of the contrast scores was 0.27, the median reliability was 0.30. The standard errors of measurement were large and, in many cases, equaled or were only marginally smaller than the contrast scores' standard deviations. The results Suggest that, at present, D-KEFS contrast measures should not be used in neuropsychological decision making. (JINS, 2008, 14, 1069-1073.)

AB - A formula for the reliability of difference scores was used to estimate the reliability of Delis-Kaplan Executive Function System (D-KEFS; Delis et al., 2001) contrast measures from the reliabilities and correlations of their components. In turn these reliabilities were used to calculate standard errors of measurement. The majority of contrast measures had low reliabilities: of the 5 1 reliability coefficients calculated in the present study, none exceeded 0.7 and hence all failed to meet any of the criteria for acceptable reliability proposed by various experts in psychological measurement. The mean reliability of the contrast scores was 0.27, the median reliability was 0.30. The standard errors of measurement were large and, in many cases, equaled or were only marginally smaller than the contrast scores' standard deviations. The results Suggest that, at present, D-KEFS contrast measures should not be used in neuropsychological decision making. (JINS, 2008, 14, 1069-1073.)

KW - executive functioning

KW - neuropsychological assessment

KW - difference scores

KW - psychometrics

KW - measurement error

KW - quantitative methods

KW - executive function system

U2 - 10.1017/S1355617708081228

DO - 10.1017/S1355617708081228

M3 - Article

VL - 14

SP - 1069

EP - 1073

JO - Journal of the International Neuropsychological Society

JF - Journal of the International Neuropsychological Society

SN - 1355-6177

IS - 6

ER -