Payne and Jones revisited: Estimating the abnormality of test score differences using a modified paired samples t test

J R Crawford, David C Howell, Paul H Garthwaite

Research output: Contribution to journalArticle

94 Citations (Scopus)

Abstract

Payne and Jones (1957) presented a useful formula for estimating the abnormality of differences between an individual's scores on two tests. Extending earlier work by Sokal and Rohlf (1995) and Crawford and Howell tin press), we developed a modified paired samples t test as an alternative to this formula. Unlike the Payne and Jones formula, the new method treats data from a normative or control sample as sample statistics rather than as population parameters. Technically, the new method is more appropriate for any comparison of an individual's difference score against normative data. However, it is most useful when the normative data is derived from samples with modest Ns: in these circumstances the Payne and Jones method overestimates the abnormality of differences. We suggest that the modified t test can be a useful tool in clinical practice and in single-case research. A computer program is made available that automates the calculations involved and can be used to store relevant data for future use.

Original languageEnglish
Pages (from-to)898-905
Number of pages8
JournalJournal of Clinical and Experimental Neuropsychology
Volume20
Issue number6
Publication statusPublished - 1998

Keywords

  • reliability

Cite this

Payne and Jones revisited : Estimating the abnormality of test score differences using a modified paired samples t test. / Crawford, J R ; Howell, David C ; Garthwaite, Paul H .

In: Journal of Clinical and Experimental Neuropsychology, Vol. 20, No. 6, 1998, p. 898-905.

Research output: Contribution to journalArticle

@article{51e554a4f72242d8bdcd36e6933403cd,
title = "Payne and Jones revisited: Estimating the abnormality of test score differences using a modified paired samples t test",
abstract = "Payne and Jones (1957) presented a useful formula for estimating the abnormality of differences between an individual's scores on two tests. Extending earlier work by Sokal and Rohlf (1995) and Crawford and Howell tin press), we developed a modified paired samples t test as an alternative to this formula. Unlike the Payne and Jones formula, the new method treats data from a normative or control sample as sample statistics rather than as population parameters. Technically, the new method is more appropriate for any comparison of an individual's difference score against normative data. However, it is most useful when the normative data is derived from samples with modest Ns: in these circumstances the Payne and Jones method overestimates the abnormality of differences. We suggest that the modified t test can be a useful tool in clinical practice and in single-case research. A computer program is made available that automates the calculations involved and can be used to store relevant data for future use.",
keywords = "reliability",
author = "Crawford, {J R} and Howell, {David C} and Garthwaite, {Paul H}",
year = "1998",
language = "English",
volume = "20",
pages = "898--905",
journal = "Journal of Clinical and Experimental Neuropsychology",
issn = "0168-8634",
publisher = "Psychology Press Ltd",
number = "6",

}

TY - JOUR

T1 - Payne and Jones revisited

T2 - Estimating the abnormality of test score differences using a modified paired samples t test

AU - Crawford, J R

AU - Howell, David C

AU - Garthwaite, Paul H

PY - 1998

Y1 - 1998

N2 - Payne and Jones (1957) presented a useful formula for estimating the abnormality of differences between an individual's scores on two tests. Extending earlier work by Sokal and Rohlf (1995) and Crawford and Howell tin press), we developed a modified paired samples t test as an alternative to this formula. Unlike the Payne and Jones formula, the new method treats data from a normative or control sample as sample statistics rather than as population parameters. Technically, the new method is more appropriate for any comparison of an individual's difference score against normative data. However, it is most useful when the normative data is derived from samples with modest Ns: in these circumstances the Payne and Jones method overestimates the abnormality of differences. We suggest that the modified t test can be a useful tool in clinical practice and in single-case research. A computer program is made available that automates the calculations involved and can be used to store relevant data for future use.

AB - Payne and Jones (1957) presented a useful formula for estimating the abnormality of differences between an individual's scores on two tests. Extending earlier work by Sokal and Rohlf (1995) and Crawford and Howell tin press), we developed a modified paired samples t test as an alternative to this formula. Unlike the Payne and Jones formula, the new method treats data from a normative or control sample as sample statistics rather than as population parameters. Technically, the new method is more appropriate for any comparison of an individual's difference score against normative data. However, it is most useful when the normative data is derived from samples with modest Ns: in these circumstances the Payne and Jones method overestimates the abnormality of differences. We suggest that the modified t test can be a useful tool in clinical practice and in single-case research. A computer program is made available that automates the calculations involved and can be used to store relevant data for future use.

KW - reliability

M3 - Article

VL - 20

SP - 898

EP - 905

JO - Journal of Clinical and Experimental Neuropsychology

JF - Journal of Clinical and Experimental Neuropsychology

SN - 0168-8634

IS - 6

ER -