Reliability of the variables in a new set of models that predict outcome after stroke

N U Weir, C E Counsell, M McDowall, A Gunkel, M S Dennis

Research output: Contribution to journalArticle

22 Citations (Scopus)

Abstract

Objectives: To provide valid predictions of outcome, the variables included in a prognostic model must be capable of reliable collection. The authors have recently reported a set of simple but rigorously developed models that predict outcome after stroke. The aim of this study was to establish the inter-rater reliability of the variables included in the models.
Methods: Inter-rater agreement was measured prospectively (between two clinicians; 92 patients). and retrospectively (between two auditors; 200 patients) and the validity of the data collected retrospectively was estimated by comparing them with data collected prospectively (195 patients). In the prospective study inter-rater agreement for urinary incontinence and for the variables of three other previously published models was also measured. The median difference (md) between ages and K statistics for other variables was calculated.
Results: For the model variables, prospective agreement ranged from good to excellent (age: md 0 years; living alone before the stroke kappa 0.84; pre-stroke functional independence kappa 0.67; normal verbal Glasgow Coma Scale score kappa 0.79; ability to lift both arms against gravity kappa 0.97; ability to walk unaided kappa 0.91) while retrospective agreement (age: md 0 years; kappa 0.55-0.92) and agreement between prospective and retrospective observers (age: md 0 years; kappa 0.49-0.78) was acceptable but less good. Prospective agreement was excellent for urinary incontinence (kappa 0.87) and variable for the other models (kappa 0.23-0.81)
Conclusion: The variables included in these new simple models of outcome after stroke are capable of reliable collection, comparable to or better than that of the other predictive variables considered. When collected retrospectively, the model variables are likely to remain reliable and reasonably valid.

Original languageEnglish
Pages (from-to)447-451
Number of pages5
JournalJournal of Neurology, Neurosurgery & Psychiatry
Volume74
Issue number4
DOIs
Publication statusPublished - Apr 2003

Keywords

  • Canadian Neurological Scale
  • retrospective assessment
  • prognostic models
  • severity
  • validity
  • variability
  • score

Cite this

Reliability of the variables in a new set of models that predict outcome after stroke. / Weir, N U; Counsell, C E; McDowall, M; Gunkel, A; Dennis, M S.

In: Journal of Neurology, Neurosurgery & Psychiatry, Vol. 74, No. 4, 04.2003, p. 447-451.

Research output: Contribution to journalArticle

@article{0533e4c6f94a4e1d9f1cb8d4fdd85502,
title = "Reliability of the variables in a new set of models that predict outcome after stroke",
abstract = "Objectives: To provide valid predictions of outcome, the variables included in a prognostic model must be capable of reliable collection. The authors have recently reported a set of simple but rigorously developed models that predict outcome after stroke. The aim of this study was to establish the inter-rater reliability of the variables included in the models. Methods: Inter-rater agreement was measured prospectively (between two clinicians; 92 patients). and retrospectively (between two auditors; 200 patients) and the validity of the data collected retrospectively was estimated by comparing them with data collected prospectively (195 patients). In the prospective study inter-rater agreement for urinary incontinence and for the variables of three other previously published models was also measured. The median difference (md) between ages and K statistics for other variables was calculated. Results: For the model variables, prospective agreement ranged from good to excellent (age: md 0 years; living alone before the stroke kappa 0.84; pre-stroke functional independence kappa 0.67; normal verbal Glasgow Coma Scale score kappa 0.79; ability to lift both arms against gravity kappa 0.97; ability to walk unaided kappa 0.91) while retrospective agreement (age: md 0 years; kappa 0.55-0.92) and agreement between prospective and retrospective observers (age: md 0 years; kappa 0.49-0.78) was acceptable but less good. Prospective agreement was excellent for urinary incontinence (kappa 0.87) and variable for the other models (kappa 0.23-0.81) Conclusion: The variables included in these new simple models of outcome after stroke are capable of reliable collection, comparable to or better than that of the other predictive variables considered. When collected retrospectively, the model variables are likely to remain reliable and reasonably valid.",
keywords = "Canadian Neurological Scale , retrospective assessment, prognostic models, severity, validity, variability, score",
author = "Weir, {N U} and Counsell, {C E} and M McDowall and A Gunkel and Dennis, {M S}",
year = "2003",
month = "4",
doi = "10.1136/jnnp.74.4.447",
language = "English",
volume = "74",
pages = "447--451",
journal = "Journal of Neurology, Neurosurgery & Psychiatry",
issn = "0022-3050",
publisher = "BMJ Publishing Group",
number = "4",

}

TY - JOUR

T1 - Reliability of the variables in a new set of models that predict outcome after stroke

AU - Weir, N U

AU - Counsell, C E

AU - McDowall, M

AU - Gunkel, A

AU - Dennis, M S

PY - 2003/4

Y1 - 2003/4

N2 - Objectives: To provide valid predictions of outcome, the variables included in a prognostic model must be capable of reliable collection. The authors have recently reported a set of simple but rigorously developed models that predict outcome after stroke. The aim of this study was to establish the inter-rater reliability of the variables included in the models. Methods: Inter-rater agreement was measured prospectively (between two clinicians; 92 patients). and retrospectively (between two auditors; 200 patients) and the validity of the data collected retrospectively was estimated by comparing them with data collected prospectively (195 patients). In the prospective study inter-rater agreement for urinary incontinence and for the variables of three other previously published models was also measured. The median difference (md) between ages and K statistics for other variables was calculated. Results: For the model variables, prospective agreement ranged from good to excellent (age: md 0 years; living alone before the stroke kappa 0.84; pre-stroke functional independence kappa 0.67; normal verbal Glasgow Coma Scale score kappa 0.79; ability to lift both arms against gravity kappa 0.97; ability to walk unaided kappa 0.91) while retrospective agreement (age: md 0 years; kappa 0.55-0.92) and agreement between prospective and retrospective observers (age: md 0 years; kappa 0.49-0.78) was acceptable but less good. Prospective agreement was excellent for urinary incontinence (kappa 0.87) and variable for the other models (kappa 0.23-0.81) Conclusion: The variables included in these new simple models of outcome after stroke are capable of reliable collection, comparable to or better than that of the other predictive variables considered. When collected retrospectively, the model variables are likely to remain reliable and reasonably valid.

AB - Objectives: To provide valid predictions of outcome, the variables included in a prognostic model must be capable of reliable collection. The authors have recently reported a set of simple but rigorously developed models that predict outcome after stroke. The aim of this study was to establish the inter-rater reliability of the variables included in the models. Methods: Inter-rater agreement was measured prospectively (between two clinicians; 92 patients). and retrospectively (between two auditors; 200 patients) and the validity of the data collected retrospectively was estimated by comparing them with data collected prospectively (195 patients). In the prospective study inter-rater agreement for urinary incontinence and for the variables of three other previously published models was also measured. The median difference (md) between ages and K statistics for other variables was calculated. Results: For the model variables, prospective agreement ranged from good to excellent (age: md 0 years; living alone before the stroke kappa 0.84; pre-stroke functional independence kappa 0.67; normal verbal Glasgow Coma Scale score kappa 0.79; ability to lift both arms against gravity kappa 0.97; ability to walk unaided kappa 0.91) while retrospective agreement (age: md 0 years; kappa 0.55-0.92) and agreement between prospective and retrospective observers (age: md 0 years; kappa 0.49-0.78) was acceptable but less good. Prospective agreement was excellent for urinary incontinence (kappa 0.87) and variable for the other models (kappa 0.23-0.81) Conclusion: The variables included in these new simple models of outcome after stroke are capable of reliable collection, comparable to or better than that of the other predictive variables considered. When collected retrospectively, the model variables are likely to remain reliable and reasonably valid.

KW - Canadian Neurological Scale

KW - retrospective assessment

KW - prognostic models

KW - severity

KW - validity

KW - variability

KW - score

U2 - 10.1136/jnnp.74.4.447

DO - 10.1136/jnnp.74.4.447

M3 - Article

VL - 74

SP - 447

EP - 451

JO - Journal of Neurology, Neurosurgery & Psychiatry

JF - Journal of Neurology, Neurosurgery & Psychiatry

SN - 0022-3050

IS - 4

ER -