Development of a triage tool for neurodevelopmental risk in children aged 30 months

Fiona Sim, Caroline Haig, John O'Dowd, Lucy Thompson, James Law, Alex McConnachie, Christopher Gillberg, Philip Wilson

Research output: Contribution to journalArticle

5 Citations (Scopus)
9 Downloads (Pure)

Abstract

Neurodevelopmental and neuropsychiatric disorders in young children predict educational, health and social problems. Early identification may significantly reduce this burden but relevant tools largely lack validation. We aimed to develop and evaluate the predictive validity of a simple screening tool for neurodevelopmental problems in a community sample of 30 month old children.

A sample of children was selected from a community cohort screened at 30 months by health visitors using the Sure Start Language Measure (SSLM) and the Strengths and Difficulties Questionnaire (SDQ) in 2011. Predictive validity was assessed by comparing screening results with detailed psychometric data from the same sample 1–2 years later. Screening performance using different thresholds was explored using Receiver Operating Characteristic (ROC) with ROC area under the curve (AUC) and bootstrapping techniques.

The SSLM predicted both language disorder identified by the New Reynell Developmental Language Scales (NRDLS) at follow-up (AUC 0.905) and global developmental delay assessed by the Griffiths Mental Development Scales (AUC 0.983). The SDQ administered at 30 months predicted psychiatric disorders identified by the Development and Wellbeing Assessment (DAWBA) at follow-up (AUC 0.821).

Using optimal cut-offs for the SDQ and SSLM at 30 months, both tools together had sensitivity 87%; specificity 64%; positive predictive value 31%; and negative predictive value 97% in the prediction of any kind of neurodevelopmental problem 1–2 years later.

The combined measure reported here is not yet sufficient as a stand-alone population screening tool for neurodevelopmental disorders. The SSLM and SDQ did however show promise in identifying preschool children at risk of ongoing language, psychiatric disorders and global developmental delay 1–2 years later but with fairly high false positive rates. Given that current developmental risk prediction in resource-poor settings is little better than random assignment, the SDQ and SSLM may aid clinical judgement when used as interim triage tools for practitioners with no specialist knowledge, in the context of longitudinal follow-up arrangements.
Original languageEnglish
Pages (from-to)69-82
Number of pages14
JournalResearch in Developmental Disabilities
Volume45-46
Early online date28 Jul 2015
DOIs
Publication statusPublished - Oct 2015

Fingerprint

Triage
Language
Area Under Curve
Language Disorders
ROC Curve
Psychiatry
Community Health Nurses
Social Problems
Preschool Children
Psychometrics
Surveys and Questionnaires
Health
Population

Keywords

  • screening
  • language delay
  • ESSENCE
  • neurodevelopment
  • neuropsychiatry
  • paediatrics
  • primary care

Cite this

Development of a triage tool for neurodevelopmental risk in children aged 30 months. / Sim, Fiona; Haig, Caroline ; O'Dowd, John; Thompson, Lucy; Law, James; McConnachie, Alex; Gillberg, Christopher; Wilson, Philip.

In: Research in Developmental Disabilities, Vol. 45-46, 10.2015, p. 69-82.

Research output: Contribution to journalArticle

Sim, Fiona ; Haig, Caroline ; O'Dowd, John ; Thompson, Lucy ; Law, James ; McConnachie, Alex ; Gillberg, Christopher ; Wilson, Philip. / Development of a triage tool for neurodevelopmental risk in children aged 30 months. In: Research in Developmental Disabilities. 2015 ; Vol. 45-46. pp. 69-82.
@article{2158b303c6a0485fb7daa7e7982784dd,
title = "Development of a triage tool for neurodevelopmental risk in children aged 30 months",
abstract = "Neurodevelopmental and neuropsychiatric disorders in young children predict educational, health and social problems. Early identification may significantly reduce this burden but relevant tools largely lack validation. We aimed to develop and evaluate the predictive validity of a simple screening tool for neurodevelopmental problems in a community sample of 30 month old children.A sample of children was selected from a community cohort screened at 30 months by health visitors using the Sure Start Language Measure (SSLM) and the Strengths and Difficulties Questionnaire (SDQ) in 2011. Predictive validity was assessed by comparing screening results with detailed psychometric data from the same sample 1–2 years later. Screening performance using different thresholds was explored using Receiver Operating Characteristic (ROC) with ROC area under the curve (AUC) and bootstrapping techniques.The SSLM predicted both language disorder identified by the New Reynell Developmental Language Scales (NRDLS) at follow-up (AUC 0.905) and global developmental delay assessed by the Griffiths Mental Development Scales (AUC 0.983). The SDQ administered at 30 months predicted psychiatric disorders identified by the Development and Wellbeing Assessment (DAWBA) at follow-up (AUC 0.821).Using optimal cut-offs for the SDQ and SSLM at 30 months, both tools together had sensitivity 87{\%}; specificity 64{\%}; positive predictive value 31{\%}; and negative predictive value 97{\%} in the prediction of any kind of neurodevelopmental problem 1–2 years later.The combined measure reported here is not yet sufficient as a stand-alone population screening tool for neurodevelopmental disorders. The SSLM and SDQ did however show promise in identifying preschool children at risk of ongoing language, psychiatric disorders and global developmental delay 1–2 years later but with fairly high false positive rates. Given that current developmental risk prediction in resource-poor settings is little better than random assignment, the SDQ and SSLM may aid clinical judgement when used as interim triage tools for practitioners with no specialist knowledge, in the context of longitudinal follow-up arrangements.",
keywords = "screening, language delay, ESSENCE, neurodevelopment, neuropsychiatry, paediatrics, primary care",
author = "Fiona Sim and Caroline Haig and John O'Dowd and Lucy Thompson and James Law and Alex McConnachie and Christopher Gillberg and Philip Wilson",
note = "Acknowledgements We are grateful to the health visitors and families who took part in this pilot work. Professor Robert Goodman kindly provided us with normative SDQ data for preschool children. Michelle Affleck conducted statistical analysis of the SIMD data. Susan Mac Millan performed some of the detailed assessments and, along with research nurses in the Glasgow Research Facility, made contact with many of the families. Mrs Kim Jones and Dr Elsa Ekevall provided invaluable administrative support: Dr Ekevall also generated the random sample for follow up. Dr Laxmi Kathuria provided the clinical ratings for the DAWBA under the supervision of Prof. Helen Minnis. Prof. Minnis, Prof. Graham Watt and Sir Lewis Ritchie all provided valuable comments on the manuscript",
year = "2015",
month = "10",
doi = "10.1016/j.ridd.2015.07.017",
language = "English",
volume = "45-46",
pages = "69--82",
journal = "Research in Developmental Disabilities",
issn = "0891-4222",
publisher = "Elsevier Inc.",

}

TY - JOUR

T1 - Development of a triage tool for neurodevelopmental risk in children aged 30 months

AU - Sim, Fiona

AU - Haig, Caroline

AU - O'Dowd, John

AU - Thompson, Lucy

AU - Law, James

AU - McConnachie, Alex

AU - Gillberg, Christopher

AU - Wilson, Philip

N1 - Acknowledgements We are grateful to the health visitors and families who took part in this pilot work. Professor Robert Goodman kindly provided us with normative SDQ data for preschool children. Michelle Affleck conducted statistical analysis of the SIMD data. Susan Mac Millan performed some of the detailed assessments and, along with research nurses in the Glasgow Research Facility, made contact with many of the families. Mrs Kim Jones and Dr Elsa Ekevall provided invaluable administrative support: Dr Ekevall also generated the random sample for follow up. Dr Laxmi Kathuria provided the clinical ratings for the DAWBA under the supervision of Prof. Helen Minnis. Prof. Minnis, Prof. Graham Watt and Sir Lewis Ritchie all provided valuable comments on the manuscript

PY - 2015/10

Y1 - 2015/10

N2 - Neurodevelopmental and neuropsychiatric disorders in young children predict educational, health and social problems. Early identification may significantly reduce this burden but relevant tools largely lack validation. We aimed to develop and evaluate the predictive validity of a simple screening tool for neurodevelopmental problems in a community sample of 30 month old children.A sample of children was selected from a community cohort screened at 30 months by health visitors using the Sure Start Language Measure (SSLM) and the Strengths and Difficulties Questionnaire (SDQ) in 2011. Predictive validity was assessed by comparing screening results with detailed psychometric data from the same sample 1–2 years later. Screening performance using different thresholds was explored using Receiver Operating Characteristic (ROC) with ROC area under the curve (AUC) and bootstrapping techniques.The SSLM predicted both language disorder identified by the New Reynell Developmental Language Scales (NRDLS) at follow-up (AUC 0.905) and global developmental delay assessed by the Griffiths Mental Development Scales (AUC 0.983). The SDQ administered at 30 months predicted psychiatric disorders identified by the Development and Wellbeing Assessment (DAWBA) at follow-up (AUC 0.821).Using optimal cut-offs for the SDQ and SSLM at 30 months, both tools together had sensitivity 87%; specificity 64%; positive predictive value 31%; and negative predictive value 97% in the prediction of any kind of neurodevelopmental problem 1–2 years later.The combined measure reported here is not yet sufficient as a stand-alone population screening tool for neurodevelopmental disorders. The SSLM and SDQ did however show promise in identifying preschool children at risk of ongoing language, psychiatric disorders and global developmental delay 1–2 years later but with fairly high false positive rates. Given that current developmental risk prediction in resource-poor settings is little better than random assignment, the SDQ and SSLM may aid clinical judgement when used as interim triage tools for practitioners with no specialist knowledge, in the context of longitudinal follow-up arrangements.

AB - Neurodevelopmental and neuropsychiatric disorders in young children predict educational, health and social problems. Early identification may significantly reduce this burden but relevant tools largely lack validation. We aimed to develop and evaluate the predictive validity of a simple screening tool for neurodevelopmental problems in a community sample of 30 month old children.A sample of children was selected from a community cohort screened at 30 months by health visitors using the Sure Start Language Measure (SSLM) and the Strengths and Difficulties Questionnaire (SDQ) in 2011. Predictive validity was assessed by comparing screening results with detailed psychometric data from the same sample 1–2 years later. Screening performance using different thresholds was explored using Receiver Operating Characteristic (ROC) with ROC area under the curve (AUC) and bootstrapping techniques.The SSLM predicted both language disorder identified by the New Reynell Developmental Language Scales (NRDLS) at follow-up (AUC 0.905) and global developmental delay assessed by the Griffiths Mental Development Scales (AUC 0.983). The SDQ administered at 30 months predicted psychiatric disorders identified by the Development and Wellbeing Assessment (DAWBA) at follow-up (AUC 0.821).Using optimal cut-offs for the SDQ and SSLM at 30 months, both tools together had sensitivity 87%; specificity 64%; positive predictive value 31%; and negative predictive value 97% in the prediction of any kind of neurodevelopmental problem 1–2 years later.The combined measure reported here is not yet sufficient as a stand-alone population screening tool for neurodevelopmental disorders. The SSLM and SDQ did however show promise in identifying preschool children at risk of ongoing language, psychiatric disorders and global developmental delay 1–2 years later but with fairly high false positive rates. Given that current developmental risk prediction in resource-poor settings is little better than random assignment, the SDQ and SSLM may aid clinical judgement when used as interim triage tools for practitioners with no specialist knowledge, in the context of longitudinal follow-up arrangements.

KW - screening

KW - language delay

KW - ESSENCE

KW - neurodevelopment

KW - neuropsychiatry

KW - paediatrics

KW - primary care

U2 - 10.1016/j.ridd.2015.07.017

DO - 10.1016/j.ridd.2015.07.017

M3 - Article

VL - 45-46

SP - 69

EP - 82

JO - Research in Developmental Disabilities

JF - Research in Developmental Disabilities

SN - 0891-4222

ER -