Analysing randomised controlled trials with missing data: Choice of approach affects conclusions

Shona Fielding, Peter Fayers, Craig R. Ramsay

Research output: Contribution to journalArticle

20 Citations (Scopus)
4 Downloads (Pure)

Abstract

Background: The publication of a wrong conclusion from a randomised trial could have disastrous consequences. Missing data are unavoidable in most studies, but ignoring the problem may introduce bias to the results. Finding an appropriate way to deal with missing data is of paramount importance. We show how the choice of analysis method can impact on the conclusion of the trial with regard to the quality of life outcomes.

Methods: Various analysis strategies (analysis of covariance, linear mixed effects model) with and without imputation were carried out to assess treatment difference in four quality of life outcomes in an example clinical trial.

Results: Across all four quality of life outcomes, the various analysis approaches provided different estimates of treatment difference, with varying precision, using different numbers of patients. In some cases the decision about statistical significance differed. The results suggested that where possible extra effort should be made to retrieve missing responses. In the presence of data missing at random, simple imputation was inappropriate with multiple imputation or a linear mixed effects model more useful.

Conclusion: Different trial conclusions were obtained for a variety of analysis approaches for the same outcome. Collecting as much data as possible is of paramount importance. Careful consideration should be taken when deciding on the most appropriate strategy for analysis when missing data are involved and this strategy should be pre-specified in the trial protocol. Making inappropriate decisions could result in inappropriate conclusions potentially leading to the adoption of a clinical intervention in error.
Original languageEnglish
Pages (from-to)461-469
Number of pages9
JournalContemporary Clinical Trials
Volume33
Issue number3
Early online date12 Jan 2012
DOIs
Publication statusPublished - May 2012

Fingerprint

Randomized Controlled Trials
Quality of Life
Clinical Protocols
Publications
Decision Making
Clinical Trials
Therapeutics

Keywords

  • clinical trial
  • analysis
  • missing data
  • quality of life
  • imputation

Cite this

Analysing randomised controlled trials with missing data : Choice of approach affects conclusions. / Fielding, Shona; Fayers, Peter; Ramsay, Craig R.

In: Contemporary Clinical Trials, Vol. 33, No. 3, 05.2012, p. 461-469.

Research output: Contribution to journalArticle

@article{874f6bff312444b9a602537fb8efd511,
title = "Analysing randomised controlled trials with missing data: Choice of approach affects conclusions",
abstract = "Background: The publication of a wrong conclusion from a randomised trial could have disastrous consequences. Missing data are unavoidable in most studies, but ignoring the problem may introduce bias to the results. Finding an appropriate way to deal with missing data is of paramount importance. We show how the choice of analysis method can impact on the conclusion of the trial with regard to the quality of life outcomes.Methods: Various analysis strategies (analysis of covariance, linear mixed effects model) with and without imputation were carried out to assess treatment difference in four quality of life outcomes in an example clinical trial.Results: Across all four quality of life outcomes, the various analysis approaches provided different estimates of treatment difference, with varying precision, using different numbers of patients. In some cases the decision about statistical significance differed. The results suggested that where possible extra effort should be made to retrieve missing responses. In the presence of data missing at random, simple imputation was inappropriate with multiple imputation or a linear mixed effects model more useful.Conclusion: Different trial conclusions were obtained for a variety of analysis approaches for the same outcome. Collecting as much data as possible is of paramount importance. Careful consideration should be taken when deciding on the most appropriate strategy for analysis when missing data are involved and this strategy should be pre-specified in the trial protocol. Making inappropriate decisions could result in inappropriate conclusions potentially leading to the adoption of a clinical intervention in error.",
keywords = "clinical trial, analysis, missing data, quality of life, imputation",
author = "Shona Fielding and Peter Fayers and Ramsay, {Craig R.}",
note = "Copyright {\circledC} 2012 Elsevier Inc. All rights reserved. PMID: 22265924 [PubMed - indexed for MEDLINE]",
year = "2012",
month = "5",
doi = "10.1016/j.cct.2011.12.002",
language = "English",
volume = "33",
pages = "461--469",
journal = "Contemporary Clinical Trials",
issn = "1551-7144",
publisher = "Elsevier Inc.",
number = "3",

}

TY - JOUR

T1 - Analysing randomised controlled trials with missing data

T2 - Choice of approach affects conclusions

AU - Fielding, Shona

AU - Fayers, Peter

AU - Ramsay, Craig R.

N1 - Copyright © 2012 Elsevier Inc. All rights reserved. PMID: 22265924 [PubMed - indexed for MEDLINE]

PY - 2012/5

Y1 - 2012/5

N2 - Background: The publication of a wrong conclusion from a randomised trial could have disastrous consequences. Missing data are unavoidable in most studies, but ignoring the problem may introduce bias to the results. Finding an appropriate way to deal with missing data is of paramount importance. We show how the choice of analysis method can impact on the conclusion of the trial with regard to the quality of life outcomes.Methods: Various analysis strategies (analysis of covariance, linear mixed effects model) with and without imputation were carried out to assess treatment difference in four quality of life outcomes in an example clinical trial.Results: Across all four quality of life outcomes, the various analysis approaches provided different estimates of treatment difference, with varying precision, using different numbers of patients. In some cases the decision about statistical significance differed. The results suggested that where possible extra effort should be made to retrieve missing responses. In the presence of data missing at random, simple imputation was inappropriate with multiple imputation or a linear mixed effects model more useful.Conclusion: Different trial conclusions were obtained for a variety of analysis approaches for the same outcome. Collecting as much data as possible is of paramount importance. Careful consideration should be taken when deciding on the most appropriate strategy for analysis when missing data are involved and this strategy should be pre-specified in the trial protocol. Making inappropriate decisions could result in inappropriate conclusions potentially leading to the adoption of a clinical intervention in error.

AB - Background: The publication of a wrong conclusion from a randomised trial could have disastrous consequences. Missing data are unavoidable in most studies, but ignoring the problem may introduce bias to the results. Finding an appropriate way to deal with missing data is of paramount importance. We show how the choice of analysis method can impact on the conclusion of the trial with regard to the quality of life outcomes.Methods: Various analysis strategies (analysis of covariance, linear mixed effects model) with and without imputation were carried out to assess treatment difference in four quality of life outcomes in an example clinical trial.Results: Across all four quality of life outcomes, the various analysis approaches provided different estimates of treatment difference, with varying precision, using different numbers of patients. In some cases the decision about statistical significance differed. The results suggested that where possible extra effort should be made to retrieve missing responses. In the presence of data missing at random, simple imputation was inappropriate with multiple imputation or a linear mixed effects model more useful.Conclusion: Different trial conclusions were obtained for a variety of analysis approaches for the same outcome. Collecting as much data as possible is of paramount importance. Careful consideration should be taken when deciding on the most appropriate strategy for analysis when missing data are involved and this strategy should be pre-specified in the trial protocol. Making inappropriate decisions could result in inappropriate conclusions potentially leading to the adoption of a clinical intervention in error.

KW - clinical trial

KW - analysis

KW - missing data

KW - quality of life

KW - imputation

U2 - 10.1016/j.cct.2011.12.002

DO - 10.1016/j.cct.2011.12.002

M3 - Article

VL - 33

SP - 461

EP - 469

JO - Contemporary Clinical Trials

JF - Contemporary Clinical Trials

SN - 1551-7144

IS - 3

ER -