Recruitment to randomised trials

Strategies for trial enrolment and participation study. The STEPS study

M. K. Campbell, Claire Snowdon, David Francis, Diana R. Elbourne, Alison Mary McDonald, Rosemary C. Knight, Vikki Ann Entwistle, Jo Garcia, Ian Roberts, A. Grant, STEPS Group

Research output: Contribution to journalLiterature review

168 Citations (Scopus)

Abstract

Objectives: To identify factors associated with good and poor recruitment to multicentre trials.

Data sources: Part A: database of trials started in or after 1994 and were due to end before 2003 held by the Medical Research Council and Health Technology Assessment Programmes. Part B: interviews with people playing a wide range of roles within four trials that their funders identified as 'exemplars'. Part C: a large multicentre trial (the CRASH trial) of treatment for head injury.

Review methods: The study used a number of different perspectives ('multiple lenses'), and three components. Part A: an epidemiological review of a cohort of trials. Part B: case studies of trials that appeared to have particularly interesting lessons for recruitment. Part C: a single, in-depth case study to examine the feasibility of applying a business-orientated analytical framework as a reference model in future trials.

Results: In the 114 trials found in Part A, less than one-third recruited their original target within the time originally specified, and around one-third had extensions. Factors observed more often in trials that recruited successfully were: having a dedicated trial manager, being a cancer or drug trial, and having interventions only available inside the trial. The most commonly reported strategies to improve recruitment were newsletters and mailshots, but it was not possible to assess whether they were causally linked to changes in recruitment. The analyses in Part B suggested that successful trials were those addressing clinically important questions at a timely point. The investigators were held in high esteem by the interviewees, and the trials were firmly grounded in existing clinical practices, so that the trial processes were not alien to clinical collaborators, and the results could be easily applicable to future practice. The interviewees considered that the needs of patients were well served by participation in the trials. Clinical collaborators particularly appreciated clear delineation of roles, which released them from much of the workload associated with trial participation. There was a strong feeling from interviewees that they were proud to be part of a successful team. This pride fed into further success. Good groundwork and excellent communications across many levels of complex trial structures were considered to be extremely important, including training components for learning about trial interventions and processes, and team building. All four trials had faced recruitment problems, and extra insights into the working of trials were afforded by strategies invoked to address them. The process of the case study in Part C was able to draw attention to a body of research and practice in a different discipline (academic business studies). It generated a reference model derived from a combination of business theory and work within CRASH. This enabled identification of weaker managerial components within CRASH, and initiatives to strengthen them. Although it is not clear, even within CRASH, whether the initiatives that follow from developing and applying the model will be effective in increasing recruitment or other aspects of the success of the trial, the reference model could provide a template, with potential for those managing other trials to use or adapt it, especially at foundation stages. The model derived from this project could also be used as a diagnostic tool if trials have difficulties and hence as a basis for deciding what type of remedial action to take. It may also be useful for auditing the progress of trials, such as during external review.

Conclusions: While not producing sufficiently definitive results to make strong recommendations, the work here suggests that future trials should consider the different needs at different phases in the life of trials, and place greater emphasis on 'conduct' (the process of actually doing trials). This implies learning lessons from successful trialists and trial managers, with better training for issues relating to trial conduct. The complexity of large trials means that unanticipated difficulties are highly likely at some time in every trial. Part B suggested that successful trials were those flexible and robust enough to adapt to unexpected issues. Arguably, the trialists should also expect agility from funders within a proactive approach to monitoring ongoing trials. Further research into different recruitment patterns (including 'failures') may help to clarify whether the patterns seen in the 'exemplar' trials differ or are similar. The reference model from Part C needs to be further considered in other similar and different trials to assess its robustness. These and other strategies aimed at increasing recruitment and making trials more successful need to be formally evaluated for their effectiveness in a range of trials.

Original languageEnglish
Pages (from-to)1-126
Number of pages126
JournalHealth Technology Assessment
Volume11
Issue number48
DOIs
Publication statusPublished - Nov 2007

Keywords

  • MRC/BHF heart protection
  • placebo-controlled trial
  • cancer clinical-trials
  • high-risk individuals
  • general-practice
  • breast-cancer
  • attitudes
  • design
  • oncologists
  • conduct

Cite this

Recruitment to randomised trials : Strategies for trial enrolment and participation study. The STEPS study. / Campbell, M. K.; Snowdon, Claire; Francis, David; Elbourne, Diana R.; McDonald, Alison Mary; Knight, Rosemary C.; Entwistle, Vikki Ann; Garcia, Jo; Roberts, Ian; Grant, A.; STEPS Group.

In: Health Technology Assessment, Vol. 11, No. 48, 11.2007, p. 1-126.

Research output: Contribution to journalLiterature review

Campbell, MK, Snowdon, C, Francis, D, Elbourne, DR, McDonald, AM, Knight, RC, Entwistle, VA, Garcia, J, Roberts, I, Grant, A & STEPS Group 2007, 'Recruitment to randomised trials: Strategies for trial enrolment and participation study. The STEPS study', Health Technology Assessment, vol. 11, no. 48, pp. 1-126. https://doi.org/10.3310/hta11480
Campbell, M. K. ; Snowdon, Claire ; Francis, David ; Elbourne, Diana R. ; McDonald, Alison Mary ; Knight, Rosemary C. ; Entwistle, Vikki Ann ; Garcia, Jo ; Roberts, Ian ; Grant, A. ; STEPS Group. / Recruitment to randomised trials : Strategies for trial enrolment and participation study. The STEPS study. In: Health Technology Assessment. 2007 ; Vol. 11, No. 48. pp. 1-126.
@article{1393137c5be249cb952a45266b048872,
title = "Recruitment to randomised trials: Strategies for trial enrolment and participation study. The STEPS study",
abstract = "Objectives: To identify factors associated with good and poor recruitment to multicentre trials. Data sources: Part A: database of trials started in or after 1994 and were due to end before 2003 held by the Medical Research Council and Health Technology Assessment Programmes. Part B: interviews with people playing a wide range of roles within four trials that their funders identified as 'exemplars'. Part C: a large multicentre trial (the CRASH trial) of treatment for head injury. Review methods: The study used a number of different perspectives ('multiple lenses'), and three components. Part A: an epidemiological review of a cohort of trials. Part B: case studies of trials that appeared to have particularly interesting lessons for recruitment. Part C: a single, in-depth case study to examine the feasibility of applying a business-orientated analytical framework as a reference model in future trials. Results: In the 114 trials found in Part A, less than one-third recruited their original target within the time originally specified, and around one-third had extensions. Factors observed more often in trials that recruited successfully were: having a dedicated trial manager, being a cancer or drug trial, and having interventions only available inside the trial. The most commonly reported strategies to improve recruitment were newsletters and mailshots, but it was not possible to assess whether they were causally linked to changes in recruitment. The analyses in Part B suggested that successful trials were those addressing clinically important questions at a timely point. The investigators were held in high esteem by the interviewees, and the trials were firmly grounded in existing clinical practices, so that the trial processes were not alien to clinical collaborators, and the results could be easily applicable to future practice. The interviewees considered that the needs of patients were well served by participation in the trials. Clinical collaborators particularly appreciated clear delineation of roles, which released them from much of the workload associated with trial participation. There was a strong feeling from interviewees that they were proud to be part of a successful team. This pride fed into further success. Good groundwork and excellent communications across many levels of complex trial structures were considered to be extremely important, including training components for learning about trial interventions and processes, and team building. All four trials had faced recruitment problems, and extra insights into the working of trials were afforded by strategies invoked to address them. The process of the case study in Part C was able to draw attention to a body of research and practice in a different discipline (academic business studies). It generated a reference model derived from a combination of business theory and work within CRASH. This enabled identification of weaker managerial components within CRASH, and initiatives to strengthen them. Although it is not clear, even within CRASH, whether the initiatives that follow from developing and applying the model will be effective in increasing recruitment or other aspects of the success of the trial, the reference model could provide a template, with potential for those managing other trials to use or adapt it, especially at foundation stages. The model derived from this project could also be used as a diagnostic tool if trials have difficulties and hence as a basis for deciding what type of remedial action to take. It may also be useful for auditing the progress of trials, such as during external review. Conclusions: While not producing sufficiently definitive results to make strong recommendations, the work here suggests that future trials should consider the different needs at different phases in the life of trials, and place greater emphasis on 'conduct' (the process of actually doing trials). This implies learning lessons from successful trialists and trial managers, with better training for issues relating to trial conduct. The complexity of large trials means that unanticipated difficulties are highly likely at some time in every trial. Part B suggested that successful trials were those flexible and robust enough to adapt to unexpected issues. Arguably, the trialists should also expect agility from funders within a proactive approach to monitoring ongoing trials. Further research into different recruitment patterns (including 'failures') may help to clarify whether the patterns seen in the 'exemplar' trials differ or are similar. The reference model from Part C needs to be further considered in other similar and different trials to assess its robustness. These and other strategies aimed at increasing recruitment and making trials more successful need to be formally evaluated for their effectiveness in a range of trials.",
keywords = "MRC/BHF heart protection, placebo-controlled trial, cancer clinical-trials, high-risk individuals, general-practice, breast-cancer, attitudes, design, oncologists, conduct",
author = "Campbell, {M. K.} and Claire Snowdon and David Francis and Elbourne, {Diana R.} and McDonald, {Alison Mary} and Knight, {Rosemary C.} and Entwistle, {Vikki Ann} and Jo Garcia and Ian Roberts and A. Grant and {STEPS Group}",
year = "2007",
month = "11",
doi = "10.3310/hta11480",
language = "English",
volume = "11",
pages = "1--126",
journal = "Health Technology Assessment",
issn = "1366-5278",
publisher = "National Co-ordinating Centre for HTA",
number = "48",

}

TY - JOUR

T1 - Recruitment to randomised trials

T2 - Strategies for trial enrolment and participation study. The STEPS study

AU - Campbell, M. K.

AU - Snowdon, Claire

AU - Francis, David

AU - Elbourne, Diana R.

AU - McDonald, Alison Mary

AU - Knight, Rosemary C.

AU - Entwistle, Vikki Ann

AU - Garcia, Jo

AU - Roberts, Ian

AU - Grant, A.

AU - STEPS Group

PY - 2007/11

Y1 - 2007/11

N2 - Objectives: To identify factors associated with good and poor recruitment to multicentre trials. Data sources: Part A: database of trials started in or after 1994 and were due to end before 2003 held by the Medical Research Council and Health Technology Assessment Programmes. Part B: interviews with people playing a wide range of roles within four trials that their funders identified as 'exemplars'. Part C: a large multicentre trial (the CRASH trial) of treatment for head injury. Review methods: The study used a number of different perspectives ('multiple lenses'), and three components. Part A: an epidemiological review of a cohort of trials. Part B: case studies of trials that appeared to have particularly interesting lessons for recruitment. Part C: a single, in-depth case study to examine the feasibility of applying a business-orientated analytical framework as a reference model in future trials. Results: In the 114 trials found in Part A, less than one-third recruited their original target within the time originally specified, and around one-third had extensions. Factors observed more often in trials that recruited successfully were: having a dedicated trial manager, being a cancer or drug trial, and having interventions only available inside the trial. The most commonly reported strategies to improve recruitment were newsletters and mailshots, but it was not possible to assess whether they were causally linked to changes in recruitment. The analyses in Part B suggested that successful trials were those addressing clinically important questions at a timely point. The investigators were held in high esteem by the interviewees, and the trials were firmly grounded in existing clinical practices, so that the trial processes were not alien to clinical collaborators, and the results could be easily applicable to future practice. The interviewees considered that the needs of patients were well served by participation in the trials. Clinical collaborators particularly appreciated clear delineation of roles, which released them from much of the workload associated with trial participation. There was a strong feeling from interviewees that they were proud to be part of a successful team. This pride fed into further success. Good groundwork and excellent communications across many levels of complex trial structures were considered to be extremely important, including training components for learning about trial interventions and processes, and team building. All four trials had faced recruitment problems, and extra insights into the working of trials were afforded by strategies invoked to address them. The process of the case study in Part C was able to draw attention to a body of research and practice in a different discipline (academic business studies). It generated a reference model derived from a combination of business theory and work within CRASH. This enabled identification of weaker managerial components within CRASH, and initiatives to strengthen them. Although it is not clear, even within CRASH, whether the initiatives that follow from developing and applying the model will be effective in increasing recruitment or other aspects of the success of the trial, the reference model could provide a template, with potential for those managing other trials to use or adapt it, especially at foundation stages. The model derived from this project could also be used as a diagnostic tool if trials have difficulties and hence as a basis for deciding what type of remedial action to take. It may also be useful for auditing the progress of trials, such as during external review. Conclusions: While not producing sufficiently definitive results to make strong recommendations, the work here suggests that future trials should consider the different needs at different phases in the life of trials, and place greater emphasis on 'conduct' (the process of actually doing trials). This implies learning lessons from successful trialists and trial managers, with better training for issues relating to trial conduct. The complexity of large trials means that unanticipated difficulties are highly likely at some time in every trial. Part B suggested that successful trials were those flexible and robust enough to adapt to unexpected issues. Arguably, the trialists should also expect agility from funders within a proactive approach to monitoring ongoing trials. Further research into different recruitment patterns (including 'failures') may help to clarify whether the patterns seen in the 'exemplar' trials differ or are similar. The reference model from Part C needs to be further considered in other similar and different trials to assess its robustness. These and other strategies aimed at increasing recruitment and making trials more successful need to be formally evaluated for their effectiveness in a range of trials.

AB - Objectives: To identify factors associated with good and poor recruitment to multicentre trials. Data sources: Part A: database of trials started in or after 1994 and were due to end before 2003 held by the Medical Research Council and Health Technology Assessment Programmes. Part B: interviews with people playing a wide range of roles within four trials that their funders identified as 'exemplars'. Part C: a large multicentre trial (the CRASH trial) of treatment for head injury. Review methods: The study used a number of different perspectives ('multiple lenses'), and three components. Part A: an epidemiological review of a cohort of trials. Part B: case studies of trials that appeared to have particularly interesting lessons for recruitment. Part C: a single, in-depth case study to examine the feasibility of applying a business-orientated analytical framework as a reference model in future trials. Results: In the 114 trials found in Part A, less than one-third recruited their original target within the time originally specified, and around one-third had extensions. Factors observed more often in trials that recruited successfully were: having a dedicated trial manager, being a cancer or drug trial, and having interventions only available inside the trial. The most commonly reported strategies to improve recruitment were newsletters and mailshots, but it was not possible to assess whether they were causally linked to changes in recruitment. The analyses in Part B suggested that successful trials were those addressing clinically important questions at a timely point. The investigators were held in high esteem by the interviewees, and the trials were firmly grounded in existing clinical practices, so that the trial processes were not alien to clinical collaborators, and the results could be easily applicable to future practice. The interviewees considered that the needs of patients were well served by participation in the trials. Clinical collaborators particularly appreciated clear delineation of roles, which released them from much of the workload associated with trial participation. There was a strong feeling from interviewees that they were proud to be part of a successful team. This pride fed into further success. Good groundwork and excellent communications across many levels of complex trial structures were considered to be extremely important, including training components for learning about trial interventions and processes, and team building. All four trials had faced recruitment problems, and extra insights into the working of trials were afforded by strategies invoked to address them. The process of the case study in Part C was able to draw attention to a body of research and practice in a different discipline (academic business studies). It generated a reference model derived from a combination of business theory and work within CRASH. This enabled identification of weaker managerial components within CRASH, and initiatives to strengthen them. Although it is not clear, even within CRASH, whether the initiatives that follow from developing and applying the model will be effective in increasing recruitment or other aspects of the success of the trial, the reference model could provide a template, with potential for those managing other trials to use or adapt it, especially at foundation stages. The model derived from this project could also be used as a diagnostic tool if trials have difficulties and hence as a basis for deciding what type of remedial action to take. It may also be useful for auditing the progress of trials, such as during external review. Conclusions: While not producing sufficiently definitive results to make strong recommendations, the work here suggests that future trials should consider the different needs at different phases in the life of trials, and place greater emphasis on 'conduct' (the process of actually doing trials). This implies learning lessons from successful trialists and trial managers, with better training for issues relating to trial conduct. The complexity of large trials means that unanticipated difficulties are highly likely at some time in every trial. Part B suggested that successful trials were those flexible and robust enough to adapt to unexpected issues. Arguably, the trialists should also expect agility from funders within a proactive approach to monitoring ongoing trials. Further research into different recruitment patterns (including 'failures') may help to clarify whether the patterns seen in the 'exemplar' trials differ or are similar. The reference model from Part C needs to be further considered in other similar and different trials to assess its robustness. These and other strategies aimed at increasing recruitment and making trials more successful need to be formally evaluated for their effectiveness in a range of trials.

KW - MRC/BHF heart protection

KW - placebo-controlled trial

KW - cancer clinical-trials

KW - high-risk individuals

KW - general-practice

KW - breast-cancer

KW - attitudes

KW - design

KW - oncologists

KW - conduct

U2 - 10.3310/hta11480

DO - 10.3310/hta11480

M3 - Literature review

VL - 11

SP - 1

EP - 126

JO - Health Technology Assessment

JF - Health Technology Assessment

SN - 1366-5278

IS - 48

ER -