Guiding the design and selection of interventions to influence the implementation of evidence-based practice: an experimental simulation of a complex intervention trial

Debbie Lee Bonetti, M. Eccles, Marie Johnston, N. Steen, R. Baker, Anne Elizabeth Walker, N. Pitts

Research output: Contribution to journalArticle

73 Citations (Scopus)

Abstract

A consistent finding in health services research is the report of uneven uptake of research findings. Implementation trials have a variable record of success in effectively influencing clinicians' behaviour. A more systematic approach may be to conduct Intervention Modelling Experiments before service-level trials, examining intervention effects on 'interim endpoints' representing clinical behaviour, derived from empirically supported psychological theories. The objectives were to: (1) Design Intervention Modelling Experiments by backward engineering a 'real-world' randomised controlled trial (NEXUS); (2) examine the applicability of psychological theories to clinical decision-making; (3) explore whether psychological theories can illuminate how interventions achieve their effects.

A 2 x 2 factorial randomised controlled trial was designed with pre- and post-intervention data collection by postal questionnaire surveys. The first survey was used to generate feedback data and the interventions were delivered in the second survey. General medical practitioners (GPs) in England and Scotland participated. First survey respondents were randomised twice to receive or not audit and feedback and educational reminder messages.

The main outcome measures included behavioural intention (general plan to refer for lumbar X-rays) and simulated behaviour (specific, scenario-based, decisions to refer for lumbar X-ray). Predictors were attitude, subjective norm, perceived behavioural control (theory of planned behaviour), self-efficacy (social cognitive theory) and decision difficulty.

Both interventions significantly influenced simulated behaviour, but neither influenced behavioural intention. There were no interaction effects. All theoretically derived cognitions significantly predicted simulated behaviour. Only subjective norm was not predictive of behavioural intention. The effect of audit and feedback on simulated behaviour was mediated through perceived behavioural control.

The results of this study suggest that Intervention Modelling Experiments, using psychological models to help isolate mediators of clinical decision-making, may be a means of developing more potent interventions, and selecting implementation interventions with a greater likelihood of success in a service-level randomised controlled trial. (c) 2004 Elsevier Ltd. All rights reserved.

Original languageEnglish
Pages (from-to)2135-2147
Number of pages12
JournalSocial Science & Medicine
Volume60
Issue number9
DOIs
Publication statusPublished - May 2005

Keywords

  • implementation modelling experiments
  • randomised controlled trials
  • the theory of planned behaviour
  • social cognitive theory
  • evidence-based practice
  • social cognition models
  • planned behavior
  • metaanalysis
  • intentions
  • impact
  • care
  • gap

Cite this

Guiding the design and selection of interventions to influence the implementation of evidence-based practice : an experimental simulation of a complex intervention trial. / Bonetti, Debbie Lee; Eccles, M.; Johnston, Marie; Steen, N.; Baker, R.; Walker, Anne Elizabeth; Pitts, N.

In: Social Science & Medicine, Vol. 60, No. 9, 05.2005, p. 2135-2147.

Research output: Contribution to journalArticle

@article{a93480fb166c43caa9ae07df94e358ed,
title = "Guiding the design and selection of interventions to influence the implementation of evidence-based practice: an experimental simulation of a complex intervention trial",
abstract = "A consistent finding in health services research is the report of uneven uptake of research findings. Implementation trials have a variable record of success in effectively influencing clinicians' behaviour. A more systematic approach may be to conduct Intervention Modelling Experiments before service-level trials, examining intervention effects on 'interim endpoints' representing clinical behaviour, derived from empirically supported psychological theories. The objectives were to: (1) Design Intervention Modelling Experiments by backward engineering a 'real-world' randomised controlled trial (NEXUS); (2) examine the applicability of psychological theories to clinical decision-making; (3) explore whether psychological theories can illuminate how interventions achieve their effects.A 2 x 2 factorial randomised controlled trial was designed with pre- and post-intervention data collection by postal questionnaire surveys. The first survey was used to generate feedback data and the interventions were delivered in the second survey. General medical practitioners (GPs) in England and Scotland participated. First survey respondents were randomised twice to receive or not audit and feedback and educational reminder messages.The main outcome measures included behavioural intention (general plan to refer for lumbar X-rays) and simulated behaviour (specific, scenario-based, decisions to refer for lumbar X-ray). Predictors were attitude, subjective norm, perceived behavioural control (theory of planned behaviour), self-efficacy (social cognitive theory) and decision difficulty.Both interventions significantly influenced simulated behaviour, but neither influenced behavioural intention. There were no interaction effects. All theoretically derived cognitions significantly predicted simulated behaviour. Only subjective norm was not predictive of behavioural intention. The effect of audit and feedback on simulated behaviour was mediated through perceived behavioural control.The results of this study suggest that Intervention Modelling Experiments, using psychological models to help isolate mediators of clinical decision-making, may be a means of developing more potent interventions, and selecting implementation interventions with a greater likelihood of success in a service-level randomised controlled trial. (c) 2004 Elsevier Ltd. All rights reserved.",
keywords = "implementation modelling experiments, randomised controlled trials, the theory of planned behaviour, social cognitive theory, evidence-based practice, social cognition models, planned behavior, metaanalysis, intentions, impact, care , gap",
author = "Bonetti, {Debbie Lee} and M. Eccles and Marie Johnston and N. Steen and R. Baker and Walker, {Anne Elizabeth} and N. Pitts",
year = "2005",
month = "5",
doi = "10.1016/j.socscimed.2004.08.072",
language = "English",
volume = "60",
pages = "2135--2147",
journal = "Social Science & Medicine",
issn = "0277-9536",
publisher = "Elsevier Limited",
number = "9",

}

TY - JOUR

T1 - Guiding the design and selection of interventions to influence the implementation of evidence-based practice

T2 - an experimental simulation of a complex intervention trial

AU - Bonetti, Debbie Lee

AU - Eccles, M.

AU - Johnston, Marie

AU - Steen, N.

AU - Baker, R.

AU - Walker, Anne Elizabeth

AU - Pitts, N.

PY - 2005/5

Y1 - 2005/5

N2 - A consistent finding in health services research is the report of uneven uptake of research findings. Implementation trials have a variable record of success in effectively influencing clinicians' behaviour. A more systematic approach may be to conduct Intervention Modelling Experiments before service-level trials, examining intervention effects on 'interim endpoints' representing clinical behaviour, derived from empirically supported psychological theories. The objectives were to: (1) Design Intervention Modelling Experiments by backward engineering a 'real-world' randomised controlled trial (NEXUS); (2) examine the applicability of psychological theories to clinical decision-making; (3) explore whether psychological theories can illuminate how interventions achieve their effects.A 2 x 2 factorial randomised controlled trial was designed with pre- and post-intervention data collection by postal questionnaire surveys. The first survey was used to generate feedback data and the interventions were delivered in the second survey. General medical practitioners (GPs) in England and Scotland participated. First survey respondents were randomised twice to receive or not audit and feedback and educational reminder messages.The main outcome measures included behavioural intention (general plan to refer for lumbar X-rays) and simulated behaviour (specific, scenario-based, decisions to refer for lumbar X-ray). Predictors were attitude, subjective norm, perceived behavioural control (theory of planned behaviour), self-efficacy (social cognitive theory) and decision difficulty.Both interventions significantly influenced simulated behaviour, but neither influenced behavioural intention. There were no interaction effects. All theoretically derived cognitions significantly predicted simulated behaviour. Only subjective norm was not predictive of behavioural intention. The effect of audit and feedback on simulated behaviour was mediated through perceived behavioural control.The results of this study suggest that Intervention Modelling Experiments, using psychological models to help isolate mediators of clinical decision-making, may be a means of developing more potent interventions, and selecting implementation interventions with a greater likelihood of success in a service-level randomised controlled trial. (c) 2004 Elsevier Ltd. All rights reserved.

AB - A consistent finding in health services research is the report of uneven uptake of research findings. Implementation trials have a variable record of success in effectively influencing clinicians' behaviour. A more systematic approach may be to conduct Intervention Modelling Experiments before service-level trials, examining intervention effects on 'interim endpoints' representing clinical behaviour, derived from empirically supported psychological theories. The objectives were to: (1) Design Intervention Modelling Experiments by backward engineering a 'real-world' randomised controlled trial (NEXUS); (2) examine the applicability of psychological theories to clinical decision-making; (3) explore whether psychological theories can illuminate how interventions achieve their effects.A 2 x 2 factorial randomised controlled trial was designed with pre- and post-intervention data collection by postal questionnaire surveys. The first survey was used to generate feedback data and the interventions were delivered in the second survey. General medical practitioners (GPs) in England and Scotland participated. First survey respondents were randomised twice to receive or not audit and feedback and educational reminder messages.The main outcome measures included behavioural intention (general plan to refer for lumbar X-rays) and simulated behaviour (specific, scenario-based, decisions to refer for lumbar X-ray). Predictors were attitude, subjective norm, perceived behavioural control (theory of planned behaviour), self-efficacy (social cognitive theory) and decision difficulty.Both interventions significantly influenced simulated behaviour, but neither influenced behavioural intention. There were no interaction effects. All theoretically derived cognitions significantly predicted simulated behaviour. Only subjective norm was not predictive of behavioural intention. The effect of audit and feedback on simulated behaviour was mediated through perceived behavioural control.The results of this study suggest that Intervention Modelling Experiments, using psychological models to help isolate mediators of clinical decision-making, may be a means of developing more potent interventions, and selecting implementation interventions with a greater likelihood of success in a service-level randomised controlled trial. (c) 2004 Elsevier Ltd. All rights reserved.

KW - implementation modelling experiments

KW - randomised controlled trials

KW - the theory of planned behaviour

KW - social cognitive theory

KW - evidence-based practice

KW - social cognition models

KW - planned behavior

KW - metaanalysis

KW - intentions

KW - impact

KW - care

KW - gap

U2 - 10.1016/j.socscimed.2004.08.072

DO - 10.1016/j.socscimed.2004.08.072

M3 - Article

VL - 60

SP - 2135

EP - 2147

JO - Social Science & Medicine

JF - Social Science & Medicine

SN - 0277-9536

IS - 9

ER -