Evaluating complex interventions and health technologies using normalization process theory

development of a simplified approach and web-enabled toolkit

Carl R May, Tracy Finch, Luciana Ballini, Anne MacFarlane, Frances Mair, Elizabeth Murray, Shaun Treweek, Tim Rapley*

*Corresponding author for this work

Research output: Contribution to journalArticle

74 Citations (Scopus)
4 Downloads (Pure)

Abstract

Background: Normalization Process Theory (NPT) can be used to explain implementation processes in health care relating to new technologies and complex interventions. This paper describes the processes by which we developed a simplified version of NPT for use by clinicians, managers, and policy makers, and which could be embedded in a web-enabled toolkit and on-line users manual.

Methods: Between 2006 and 2010 we undertook four tasks. (i) We presented NPT to potential and actual users in multiple workshops, seminars, and presentations. (ii) Using what we discovered from these meetings, we decided to create a simplified set of statements and explanations expressing core constructs of the theory (iii) We circulated these statements to a criterion sample of 60 researchers, clinicians and others, using SurveyMonkey to collect qualitative textual data about their criticisms of the statements. (iv) We then reconstructed the statements and explanations to meet users' criticisms, embedded them in a web-enabled toolkit, and beta tested this 'in the wild'.

Results: On-line data collection was effective: over a four week period 50/60 participants responded using SurveyMonkey (40/60) or direct phone and email contact (10/60). An additional nine responses were received from people who had been sent the SurveyMonkey form by other respondents. Beta testing of the web enabled toolkit produced 13 responses, from 327 visits to http://www.normalizationprocess.org. Qualitative analysis of both sets of responses showed a high level of support for the statements but also showed that some statements poorly expressed their underlying constructs or overlapped with others. These were rewritten to take account of users' criticisms and then embedded in a web-enabled toolkit. As a result we were able translate the core constructs into a simplified set of statements that could be utilized by non-experts.

Conclusion: Normalization Process Theory has been developed through transparent procedures at each stage of its life. The theory has been shown to be sufficiently robust to merit formal testing. This project has provided a user friendly version of NPT that can be embedded in a web-enabled toolkit and used as a heuristic device to think through implementation and integration problems.

Original languageEnglish
Article number245
Number of pages11
JournalBMC Health Services Research
Volume11
DOIs
Publication statusPublished - 30 Sep 2011

Keywords

  • process model
  • trial
  • adoption
  • implementation
  • care
  • improve health

Cite this

Evaluating complex interventions and health technologies using normalization process theory : development of a simplified approach and web-enabled toolkit. / May, Carl R; Finch, Tracy; Ballini, Luciana; MacFarlane, Anne; Mair, Frances; Murray, Elizabeth; Treweek, Shaun; Rapley, Tim.

In: BMC Health Services Research, Vol. 11, 245, 30.09.2011.

Research output: Contribution to journalArticle

May, Carl R ; Finch, Tracy ; Ballini, Luciana ; MacFarlane, Anne ; Mair, Frances ; Murray, Elizabeth ; Treweek, Shaun ; Rapley, Tim. / Evaluating complex interventions and health technologies using normalization process theory : development of a simplified approach and web-enabled toolkit. In: BMC Health Services Research. 2011 ; Vol. 11.
@article{b46b6df4bfb5478c8538e3696c57e1d7,
title = "Evaluating complex interventions and health technologies using normalization process theory: development of a simplified approach and web-enabled toolkit",
abstract = "Background: Normalization Process Theory (NPT) can be used to explain implementation processes in health care relating to new technologies and complex interventions. This paper describes the processes by which we developed a simplified version of NPT for use by clinicians, managers, and policy makers, and which could be embedded in a web-enabled toolkit and on-line users manual.Methods: Between 2006 and 2010 we undertook four tasks. (i) We presented NPT to potential and actual users in multiple workshops, seminars, and presentations. (ii) Using what we discovered from these meetings, we decided to create a simplified set of statements and explanations expressing core constructs of the theory (iii) We circulated these statements to a criterion sample of 60 researchers, clinicians and others, using SurveyMonkey to collect qualitative textual data about their criticisms of the statements. (iv) We then reconstructed the statements and explanations to meet users' criticisms, embedded them in a web-enabled toolkit, and beta tested this 'in the wild'.Results: On-line data collection was effective: over a four week period 50/60 participants responded using SurveyMonkey (40/60) or direct phone and email contact (10/60). An additional nine responses were received from people who had been sent the SurveyMonkey form by other respondents. Beta testing of the web enabled toolkit produced 13 responses, from 327 visits to http://www.normalizationprocess.org. Qualitative analysis of both sets of responses showed a high level of support for the statements but also showed that some statements poorly expressed their underlying constructs or overlapped with others. These were rewritten to take account of users' criticisms and then embedded in a web-enabled toolkit. As a result we were able translate the core constructs into a simplified set of statements that could be utilized by non-experts.Conclusion: Normalization Process Theory has been developed through transparent procedures at each stage of its life. The theory has been shown to be sufficiently robust to merit formal testing. This project has provided a user friendly version of NPT that can be embedded in a web-enabled toolkit and used as a heuristic device to think through implementation and integration problems.",
keywords = "process model, trial, adoption, implementation, care, improve health",
author = "May, {Carl R} and Tracy Finch and Luciana Ballini and Anne MacFarlane and Frances Mair and Elizabeth Murray and Shaun Treweek and Tim Rapley",
year = "2011",
month = "9",
day = "30",
doi = "10.1186/1472-6963-11-245",
language = "English",
volume = "11",
journal = "BMC Health Services Research",
issn = "1472-6963",
publisher = "BioMed Central",

}

TY - JOUR

T1 - Evaluating complex interventions and health technologies using normalization process theory

T2 - development of a simplified approach and web-enabled toolkit

AU - May, Carl R

AU - Finch, Tracy

AU - Ballini, Luciana

AU - MacFarlane, Anne

AU - Mair, Frances

AU - Murray, Elizabeth

AU - Treweek, Shaun

AU - Rapley, Tim

PY - 2011/9/30

Y1 - 2011/9/30

N2 - Background: Normalization Process Theory (NPT) can be used to explain implementation processes in health care relating to new technologies and complex interventions. This paper describes the processes by which we developed a simplified version of NPT for use by clinicians, managers, and policy makers, and which could be embedded in a web-enabled toolkit and on-line users manual.Methods: Between 2006 and 2010 we undertook four tasks. (i) We presented NPT to potential and actual users in multiple workshops, seminars, and presentations. (ii) Using what we discovered from these meetings, we decided to create a simplified set of statements and explanations expressing core constructs of the theory (iii) We circulated these statements to a criterion sample of 60 researchers, clinicians and others, using SurveyMonkey to collect qualitative textual data about their criticisms of the statements. (iv) We then reconstructed the statements and explanations to meet users' criticisms, embedded them in a web-enabled toolkit, and beta tested this 'in the wild'.Results: On-line data collection was effective: over a four week period 50/60 participants responded using SurveyMonkey (40/60) or direct phone and email contact (10/60). An additional nine responses were received from people who had been sent the SurveyMonkey form by other respondents. Beta testing of the web enabled toolkit produced 13 responses, from 327 visits to http://www.normalizationprocess.org. Qualitative analysis of both sets of responses showed a high level of support for the statements but also showed that some statements poorly expressed their underlying constructs or overlapped with others. These were rewritten to take account of users' criticisms and then embedded in a web-enabled toolkit. As a result we were able translate the core constructs into a simplified set of statements that could be utilized by non-experts.Conclusion: Normalization Process Theory has been developed through transparent procedures at each stage of its life. The theory has been shown to be sufficiently robust to merit formal testing. This project has provided a user friendly version of NPT that can be embedded in a web-enabled toolkit and used as a heuristic device to think through implementation and integration problems.

AB - Background: Normalization Process Theory (NPT) can be used to explain implementation processes in health care relating to new technologies and complex interventions. This paper describes the processes by which we developed a simplified version of NPT for use by clinicians, managers, and policy makers, and which could be embedded in a web-enabled toolkit and on-line users manual.Methods: Between 2006 and 2010 we undertook four tasks. (i) We presented NPT to potential and actual users in multiple workshops, seminars, and presentations. (ii) Using what we discovered from these meetings, we decided to create a simplified set of statements and explanations expressing core constructs of the theory (iii) We circulated these statements to a criterion sample of 60 researchers, clinicians and others, using SurveyMonkey to collect qualitative textual data about their criticisms of the statements. (iv) We then reconstructed the statements and explanations to meet users' criticisms, embedded them in a web-enabled toolkit, and beta tested this 'in the wild'.Results: On-line data collection was effective: over a four week period 50/60 participants responded using SurveyMonkey (40/60) or direct phone and email contact (10/60). An additional nine responses were received from people who had been sent the SurveyMonkey form by other respondents. Beta testing of the web enabled toolkit produced 13 responses, from 327 visits to http://www.normalizationprocess.org. Qualitative analysis of both sets of responses showed a high level of support for the statements but also showed that some statements poorly expressed their underlying constructs or overlapped with others. These were rewritten to take account of users' criticisms and then embedded in a web-enabled toolkit. As a result we were able translate the core constructs into a simplified set of statements that could be utilized by non-experts.Conclusion: Normalization Process Theory has been developed through transparent procedures at each stage of its life. The theory has been shown to be sufficiently robust to merit formal testing. This project has provided a user friendly version of NPT that can be embedded in a web-enabled toolkit and used as a heuristic device to think through implementation and integration problems.

KW - process model

KW - trial

KW - adoption

KW - implementation

KW - care

KW - improve health

U2 - 10.1186/1472-6963-11-245

DO - 10.1186/1472-6963-11-245

M3 - Article

VL - 11

JO - BMC Health Services Research

JF - BMC Health Services Research

SN - 1472-6963

M1 - 245

ER -