Studying complex interventions: reflections from the FEMHealth project on evaluating fee exemption policies in West Africa and Morocco

Bruno Marchal, Sara Van Belle, Vincent De Brouwere, Sophie Witter

Research output: Contribution to journalArticle

20 Citations (Scopus)
4 Downloads (Pure)

Abstract

Background: The importance of complexity in health care policy-making and interventions, as well as research
and evaluation is now widely acknowledged, but conceptual confusion reigns and few applications of complexity
concepts in research design have been published. Taking user fee exemption policies as an entry point, we explore
the methodological consequences of ‘complexity’ for health policy research and evaluation. We first discuss the difference
between simple, complicated and complex and introduce key concepts of complex adaptive systems theory. We then
apply these to fee exemption policies.
Design: We describe how the FEMHealth research project attempts to address the challenges of complexity in its
evaluation of fee exemption policies for maternal care. We present how the development of a programme theory for fee
exemption policies was used to structure the overall design. This allowed for structured discussions on the hypotheses
held by the researchers and helped to structure, integrate and monitor the sub-studies. We then show how the choice
of data collection methods and tools for each sub-study was informed by the overall design.
Discussion: Applying key concepts from complexity theory proved useful in broadening our view on fee exemption
policies and in developing the overall research design. However, we encountered a number of challenges, including
maintaining adaptiveness of the design during the evaluation, and ensuring cohesion in the disciplinary diversity of the
research teams. Whether the programme theory can fulfil its claimed potential to help making sense of the findings is
yet to be tested. Experience from other studies allows for some moderate optimism. However, the biggest challenge
complexity throws at health system researchers may be to deal with the unknown unknowns and the consequence that
complex issues can only be understood in retrospect. From a complexity theory point of view, only plausible
explanations can be developed, not predictive theories. Yet here, theory-driven approaches may help.
Original languageEnglish
Article number469
JournalBMC Health Services Research
Volume13
DOIs
Publication statusPublished - 2013

Fingerprint

Morocco
Western Africa
Fees and Charges
Health Policy
Research Design
Research Personnel
Systems Theory
Program Development
Policy Making
Mothers
Delivery of Health Care
Health
Research

Keywords

  • fee exemption policy
  • policy implementation
  • complex intervention
  • research design
  • complex adaptive systems
  • theory-driven evaluation

Cite this

Studying complex interventions : reflections from the FEMHealth project on evaluating fee exemption policies in West Africa and Morocco. / Marchal, Bruno; Van Belle, Sara; De Brouwere, Vincent; Witter, Sophie.

In: BMC Health Services Research, Vol. 13, 469, 2013.

Research output: Contribution to journalArticle

@article{ce082d2924484f2d9b43c98cfc01c9c2,
title = "Studying complex interventions: reflections from the FEMHealth project on evaluating fee exemption policies in West Africa and Morocco",
abstract = "Background: The importance of complexity in health care policy-making and interventions, as well as researchand evaluation is now widely acknowledged, but conceptual confusion reigns and few applications of complexityconcepts in research design have been published. Taking user fee exemption policies as an entry point, we explorethe methodological consequences of ‘complexity’ for health policy research and evaluation. We first discuss the differencebetween simple, complicated and complex and introduce key concepts of complex adaptive systems theory. We thenapply these to fee exemption policies.Design: We describe how the FEMHealth research project attempts to address the challenges of complexity in itsevaluation of fee exemption policies for maternal care. We present how the development of a programme theory for feeexemption policies was used to structure the overall design. This allowed for structured discussions on the hypothesesheld by the researchers and helped to structure, integrate and monitor the sub-studies. We then show how the choiceof data collection methods and tools for each sub-study was informed by the overall design.Discussion: Applying key concepts from complexity theory proved useful in broadening our view on fee exemptionpolicies and in developing the overall research design. However, we encountered a number of challenges, includingmaintaining adaptiveness of the design during the evaluation, and ensuring cohesion in the disciplinary diversity of theresearch teams. Whether the programme theory can fulfil its claimed potential to help making sense of the findings isyet to be tested. Experience from other studies allows for some moderate optimism. However, the biggest challengecomplexity throws at health system researchers may be to deal with the unknown unknowns and the consequence thatcomplex issues can only be understood in retrospect. From a complexity theory point of view, only plausibleexplanations can be developed, not predictive theories. Yet here, theory-driven approaches may help.",
keywords = "fee exemption policy, policy implementation, complex intervention, research design, complex adaptive systems, theory-driven evaluation",
author = "Bruno Marchal and {Van Belle}, Sara and {De Brouwere}, Vincent and Sophie Witter",
year = "2013",
doi = "10.1186/1472-6963-13-469",
language = "English",
volume = "13",
journal = "BMC Health Services Research",
issn = "1472-6963",
publisher = "BioMed Central",

}

TY - JOUR

T1 - Studying complex interventions

T2 - reflections from the FEMHealth project on evaluating fee exemption policies in West Africa and Morocco

AU - Marchal, Bruno

AU - Van Belle, Sara

AU - De Brouwere, Vincent

AU - Witter, Sophie

PY - 2013

Y1 - 2013

N2 - Background: The importance of complexity in health care policy-making and interventions, as well as researchand evaluation is now widely acknowledged, but conceptual confusion reigns and few applications of complexityconcepts in research design have been published. Taking user fee exemption policies as an entry point, we explorethe methodological consequences of ‘complexity’ for health policy research and evaluation. We first discuss the differencebetween simple, complicated and complex and introduce key concepts of complex adaptive systems theory. We thenapply these to fee exemption policies.Design: We describe how the FEMHealth research project attempts to address the challenges of complexity in itsevaluation of fee exemption policies for maternal care. We present how the development of a programme theory for feeexemption policies was used to structure the overall design. This allowed for structured discussions on the hypothesesheld by the researchers and helped to structure, integrate and monitor the sub-studies. We then show how the choiceof data collection methods and tools for each sub-study was informed by the overall design.Discussion: Applying key concepts from complexity theory proved useful in broadening our view on fee exemptionpolicies and in developing the overall research design. However, we encountered a number of challenges, includingmaintaining adaptiveness of the design during the evaluation, and ensuring cohesion in the disciplinary diversity of theresearch teams. Whether the programme theory can fulfil its claimed potential to help making sense of the findings isyet to be tested. Experience from other studies allows for some moderate optimism. However, the biggest challengecomplexity throws at health system researchers may be to deal with the unknown unknowns and the consequence thatcomplex issues can only be understood in retrospect. From a complexity theory point of view, only plausibleexplanations can be developed, not predictive theories. Yet here, theory-driven approaches may help.

AB - Background: The importance of complexity in health care policy-making and interventions, as well as researchand evaluation is now widely acknowledged, but conceptual confusion reigns and few applications of complexityconcepts in research design have been published. Taking user fee exemption policies as an entry point, we explorethe methodological consequences of ‘complexity’ for health policy research and evaluation. We first discuss the differencebetween simple, complicated and complex and introduce key concepts of complex adaptive systems theory. We thenapply these to fee exemption policies.Design: We describe how the FEMHealth research project attempts to address the challenges of complexity in itsevaluation of fee exemption policies for maternal care. We present how the development of a programme theory for feeexemption policies was used to structure the overall design. This allowed for structured discussions on the hypothesesheld by the researchers and helped to structure, integrate and monitor the sub-studies. We then show how the choiceof data collection methods and tools for each sub-study was informed by the overall design.Discussion: Applying key concepts from complexity theory proved useful in broadening our view on fee exemptionpolicies and in developing the overall research design. However, we encountered a number of challenges, includingmaintaining adaptiveness of the design during the evaluation, and ensuring cohesion in the disciplinary diversity of theresearch teams. Whether the programme theory can fulfil its claimed potential to help making sense of the findings isyet to be tested. Experience from other studies allows for some moderate optimism. However, the biggest challengecomplexity throws at health system researchers may be to deal with the unknown unknowns and the consequence thatcomplex issues can only be understood in retrospect. From a complexity theory point of view, only plausibleexplanations can be developed, not predictive theories. Yet here, theory-driven approaches may help.

KW - fee exemption policy

KW - policy implementation

KW - complex intervention

KW - research design

KW - complex adaptive systems

KW - theory-driven evaluation

U2 - 10.1186/1472-6963-13-469

DO - 10.1186/1472-6963-13-469

M3 - Article

VL - 13

JO - BMC Health Services Research

JF - BMC Health Services Research

SN - 1472-6963

M1 - 469

ER -