The importance of conducting and reporting pilot studies: the example of the Scottish Births Survey

Edwin Roland Van Teijlingen, A. M. Rennie, Wendy Jane Graham, Vanora Hundley

Research output: Contribution to journalArticle

111 Citations (Scopus)

Abstract

Background. In many research papers, pilot studies are only reported as a means of justifying the methods. This justification might refer to the overall research design, or simply to the validity and reliability of the research tools. It is unusual for reports of pilot studies to include practical problems faced by the researcher(s). Pilot studies are relevant to best practice in research, but their potential for other researchers appears to be ignored.

Objective. The primary aim of this study was to identify the most appropriate method for conducting a national survey of maternity care.

Methods. Pilot studies were conducted in five hospitals to establish the best of four possible methods of approaching women, distributing questionnaires and encouraging the return of these questionnaires. Variations in the pilot studies included (a) whether or not the questionnaires were anonymous, (b) the staff involved in distributing the questionnaires and ici whether questionnaires were distributed via central or local processes. For this purpose, five maternity hospitals of different sizes in Scotland were included.

Results. Problems in contacting women as a result of changes in the Data Protection Act (1998) required us to rely heavily on service providers. However, this resulted ill a number of difficulties. These included poor distribution rates in areas where distribution relied upon service providers, unauthorized changes to the study protocol and limited or inaccurate information regarding the numbers of questionnaires distributed.

Conclusions. The pilot raised a number of fundamental issues related to the process of conducting a large-scale survey, including the method of distributing the questionnaire, gaining access to patients, and reliance on 'gatekeepers'. This paper highlights the lessons learned as well as the balancing act of using research methods in the most optimal way under the combined pressure of time, ethical considerations and the influences of stakeholders. Reporting the kinds of practical issues that occur during pilot studies might help others avoid similar pitfalls anti mistakes.

Original languageEnglish
Pages (from-to)289-295
Number of pages6
JournalJournal of Advanced Nursing
Volume34
Issue number3
DOIs
Publication statusPublished - 2001

Keywords

  • pilot studies
  • methodology
  • midwifery research
  • satisfaction studies
  • UK Data Protection Act (1998)
  • maternity care
  • WOMENS VIEWS
  • CARE
  • SATISFACTION

Cite this

The importance of conducting and reporting pilot studies: the example of the Scottish Births Survey. / Van Teijlingen, Edwin Roland; Rennie, A. M.; Graham, Wendy Jane; Hundley, Vanora.

In: Journal of Advanced Nursing, Vol. 34, No. 3, 2001, p. 289-295.

Research output: Contribution to journalArticle

Van Teijlingen, Edwin Roland ; Rennie, A. M. ; Graham, Wendy Jane ; Hundley, Vanora. / The importance of conducting and reporting pilot studies: the example of the Scottish Births Survey. In: Journal of Advanced Nursing. 2001 ; Vol. 34, No. 3. pp. 289-295.
@article{1610d9006fd646b7822718e114d45017,
title = "The importance of conducting and reporting pilot studies: the example of the Scottish Births Survey",
abstract = "Background. In many research papers, pilot studies are only reported as a means of justifying the methods. This justification might refer to the overall research design, or simply to the validity and reliability of the research tools. It is unusual for reports of pilot studies to include practical problems faced by the researcher(s). Pilot studies are relevant to best practice in research, but their potential for other researchers appears to be ignored.Objective. The primary aim of this study was to identify the most appropriate method for conducting a national survey of maternity care.Methods. Pilot studies were conducted in five hospitals to establish the best of four possible methods of approaching women, distributing questionnaires and encouraging the return of these questionnaires. Variations in the pilot studies included (a) whether or not the questionnaires were anonymous, (b) the staff involved in distributing the questionnaires and ici whether questionnaires were distributed via central or local processes. For this purpose, five maternity hospitals of different sizes in Scotland were included.Results. Problems in contacting women as a result of changes in the Data Protection Act (1998) required us to rely heavily on service providers. However, this resulted ill a number of difficulties. These included poor distribution rates in areas where distribution relied upon service providers, unauthorized changes to the study protocol and limited or inaccurate information regarding the numbers of questionnaires distributed.Conclusions. The pilot raised a number of fundamental issues related to the process of conducting a large-scale survey, including the method of distributing the questionnaire, gaining access to patients, and reliance on 'gatekeepers'. This paper highlights the lessons learned as well as the balancing act of using research methods in the most optimal way under the combined pressure of time, ethical considerations and the influences of stakeholders. Reporting the kinds of practical issues that occur during pilot studies might help others avoid similar pitfalls anti mistakes.",
keywords = "pilot studies, methodology, midwifery research, satisfaction studies, UK Data Protection Act (1998), maternity care, WOMENS VIEWS, CARE, SATISFACTION",
author = "{Van Teijlingen}, {Edwin Roland} and Rennie, {A. M.} and Graham, {Wendy Jane} and Vanora Hundley",
year = "2001",
doi = "10.1046/j.1365-2648.2001.01757.x",
language = "English",
volume = "34",
pages = "289--295",
journal = "Journal of Advanced Nursing",
issn = "0309-2402",
publisher = "Wiley-Blackwell",
number = "3",

}

TY - JOUR

T1 - The importance of conducting and reporting pilot studies: the example of the Scottish Births Survey

AU - Van Teijlingen, Edwin Roland

AU - Rennie, A. M.

AU - Graham, Wendy Jane

AU - Hundley, Vanora

PY - 2001

Y1 - 2001

N2 - Background. In many research papers, pilot studies are only reported as a means of justifying the methods. This justification might refer to the overall research design, or simply to the validity and reliability of the research tools. It is unusual for reports of pilot studies to include practical problems faced by the researcher(s). Pilot studies are relevant to best practice in research, but their potential for other researchers appears to be ignored.Objective. The primary aim of this study was to identify the most appropriate method for conducting a national survey of maternity care.Methods. Pilot studies were conducted in five hospitals to establish the best of four possible methods of approaching women, distributing questionnaires and encouraging the return of these questionnaires. Variations in the pilot studies included (a) whether or not the questionnaires were anonymous, (b) the staff involved in distributing the questionnaires and ici whether questionnaires were distributed via central or local processes. For this purpose, five maternity hospitals of different sizes in Scotland were included.Results. Problems in contacting women as a result of changes in the Data Protection Act (1998) required us to rely heavily on service providers. However, this resulted ill a number of difficulties. These included poor distribution rates in areas where distribution relied upon service providers, unauthorized changes to the study protocol and limited or inaccurate information regarding the numbers of questionnaires distributed.Conclusions. The pilot raised a number of fundamental issues related to the process of conducting a large-scale survey, including the method of distributing the questionnaire, gaining access to patients, and reliance on 'gatekeepers'. This paper highlights the lessons learned as well as the balancing act of using research methods in the most optimal way under the combined pressure of time, ethical considerations and the influences of stakeholders. Reporting the kinds of practical issues that occur during pilot studies might help others avoid similar pitfalls anti mistakes.

AB - Background. In many research papers, pilot studies are only reported as a means of justifying the methods. This justification might refer to the overall research design, or simply to the validity and reliability of the research tools. It is unusual for reports of pilot studies to include practical problems faced by the researcher(s). Pilot studies are relevant to best practice in research, but their potential for other researchers appears to be ignored.Objective. The primary aim of this study was to identify the most appropriate method for conducting a national survey of maternity care.Methods. Pilot studies were conducted in five hospitals to establish the best of four possible methods of approaching women, distributing questionnaires and encouraging the return of these questionnaires. Variations in the pilot studies included (a) whether or not the questionnaires were anonymous, (b) the staff involved in distributing the questionnaires and ici whether questionnaires were distributed via central or local processes. For this purpose, five maternity hospitals of different sizes in Scotland were included.Results. Problems in contacting women as a result of changes in the Data Protection Act (1998) required us to rely heavily on service providers. However, this resulted ill a number of difficulties. These included poor distribution rates in areas where distribution relied upon service providers, unauthorized changes to the study protocol and limited or inaccurate information regarding the numbers of questionnaires distributed.Conclusions. The pilot raised a number of fundamental issues related to the process of conducting a large-scale survey, including the method of distributing the questionnaire, gaining access to patients, and reliance on 'gatekeepers'. This paper highlights the lessons learned as well as the balancing act of using research methods in the most optimal way under the combined pressure of time, ethical considerations and the influences of stakeholders. Reporting the kinds of practical issues that occur during pilot studies might help others avoid similar pitfalls anti mistakes.

KW - pilot studies

KW - methodology

KW - midwifery research

KW - satisfaction studies

KW - UK Data Protection Act (1998)

KW - maternity care

KW - WOMENS VIEWS

KW - CARE

KW - SATISFACTION

U2 - 10.1046/j.1365-2648.2001.01757.x

DO - 10.1046/j.1365-2648.2001.01757.x

M3 - Article

VL - 34

SP - 289

EP - 295

JO - Journal of Advanced Nursing

JF - Journal of Advanced Nursing

SN - 0309-2402

IS - 3

ER -