What is an adequate sample size? Operationalising data saturation for theory-based interview studies

Jill J Francis, Marie Johnston, Clare Robertson, Liz Glidewell, Vikki Ann Entwistle, Martin P Eccles, Jeremy M Grimshaw

Research output: Contribution to journalArticle

682 Citations (Scopus)
12 Downloads (Pure)

Abstract

In interview studies, sample size is often justified by interviewing participants until reaching 'data saturation'. However, there is no agreed method of establishing this. We propose principles for deciding saturation in theory-based interview studies (where conceptual categories are pre-established by existing theory). First, specify a minimum sample size for initial analysis (initial analysis sample). Second, specify how many more interviews will be conducted without new ideas emerging (stopping criterion). We demonstrate these principles in two studies, based on the theory of planned behaviour, designed to identify three belief categories (Behavioural, Normative and Control), using an initial analysis sample of 10 and stopping criterion of 3. Study 1 (retrospective analysis of existing data) identified 84 shared beliefs of 14 general medical practitioners about managing patients with sore throat without prescribing antibiotics. The criterion for saturation was achieved for Normative beliefs but not for other beliefs or studywise saturation. In Study 2 (prospective analysis), 17 relatives of people with Paget's disease of the bone reported 44 shared beliefs about taking genetic testing. Studywise data saturation was achieved at interview 17. We propose specification of these principles for reporting data saturation in theory-based interview studies. The principles may be adaptable for other types of studies.
Original languageEnglish
Pages (from-to)1229-1245
Number of pages17
JournalPsychology & Health
Volume25
Issue number10
DOIs
Publication statusPublished - Dec 2010

Fingerprint

Sample Size
Interviews
Osteitis Deformans
Pharyngitis
Genetic Testing
General Practitioners
Research Design
Retrospective Studies
Prospective Studies
Anti-Bacterial Agents

Keywords

  • data saturation
  • sample size
  • interviews as topic
  • models, psychological
  • theory-based content analysis

Cite this

What is an adequate sample size? Operationalising data saturation for theory-based interview studies. / Francis, Jill J; Johnston, Marie; Robertson, Clare; Glidewell, Liz; Entwistle, Vikki Ann; Eccles, Martin P; Grimshaw, Jeremy M.

In: Psychology & Health, Vol. 25, No. 10, 12.2010, p. 1229-1245.

Research output: Contribution to journalArticle

Francis, Jill J ; Johnston, Marie ; Robertson, Clare ; Glidewell, Liz ; Entwistle, Vikki Ann ; Eccles, Martin P ; Grimshaw, Jeremy M. / What is an adequate sample size? Operationalising data saturation for theory-based interview studies. In: Psychology & Health. 2010 ; Vol. 25, No. 10. pp. 1229-1245.
@article{17ec4b3b10234c74a76201e21d736d16,
title = "What is an adequate sample size?: Operationalising data saturation for theory-based interview studies",
abstract = "In interview studies, sample size is often justified by interviewing participants until reaching 'data saturation'. However, there is no agreed method of establishing this. We propose principles for deciding saturation in theory-based interview studies (where conceptual categories are pre-established by existing theory). First, specify a minimum sample size for initial analysis (initial analysis sample). Second, specify how many more interviews will be conducted without new ideas emerging (stopping criterion). We demonstrate these principles in two studies, based on the theory of planned behaviour, designed to identify three belief categories (Behavioural, Normative and Control), using an initial analysis sample of 10 and stopping criterion of 3. Study 1 (retrospective analysis of existing data) identified 84 shared beliefs of 14 general medical practitioners about managing patients with sore throat without prescribing antibiotics. The criterion for saturation was achieved for Normative beliefs but not for other beliefs or studywise saturation. In Study 2 (prospective analysis), 17 relatives of people with Paget's disease of the bone reported 44 shared beliefs about taking genetic testing. Studywise data saturation was achieved at interview 17. We propose specification of these principles for reporting data saturation in theory-based interview studies. The principles may be adaptable for other types of studies.",
keywords = "data saturation, sample size, interviews as topic, models, psychological, theory-based content analysis",
author = "Francis, {Jill J} and Marie Johnston and Clare Robertson and Liz Glidewell and Entwistle, {Vikki Ann} and Eccles, {Martin P} and Grimshaw, {Jeremy M}",
note = "This is an electronic version of an article published in Francis, JJ, Johnston, M, Robertson, C, Glidewell, L, Entwistle, V, Eccles, MP & Grimshaw, JM 2010, 'What is an adequate sample size? : Operationalising data saturation for theory-based interview studies', Psychology & Health, Vol. 25, No. 10, pp. 1229-1245. Psychology & Health is available online at: http://www.informaworld.com/smpp/content~db=all?content=10.1080/08870440903194015.",
year = "2010",
month = "12",
doi = "10.1080/08870440903194015",
language = "English",
volume = "25",
pages = "1229--1245",
journal = "Psychology & Health",
issn = "0887-0446",
publisher = "Routledge",
number = "10",

}

TY - JOUR

T1 - What is an adequate sample size?

T2 - Operationalising data saturation for theory-based interview studies

AU - Francis, Jill J

AU - Johnston, Marie

AU - Robertson, Clare

AU - Glidewell, Liz

AU - Entwistle, Vikki Ann

AU - Eccles, Martin P

AU - Grimshaw, Jeremy M

N1 - This is an electronic version of an article published in Francis, JJ, Johnston, M, Robertson, C, Glidewell, L, Entwistle, V, Eccles, MP & Grimshaw, JM 2010, 'What is an adequate sample size? : Operationalising data saturation for theory-based interview studies', Psychology & Health, Vol. 25, No. 10, pp. 1229-1245. Psychology & Health is available online at: http://www.informaworld.com/smpp/content~db=all?content=10.1080/08870440903194015.

PY - 2010/12

Y1 - 2010/12

N2 - In interview studies, sample size is often justified by interviewing participants until reaching 'data saturation'. However, there is no agreed method of establishing this. We propose principles for deciding saturation in theory-based interview studies (where conceptual categories are pre-established by existing theory). First, specify a minimum sample size for initial analysis (initial analysis sample). Second, specify how many more interviews will be conducted without new ideas emerging (stopping criterion). We demonstrate these principles in two studies, based on the theory of planned behaviour, designed to identify three belief categories (Behavioural, Normative and Control), using an initial analysis sample of 10 and stopping criterion of 3. Study 1 (retrospective analysis of existing data) identified 84 shared beliefs of 14 general medical practitioners about managing patients with sore throat without prescribing antibiotics. The criterion for saturation was achieved for Normative beliefs but not for other beliefs or studywise saturation. In Study 2 (prospective analysis), 17 relatives of people with Paget's disease of the bone reported 44 shared beliefs about taking genetic testing. Studywise data saturation was achieved at interview 17. We propose specification of these principles for reporting data saturation in theory-based interview studies. The principles may be adaptable for other types of studies.

AB - In interview studies, sample size is often justified by interviewing participants until reaching 'data saturation'. However, there is no agreed method of establishing this. We propose principles for deciding saturation in theory-based interview studies (where conceptual categories are pre-established by existing theory). First, specify a minimum sample size for initial analysis (initial analysis sample). Second, specify how many more interviews will be conducted without new ideas emerging (stopping criterion). We demonstrate these principles in two studies, based on the theory of planned behaviour, designed to identify three belief categories (Behavioural, Normative and Control), using an initial analysis sample of 10 and stopping criterion of 3. Study 1 (retrospective analysis of existing data) identified 84 shared beliefs of 14 general medical practitioners about managing patients with sore throat without prescribing antibiotics. The criterion for saturation was achieved for Normative beliefs but not for other beliefs or studywise saturation. In Study 2 (prospective analysis), 17 relatives of people with Paget's disease of the bone reported 44 shared beliefs about taking genetic testing. Studywise data saturation was achieved at interview 17. We propose specification of these principles for reporting data saturation in theory-based interview studies. The principles may be adaptable for other types of studies.

KW - data saturation

KW - sample size

KW - interviews as topic

KW - models, psychological

KW - theory-based content analysis

U2 - 10.1080/08870440903194015

DO - 10.1080/08870440903194015

M3 - Article

C2 - 20204937

VL - 25

SP - 1229

EP - 1245

JO - Psychology & Health

JF - Psychology & Health

SN - 0887-0446

IS - 10

ER -