Reliability of Identification of Behavior Change Techniques in Intervention Descriptions

Charles Abraham, Caroline E Wood, Marie Johnston, Jill Francis, Wendy Hardeman, Michelle Richardson, Susan Michie

Research output: Contribution to journalArticle

24 Citations (Scopus)

Abstract

PURPOSE: The aim of this paper is to assess the frequency of identification as well as the inter-coder and test-retest reliability of identification of behavior change techniques (BCTs) in written intervention descriptions.

METHODS: Forty trained coders applied the "Behavior Change Technique Taxonomy version 1" (BCTTv1) to 40 intervention descriptions published in protocols and repeated this 1 month later.

RESULTS: Eighty of 93 defined BCTs were identified by at least one trained coder, and 22 BCTs were identified in 16 (40 %) or more of 40 descriptions. Good inter-coder reliability was observed across 80 BCTs identified in the protocols: 66 (80 %) achieved mean prevalence and bias-adjusted kappa (PABAK) scores of 0.70 or greater, and 59 (74 %) achieved mean scores of 0.80 or greater. There was good within-coder agreement between baseline and 1 month, demonstrating good test-retest reliability.

CONCLUSIONS: BCTTv1 can be used by trained coders to identify BCTs in intervention descriptions reliably. However, some frequently occurring BCT definitions require further clarification.

Original languageEnglish
Pages (from-to)885-900
Number of pages16
JournalAnnals of Behavioral Medicine
Volume49
Issue number6
Early online date20 Aug 2015
DOIs
Publication statusPublished - Dec 2015

Keywords

  • behavior change
  • intervention
  • behavior change technique
  • taxonomy
  • inter-coder reliability
  • test-retest reliability

Fingerprint Dive into the research topics of 'Reliability of Identification of Behavior Change Techniques in Intervention Descriptions'. Together they form a unique fingerprint.

  • Cite this