What do self-efficacy items measure?

Examining the discriminant content validity of self-efficacy items

Alison M G Burrell, Julia L Allan, David M Williams, Marie Johnston

Research output: Contribution to journalArticle

3 Citations (Scopus)
6 Downloads (Pure)

Abstract

OBJECTIVES: Self-efficacy - an individual's judgement of their ability to successfully perform a behaviour - is commonly used to explain and predict behaviour. It is measured through self-report questionnaires. These scales require good content validity, that is must measure the full scope and content of the construct without contamination from similar constructs. This study uses a systematic, transparent quantitative method (discriminant content validation, DCV) to assess the content validity of a variety of self-efficacy items and qualitatively explores participant interpretations of these items.

DESIGN: A quantitative DCV and qualitative think-aloud study of self-efficacy item interpretation.

METHODS: Participants (n = 21) were presented with items designed to measure self-efficacy and related constructs following standard DCV methodology. Items were rated against construct definitions to determine whether they measured a particular construct (yes/no). Judges' confidence in each assessment was also assessed (%) and used to establish quantitative estimates of content validity for each item. A qualitative think-aloud study explored the judgements made in a subset of participants.

RESULTS: 8/8 self-efficacy items were found to measure self-efficacy; however, 2/8 of these also measured motivation. 6/8 items displayed discriminant content validity and thus can be considered 'pure' measures of self-efficacy. The think-aloud study indicated that item wording is a likely cause of item misinterpretation.

CONCLUSIONS: Self-efficacy items vary in terms of their content validity with only some of the items assessed providing 'pure' measures of the self-efficacy construct. Item wording should be considered during study design to avoid misinterpretation. Statement of contribution What is already known on this subject? For decades, questions have been raised relating to the content validity of self-efficacy scales, with suggestions of possible construct contamination. Previous studies have shown that manipulation of the wording of self-efficacy scale items results in varied participant interpretations. While self-efficacy items have been found to be distinguishable from other similar constructs, it is equally important to ensure that they are uncontaminated by different constructs within the same theory. Otherwise, when the theory is used to investigate behaviour, variance attributable to self-efficacy may be attributed to a different construct or vice versa. The present study uses discriminant content validation to test this and a think-aloud study to explore participants' interpretation of classic self-efficacy items. What does this study add? The study uses discriminant content validity methodology to assess the content validity of self-efficacy scales. Self-efficacy items which are contaminated with content from other constructs are identified. Information is presented on 'pure' self-efficacy items which can be used to guide item selection in future studies.

Original languageEnglish
Pages (from-to)597-611
Number of pages15
JournalBritish Journal of Health Psychology
Volume23
Issue number3
Early online date8 Mar 2018
DOIs
Publication statusPublished - Sep 2018

Fingerprint

Self Efficacy
Aptitude
Self Report

Keywords

  • self-efficacy
  • discriminant content validity

Cite this

What do self-efficacy items measure? Examining the discriminant content validity of self-efficacy items. / Burrell, Alison M G; Allan, Julia L; Williams, David M; Johnston, Marie.

In: British Journal of Health Psychology, Vol. 23, No. 3, 09.2018, p. 597-611.

Research output: Contribution to journalArticle

@article{4f98625774f849818e2114a7a921388e,
title = "What do self-efficacy items measure?: Examining the discriminant content validity of self-efficacy items",
abstract = "OBJECTIVES: Self-efficacy - an individual's judgement of their ability to successfully perform a behaviour - is commonly used to explain and predict behaviour. It is measured through self-report questionnaires. These scales require good content validity, that is must measure the full scope and content of the construct without contamination from similar constructs. This study uses a systematic, transparent quantitative method (discriminant content validation, DCV) to assess the content validity of a variety of self-efficacy items and qualitatively explores participant interpretations of these items.DESIGN: A quantitative DCV and qualitative think-aloud study of self-efficacy item interpretation.METHODS: Participants (n = 21) were presented with items designed to measure self-efficacy and related constructs following standard DCV methodology. Items were rated against construct definitions to determine whether they measured a particular construct (yes/no). Judges' confidence in each assessment was also assessed ({\%}) and used to establish quantitative estimates of content validity for each item. A qualitative think-aloud study explored the judgements made in a subset of participants.RESULTS: 8/8 self-efficacy items were found to measure self-efficacy; however, 2/8 of these also measured motivation. 6/8 items displayed discriminant content validity and thus can be considered 'pure' measures of self-efficacy. The think-aloud study indicated that item wording is a likely cause of item misinterpretation.CONCLUSIONS: Self-efficacy items vary in terms of their content validity with only some of the items assessed providing 'pure' measures of the self-efficacy construct. Item wording should be considered during study design to avoid misinterpretation. Statement of contribution What is already known on this subject? For decades, questions have been raised relating to the content validity of self-efficacy scales, with suggestions of possible construct contamination. Previous studies have shown that manipulation of the wording of self-efficacy scale items results in varied participant interpretations. While self-efficacy items have been found to be distinguishable from other similar constructs, it is equally important to ensure that they are uncontaminated by different constructs within the same theory. Otherwise, when the theory is used to investigate behaviour, variance attributable to self-efficacy may be attributed to a different construct or vice versa. The present study uses discriminant content validation to test this and a think-aloud study to explore participants' interpretation of classic self-efficacy items. What does this study add? The study uses discriminant content validity methodology to assess the content validity of self-efficacy scales. Self-efficacy items which are contaminated with content from other constructs are identified. Information is presented on 'pure' self-efficacy items which can be used to guide item selection in future studies.",
keywords = "self-efficacy, discriminant content validity",
author = "Burrell, {Alison M G} and Allan, {Julia L} and Williams, {David M} and Marie Johnston",
note = "{\circledC} 2018 The British Psychological Society.",
year = "2018",
month = "9",
doi = "10.1111/bjhp.12306",
language = "English",
volume = "23",
pages = "597--611",
journal = "British Journal of Health Psychology",
issn = "1359-107X",
publisher = "Wiley-Blackwell",
number = "3",

}

TY - JOUR

T1 - What do self-efficacy items measure?

T2 - Examining the discriminant content validity of self-efficacy items

AU - Burrell, Alison M G

AU - Allan, Julia L

AU - Williams, David M

AU - Johnston, Marie

N1 - © 2018 The British Psychological Society.

PY - 2018/9

Y1 - 2018/9

N2 - OBJECTIVES: Self-efficacy - an individual's judgement of their ability to successfully perform a behaviour - is commonly used to explain and predict behaviour. It is measured through self-report questionnaires. These scales require good content validity, that is must measure the full scope and content of the construct without contamination from similar constructs. This study uses a systematic, transparent quantitative method (discriminant content validation, DCV) to assess the content validity of a variety of self-efficacy items and qualitatively explores participant interpretations of these items.DESIGN: A quantitative DCV and qualitative think-aloud study of self-efficacy item interpretation.METHODS: Participants (n = 21) were presented with items designed to measure self-efficacy and related constructs following standard DCV methodology. Items were rated against construct definitions to determine whether they measured a particular construct (yes/no). Judges' confidence in each assessment was also assessed (%) and used to establish quantitative estimates of content validity for each item. A qualitative think-aloud study explored the judgements made in a subset of participants.RESULTS: 8/8 self-efficacy items were found to measure self-efficacy; however, 2/8 of these also measured motivation. 6/8 items displayed discriminant content validity and thus can be considered 'pure' measures of self-efficacy. The think-aloud study indicated that item wording is a likely cause of item misinterpretation.CONCLUSIONS: Self-efficacy items vary in terms of their content validity with only some of the items assessed providing 'pure' measures of the self-efficacy construct. Item wording should be considered during study design to avoid misinterpretation. Statement of contribution What is already known on this subject? For decades, questions have been raised relating to the content validity of self-efficacy scales, with suggestions of possible construct contamination. Previous studies have shown that manipulation of the wording of self-efficacy scale items results in varied participant interpretations. While self-efficacy items have been found to be distinguishable from other similar constructs, it is equally important to ensure that they are uncontaminated by different constructs within the same theory. Otherwise, when the theory is used to investigate behaviour, variance attributable to self-efficacy may be attributed to a different construct or vice versa. The present study uses discriminant content validation to test this and a think-aloud study to explore participants' interpretation of classic self-efficacy items. What does this study add? The study uses discriminant content validity methodology to assess the content validity of self-efficacy scales. Self-efficacy items which are contaminated with content from other constructs are identified. Information is presented on 'pure' self-efficacy items which can be used to guide item selection in future studies.

AB - OBJECTIVES: Self-efficacy - an individual's judgement of their ability to successfully perform a behaviour - is commonly used to explain and predict behaviour. It is measured through self-report questionnaires. These scales require good content validity, that is must measure the full scope and content of the construct without contamination from similar constructs. This study uses a systematic, transparent quantitative method (discriminant content validation, DCV) to assess the content validity of a variety of self-efficacy items and qualitatively explores participant interpretations of these items.DESIGN: A quantitative DCV and qualitative think-aloud study of self-efficacy item interpretation.METHODS: Participants (n = 21) were presented with items designed to measure self-efficacy and related constructs following standard DCV methodology. Items were rated against construct definitions to determine whether they measured a particular construct (yes/no). Judges' confidence in each assessment was also assessed (%) and used to establish quantitative estimates of content validity for each item. A qualitative think-aloud study explored the judgements made in a subset of participants.RESULTS: 8/8 self-efficacy items were found to measure self-efficacy; however, 2/8 of these also measured motivation. 6/8 items displayed discriminant content validity and thus can be considered 'pure' measures of self-efficacy. The think-aloud study indicated that item wording is a likely cause of item misinterpretation.CONCLUSIONS: Self-efficacy items vary in terms of their content validity with only some of the items assessed providing 'pure' measures of the self-efficacy construct. Item wording should be considered during study design to avoid misinterpretation. Statement of contribution What is already known on this subject? For decades, questions have been raised relating to the content validity of self-efficacy scales, with suggestions of possible construct contamination. Previous studies have shown that manipulation of the wording of self-efficacy scale items results in varied participant interpretations. While self-efficacy items have been found to be distinguishable from other similar constructs, it is equally important to ensure that they are uncontaminated by different constructs within the same theory. Otherwise, when the theory is used to investigate behaviour, variance attributable to self-efficacy may be attributed to a different construct or vice versa. The present study uses discriminant content validation to test this and a think-aloud study to explore participants' interpretation of classic self-efficacy items. What does this study add? The study uses discriminant content validity methodology to assess the content validity of self-efficacy scales. Self-efficacy items which are contaminated with content from other constructs are identified. Information is presented on 'pure' self-efficacy items which can be used to guide item selection in future studies.

KW - self-efficacy

KW - discriminant content validity

U2 - 10.1111/bjhp.12306

DO - 10.1111/bjhp.12306

M3 - Article

VL - 23

SP - 597

EP - 611

JO - British Journal of Health Psychology

JF - British Journal of Health Psychology

SN - 1359-107X

IS - 3

ER -