The practical impact of differential item functioning analyses in a health-related quality of life instrument

EORTC Quality of Life Group, Quality of Life Cross-Cultural Meta-Analysis Group

Research output: Contribution to journalArticle

18 Citations (Scopus)

Abstract

INTRODUCTION: Differential item functioning (DIF) analyses are commonly used to evaluate health-related quality of life (HRQoL) instruments. There is, however, a lack of consensus as to how to assess the practical impact of statistically significant DIF results. METHODS: Using our previously published ordinal logistic regression DIF results for the Fatigue scale of a HRQoL instrument as an example, the practical impact on a particular Norwegian clinical trial was investigated. The results were used to determine the difference in mean Fatigue scores assuming that the same trial was conducted in the UK. The results were then compared with published information on what would be considered a clinically important change in scores. RESULTS: The item with the largest DIF effect resulted in differences between the mean English and Norwegian Fatigue scores that, although small, could be considered clinically important. Sensitivity analyses showed that larger differences were found for shorter scales, and when the proportions in each response category were equal. DISCUSSION: Our scenarios suggest that translation differences in an item can result in small, but clinically important, differences at the scale score level. This is more likely to be problematic for observational studies than for clinical trials, where randomised groups are stratified by centre.
Original languageEnglish
Pages (from-to)1125-1130
Number of pages6
JournalQuality of Life Research
Volume18
Issue number8
Early online date4 Aug 2009
DOIs
Publication statusPublished - Oct 2009

Fingerprint

Fatigue
Quality of Life
Observational Studies
Randomized Controlled Trials
Logistic Models
Clinical Trials

Cite this

The practical impact of differential item functioning analyses in a health-related quality of life instrument. / EORTC Quality of Life Group; Quality of Life Cross-Cultural Meta-Analysis Group.

In: Quality of Life Research, Vol. 18, No. 8, 10.2009, p. 1125-1130.

Research output: Contribution to journalArticle

EORTC Quality of Life Group & Quality of Life Cross-Cultural Meta-Analysis Group 2009, 'The practical impact of differential item functioning analyses in a health-related quality of life instrument' Quality of Life Research, vol. 18, no. 8, pp. 1125-1130. https://doi.org/10.1007/s11136-009-9521-z
EORTC Quality of Life Group ; Quality of Life Cross-Cultural Meta-Analysis Group. / The practical impact of differential item functioning analyses in a health-related quality of life instrument. In: Quality of Life Research. 2009 ; Vol. 18, No. 8. pp. 1125-1130.
@article{52df7fcac2d04c208f5bf06dce54b5b3,
title = "The practical impact of differential item functioning analyses in a health-related quality of life instrument",
abstract = "INTRODUCTION: Differential item functioning (DIF) analyses are commonly used to evaluate health-related quality of life (HRQoL) instruments. There is, however, a lack of consensus as to how to assess the practical impact of statistically significant DIF results. METHODS: Using our previously published ordinal logistic regression DIF results for the Fatigue scale of a HRQoL instrument as an example, the practical impact on a particular Norwegian clinical trial was investigated. The results were used to determine the difference in mean Fatigue scores assuming that the same trial was conducted in the UK. The results were then compared with published information on what would be considered a clinically important change in scores. RESULTS: The item with the largest DIF effect resulted in differences between the mean English and Norwegian Fatigue scores that, although small, could be considered clinically important. Sensitivity analyses showed that larger differences were found for shorter scales, and when the proportions in each response category were equal. DISCUSSION: Our scenarios suggest that translation differences in an item can result in small, but clinically important, differences at the scale score level. This is more likely to be problematic for observational studies than for clinical trials, where randomised groups are stratified by centre.",
author = "Scott, {Neil W} and Fayers, {Peter M} and Aaronson, {Neil K} and Andrew Bottomley and {de Graeff}, Alexander and Mogens Groenvold and Chad Gundy and Michael Koller and Petersen, {Morten A} and Sprangers, {Mirjam A G} and {EORTC Quality of Life Group} and {Quality of Life Cross-Cultural Meta-Analysis Group}",
year = "2009",
month = "10",
doi = "10.1007/s11136-009-9521-z",
language = "English",
volume = "18",
pages = "1125--1130",
journal = "Quality of Life Research",
issn = "0962-9343",
publisher = "Springer",
number = "8",

}

TY - JOUR

T1 - The practical impact of differential item functioning analyses in a health-related quality of life instrument

AU - Scott, Neil W

AU - Fayers, Peter M

AU - Aaronson, Neil K

AU - Bottomley, Andrew

AU - de Graeff, Alexander

AU - Groenvold, Mogens

AU - Gundy, Chad

AU - Koller, Michael

AU - Petersen, Morten A

AU - Sprangers, Mirjam A G

AU - EORTC Quality of Life Group

AU - Quality of Life Cross-Cultural Meta-Analysis Group

PY - 2009/10

Y1 - 2009/10

N2 - INTRODUCTION: Differential item functioning (DIF) analyses are commonly used to evaluate health-related quality of life (HRQoL) instruments. There is, however, a lack of consensus as to how to assess the practical impact of statistically significant DIF results. METHODS: Using our previously published ordinal logistic regression DIF results for the Fatigue scale of a HRQoL instrument as an example, the practical impact on a particular Norwegian clinical trial was investigated. The results were used to determine the difference in mean Fatigue scores assuming that the same trial was conducted in the UK. The results were then compared with published information on what would be considered a clinically important change in scores. RESULTS: The item with the largest DIF effect resulted in differences between the mean English and Norwegian Fatigue scores that, although small, could be considered clinically important. Sensitivity analyses showed that larger differences were found for shorter scales, and when the proportions in each response category were equal. DISCUSSION: Our scenarios suggest that translation differences in an item can result in small, but clinically important, differences at the scale score level. This is more likely to be problematic for observational studies than for clinical trials, where randomised groups are stratified by centre.

AB - INTRODUCTION: Differential item functioning (DIF) analyses are commonly used to evaluate health-related quality of life (HRQoL) instruments. There is, however, a lack of consensus as to how to assess the practical impact of statistically significant DIF results. METHODS: Using our previously published ordinal logistic regression DIF results for the Fatigue scale of a HRQoL instrument as an example, the practical impact on a particular Norwegian clinical trial was investigated. The results were used to determine the difference in mean Fatigue scores assuming that the same trial was conducted in the UK. The results were then compared with published information on what would be considered a clinically important change in scores. RESULTS: The item with the largest DIF effect resulted in differences between the mean English and Norwegian Fatigue scores that, although small, could be considered clinically important. Sensitivity analyses showed that larger differences were found for shorter scales, and when the proportions in each response category were equal. DISCUSSION: Our scenarios suggest that translation differences in an item can result in small, but clinically important, differences at the scale score level. This is more likely to be problematic for observational studies than for clinical trials, where randomised groups are stratified by centre.

U2 - 10.1007/s11136-009-9521-z

DO - 10.1007/s11136-009-9521-z

M3 - Article

VL - 18

SP - 1125

EP - 1130

JO - Quality of Life Research

JF - Quality of Life Research

SN - 0962-9343

IS - 8

ER -