How do patients contribute to signal detection?

A retrospective analysis of spontaneous reporting of adverse drug reactions in the UK’s Yellow Card Scheme

Lorna Hazell, Victoria Cornelius, Philip Hannaford, Saad Shakir, Anthony Avery, Yellow Card Study Collaboration

Research output: Contribution to journalArticle

50 Citations (Scopus)

Abstract

Background

In 2005, spontaneous reporting of adverse drug reactions (ADRs) to the UK’s Yellow Card Scheme (YCS) was extended to include patient reports. Here, we investigate the potential pharmacovigilance impact of patient reporting.

Objectives

The aim of the study was to investigate the relative contribution of patient reporting to signal detection through disproportionality analysis.

Methods

Data were analysed from all reports submitted directly to the YCS between October 2005 and September 2007. Three datasets of drug–ADR pairs were created: one for patient reports, one for healthcare professional (HCP) reports and one for all reports combined. The proportional reporting ratio (PRR) method was used to identify signals of disproportionate reporting (SDRs) in each dataset. The number of SDRs identified from patient and HCP reports were compared, as well as the type of ADR and suspect drug involved. A sensitivity analysis was performed to examine how combining the patient and HCP reports may affect the SDRs identified.

Results

Data were received for 5,180 patient and 20,949 HCP reports, relating to 16,566 and 28,775 drug–ADR pairs, respectively, with 4,340 (10.6 %) pairs found in both datasets. A significantly higher proportion of the SDRs identified from HCP reports involved reactions classified as serious by the Medicines and Healthcare products Regulatory Agency (MHRA), compared with patient reports (n = 931, 48.0 % vs. n = 185, 28.5 %), or involved newly marketed drugs (n = 596, 30.7 % vs. n = 71, 10.9 %). The proportion of SDRs assessed as not listed on the Summary of Product Characteristics (SPC) was similar in each group (~15 %, based on a random sample). After combining the patient and HCP reports, 278 (~11 %) of the SDRs identified when each group was analysed separately no longer met the SDR criteria, including 12 potentially serious ADRs not listed on the product’s SPC. On the other hand, the combined dataset identified an additional 508 SDRs that were not identified when patient or HCP reports were analysed separately. Approximately 10 % (n = 47) of these additional SDRs were assessed as serious ADRs and were not listed on the product’s SPC.

Conclusions

Although this study is limited to the UK experience, overall, the results suggest that patient reporting may provide a positive complementary contribution to that of HCPs. Patient reporting may make an important contribution to drug safety by identifying different SDRs not identified from HCP reports alone. The combination of reports from patients and HCPs, however, when used for the purposes of signal detection through disproportionality analysis, may result in the loss of some information. One possible strategy is to conduct such analyses using reports from patients and HCPs combined, as well as separately for each group.
Original languageEnglish
Pages (from-to)199-206
Number of pages8
JournalDrug Safety
Volume36
Issue number3
Early online date27 Feb 2013
DOIs
Publication statusPublished - Mar 2013

Fingerprint

Signal detection
Drug-Related Side Effects and Adverse Reactions
Pharmaceutical Preparations
Delivery of Health Care
Sensitivity analysis
Medicine
Pharmacovigilance

Cite this

How do patients contribute to signal detection? A retrospective analysis of spontaneous reporting of adverse drug reactions in the UK’s Yellow Card Scheme. / Hazell, Lorna; Cornelius, Victoria; Hannaford, Philip; Shakir, Saad; Avery, Anthony; Yellow Card Study Collaboration.

In: Drug Safety, Vol. 36, No. 3, 03.2013, p. 199-206.

Research output: Contribution to journalArticle

Hazell, Lorna ; Cornelius, Victoria ; Hannaford, Philip ; Shakir, Saad ; Avery, Anthony ; Yellow Card Study Collaboration. / How do patients contribute to signal detection? A retrospective analysis of spontaneous reporting of adverse drug reactions in the UK’s Yellow Card Scheme. In: Drug Safety. 2013 ; Vol. 36, No. 3. pp. 199-206.
@article{72bfa6cda2f54228a213ee75c89c47fa,
title = "How do patients contribute to signal detection?: A retrospective analysis of spontaneous reporting of adverse drug reactions in the UK’s Yellow Card Scheme",
abstract = "BackgroundIn 2005, spontaneous reporting of adverse drug reactions (ADRs) to the UK’s Yellow Card Scheme (YCS) was extended to include patient reports. Here, we investigate the potential pharmacovigilance impact of patient reporting.ObjectivesThe aim of the study was to investigate the relative contribution of patient reporting to signal detection through disproportionality analysis.MethodsData were analysed from all reports submitted directly to the YCS between October 2005 and September 2007. Three datasets of drug–ADR pairs were created: one for patient reports, one for healthcare professional (HCP) reports and one for all reports combined. The proportional reporting ratio (PRR) method was used to identify signals of disproportionate reporting (SDRs) in each dataset. The number of SDRs identified from patient and HCP reports were compared, as well as the type of ADR and suspect drug involved. A sensitivity analysis was performed to examine how combining the patient and HCP reports may affect the SDRs identified.ResultsData were received for 5,180 patient and 20,949 HCP reports, relating to 16,566 and 28,775 drug–ADR pairs, respectively, with 4,340 (10.6 {\%}) pairs found in both datasets. A significantly higher proportion of the SDRs identified from HCP reports involved reactions classified as serious by the Medicines and Healthcare products Regulatory Agency (MHRA), compared with patient reports (n = 931, 48.0 {\%} vs. n = 185, 28.5 {\%}), or involved newly marketed drugs (n = 596, 30.7 {\%} vs. n = 71, 10.9 {\%}). The proportion of SDRs assessed as not listed on the Summary of Product Characteristics (SPC) was similar in each group (~15 {\%}, based on a random sample). After combining the patient and HCP reports, 278 (~11 {\%}) of the SDRs identified when each group was analysed separately no longer met the SDR criteria, including 12 potentially serious ADRs not listed on the product’s SPC. On the other hand, the combined dataset identified an additional 508 SDRs that were not identified when patient or HCP reports were analysed separately. Approximately 10 {\%} (n = 47) of these additional SDRs were assessed as serious ADRs and were not listed on the product’s SPC.ConclusionsAlthough this study is limited to the UK experience, overall, the results suggest that patient reporting may provide a positive complementary contribution to that of HCPs. Patient reporting may make an important contribution to drug safety by identifying different SDRs not identified from HCP reports alone. The combination of reports from patients and HCPs, however, when used for the purposes of signal detection through disproportionality analysis, may result in the loss of some information. One possible strategy is to conduct such analyses using reports from patients and HCPs combined, as well as separately for each group.",
author = "Lorna Hazell and Victoria Cornelius and Philip Hannaford and Saad Shakir and Anthony Avery and {Yellow Card Study Collaboration}",
note = "Acknowledgments The MedDRA{\circledR} trademark is owned by the International Federation of Pharmaceutical Manufacturers & Associations (IFPMA) on behalf of the ICH. Some of the text, tables and figures in this article have been reproduced or adapted from the previously published Health Technology Assessment (no. 1520) [20]. This work was carried out at the DSRU in Southampton, UK. The Yellow Card Study Collaboration also includes Heather Fortnum, Alison Gifford, Janet Krska, Amanda Lee, Elizabeth Murphy, Tim Payne, Claire Anderson, Margaret Watson, David McLernon and Christine Bond. We wish to thank the Yellow Card Study Collaboration Advisory Group for their feedback and the UK MHRA for providing us with their data and assisting with any queries. We also thank Mr Andrew Hauschild, Software Developer, DSRU, and Professor Stephen Evans, Professor of Pharmacoepidemiology, London School of Hygiene and Tropical Medicine, for statistical advice. Conflict of interest and funding The DSRU is a registered independent charity (No. 327206) that works in association with the University of Portsmouth. It receives unconditional donations from pharmaceutical companies. These companies have no control over the conduct or publication of studies performed by the DSRU. Saad Shakir has received lecturing fees from the pharmaceutical industry and consultancy fees, although not in relation to the current study. As the current study regards no particular pharmaceutical product, there is no conflict interest. This research was supported by the UK National Health Service Research & Development Programme Health Technology Assessment Programme (project number 06/92/03). The views and opinions expressed herein are those of the authors and do not necessarily reflect those of the Department of Health. The study sponsor did not participate in the study design; in the collection, analysis or interpretation of data; in the writing of the report; or in the decision to submit the paper for publication. All researchers were independent from the funder. The authors have no conflicts of interest to report.",
year = "2013",
month = "3",
doi = "10.1007/s40264-013-0021-2",
language = "English",
volume = "36",
pages = "199--206",
journal = "Drug Safety",
issn = "0114-5916",
publisher = "Adis International Ltd",
number = "3",

}

TY - JOUR

T1 - How do patients contribute to signal detection?

T2 - A retrospective analysis of spontaneous reporting of adverse drug reactions in the UK’s Yellow Card Scheme

AU - Hazell, Lorna

AU - Cornelius, Victoria

AU - Hannaford, Philip

AU - Shakir, Saad

AU - Avery, Anthony

AU - Yellow Card Study Collaboration

N1 - Acknowledgments The MedDRA® trademark is owned by the International Federation of Pharmaceutical Manufacturers & Associations (IFPMA) on behalf of the ICH. Some of the text, tables and figures in this article have been reproduced or adapted from the previously published Health Technology Assessment (no. 1520) [20]. This work was carried out at the DSRU in Southampton, UK. The Yellow Card Study Collaboration also includes Heather Fortnum, Alison Gifford, Janet Krska, Amanda Lee, Elizabeth Murphy, Tim Payne, Claire Anderson, Margaret Watson, David McLernon and Christine Bond. We wish to thank the Yellow Card Study Collaboration Advisory Group for their feedback and the UK MHRA for providing us with their data and assisting with any queries. We also thank Mr Andrew Hauschild, Software Developer, DSRU, and Professor Stephen Evans, Professor of Pharmacoepidemiology, London School of Hygiene and Tropical Medicine, for statistical advice. Conflict of interest and funding The DSRU is a registered independent charity (No. 327206) that works in association with the University of Portsmouth. It receives unconditional donations from pharmaceutical companies. These companies have no control over the conduct or publication of studies performed by the DSRU. Saad Shakir has received lecturing fees from the pharmaceutical industry and consultancy fees, although not in relation to the current study. As the current study regards no particular pharmaceutical product, there is no conflict interest. This research was supported by the UK National Health Service Research & Development Programme Health Technology Assessment Programme (project number 06/92/03). The views and opinions expressed herein are those of the authors and do not necessarily reflect those of the Department of Health. The study sponsor did not participate in the study design; in the collection, analysis or interpretation of data; in the writing of the report; or in the decision to submit the paper for publication. All researchers were independent from the funder. The authors have no conflicts of interest to report.

PY - 2013/3

Y1 - 2013/3

N2 - BackgroundIn 2005, spontaneous reporting of adverse drug reactions (ADRs) to the UK’s Yellow Card Scheme (YCS) was extended to include patient reports. Here, we investigate the potential pharmacovigilance impact of patient reporting.ObjectivesThe aim of the study was to investigate the relative contribution of patient reporting to signal detection through disproportionality analysis.MethodsData were analysed from all reports submitted directly to the YCS between October 2005 and September 2007. Three datasets of drug–ADR pairs were created: one for patient reports, one for healthcare professional (HCP) reports and one for all reports combined. The proportional reporting ratio (PRR) method was used to identify signals of disproportionate reporting (SDRs) in each dataset. The number of SDRs identified from patient and HCP reports were compared, as well as the type of ADR and suspect drug involved. A sensitivity analysis was performed to examine how combining the patient and HCP reports may affect the SDRs identified.ResultsData were received for 5,180 patient and 20,949 HCP reports, relating to 16,566 and 28,775 drug–ADR pairs, respectively, with 4,340 (10.6 %) pairs found in both datasets. A significantly higher proportion of the SDRs identified from HCP reports involved reactions classified as serious by the Medicines and Healthcare products Regulatory Agency (MHRA), compared with patient reports (n = 931, 48.0 % vs. n = 185, 28.5 %), or involved newly marketed drugs (n = 596, 30.7 % vs. n = 71, 10.9 %). The proportion of SDRs assessed as not listed on the Summary of Product Characteristics (SPC) was similar in each group (~15 %, based on a random sample). After combining the patient and HCP reports, 278 (~11 %) of the SDRs identified when each group was analysed separately no longer met the SDR criteria, including 12 potentially serious ADRs not listed on the product’s SPC. On the other hand, the combined dataset identified an additional 508 SDRs that were not identified when patient or HCP reports were analysed separately. Approximately 10 % (n = 47) of these additional SDRs were assessed as serious ADRs and were not listed on the product’s SPC.ConclusionsAlthough this study is limited to the UK experience, overall, the results suggest that patient reporting may provide a positive complementary contribution to that of HCPs. Patient reporting may make an important contribution to drug safety by identifying different SDRs not identified from HCP reports alone. The combination of reports from patients and HCPs, however, when used for the purposes of signal detection through disproportionality analysis, may result in the loss of some information. One possible strategy is to conduct such analyses using reports from patients and HCPs combined, as well as separately for each group.

AB - BackgroundIn 2005, spontaneous reporting of adverse drug reactions (ADRs) to the UK’s Yellow Card Scheme (YCS) was extended to include patient reports. Here, we investigate the potential pharmacovigilance impact of patient reporting.ObjectivesThe aim of the study was to investigate the relative contribution of patient reporting to signal detection through disproportionality analysis.MethodsData were analysed from all reports submitted directly to the YCS between October 2005 and September 2007. Three datasets of drug–ADR pairs were created: one for patient reports, one for healthcare professional (HCP) reports and one for all reports combined. The proportional reporting ratio (PRR) method was used to identify signals of disproportionate reporting (SDRs) in each dataset. The number of SDRs identified from patient and HCP reports were compared, as well as the type of ADR and suspect drug involved. A sensitivity analysis was performed to examine how combining the patient and HCP reports may affect the SDRs identified.ResultsData were received for 5,180 patient and 20,949 HCP reports, relating to 16,566 and 28,775 drug–ADR pairs, respectively, with 4,340 (10.6 %) pairs found in both datasets. A significantly higher proportion of the SDRs identified from HCP reports involved reactions classified as serious by the Medicines and Healthcare products Regulatory Agency (MHRA), compared with patient reports (n = 931, 48.0 % vs. n = 185, 28.5 %), or involved newly marketed drugs (n = 596, 30.7 % vs. n = 71, 10.9 %). The proportion of SDRs assessed as not listed on the Summary of Product Characteristics (SPC) was similar in each group (~15 %, based on a random sample). After combining the patient and HCP reports, 278 (~11 %) of the SDRs identified when each group was analysed separately no longer met the SDR criteria, including 12 potentially serious ADRs not listed on the product’s SPC. On the other hand, the combined dataset identified an additional 508 SDRs that were not identified when patient or HCP reports were analysed separately. Approximately 10 % (n = 47) of these additional SDRs were assessed as serious ADRs and were not listed on the product’s SPC.ConclusionsAlthough this study is limited to the UK experience, overall, the results suggest that patient reporting may provide a positive complementary contribution to that of HCPs. Patient reporting may make an important contribution to drug safety by identifying different SDRs not identified from HCP reports alone. The combination of reports from patients and HCPs, however, when used for the purposes of signal detection through disproportionality analysis, may result in the loss of some information. One possible strategy is to conduct such analyses using reports from patients and HCPs combined, as well as separately for each group.

U2 - 10.1007/s40264-013-0021-2

DO - 10.1007/s40264-013-0021-2

M3 - Article

VL - 36

SP - 199

EP - 206

JO - Drug Safety

JF - Drug Safety

SN - 0114-5916

IS - 3

ER -