Developing and validating a tool for assessment of pharmacist prescribers' consultations

Derek Stewart (Corresponding Author), Johnson George, Christine Bond, Lesley Diack, Jen Cleland, Dorothy McCaig, Scott Cunningham, Katie McClure, Sally Harkness

Research output: Contribution to journalArticle

5 Citations (Scopus)

Abstract

Objective. To develop and validate an assessment tool, based on the ‘Royal College of General Practitioners’ (RCGP) Video Assessment Tool’, for assessment of pharmacist prescribers’ consultation skills.

Methods. Competency areas of the RCGP tool were left unchanged but performance criteria for each were modified to reflect pharmacist prescribing. Each criterion and the overall consultation were rated from 1 (poor) to 5 (excellent).

A purposive sample of 10 experienced prescribing pharmacists was selected. Each pharmacist identified, recruited and consented two patients. Video recordings of consultations were assessed independently by two randomly assigned GPs, experienced in the use of the RCGP tool, using the newly developed scale. Inter-rater reliability was assessed. Construct validity was assessed by comparing the assessor score with a patient satisfaction score. Spearman's rho was used to test the correlation between the two scores.

Results. The RCGP tool was modified to give the ‘Pharmacist Consultation Assessment Tool’ (PharmaCAT). The median overall PharmaCAT consultation rating was 3. There was good agreement between the two assessors for total scores (intraclass correlation coefficient = 0.694).

Fourteen (78%) patient satisfaction questionnaires were returned; most (n = 13, 93%) agreed/strongly agreed that they were entirely satisfied with the consultation. Correlations between average total scores on PharmaCAT and the patient satisfaction questionnaire were weak (Spearman's rho = 0.142 and 0.242 for both assessors).

Conclusions. The PharmaCAT has been tested in the pharmacist prescriber setting. The tool had discriminatory power across different domains and inter-rater reliability. The PharmaCAT has potential to be used as a formative and/or summative assessment tool.
Original languageEnglish
Pages (from-to)520-526
Number of pages7
JournalFamily Practice
Volume27
Issue number5
Early online date7 Jun 2010
DOIs
Publication statusPublished - Oct 2010

Fingerprint

Pharmacists
Referral and Consultation
General Practitioners
Patient Satisfaction
Video Recording

Keywords

  • communication skills
  • consultation
  • pharmacy
  • prescribing

Cite this

Developing and validating a tool for assessment of pharmacist prescribers' consultations. / Stewart, Derek (Corresponding Author); George, Johnson; Bond, Christine; Diack, Lesley; Cleland, Jen; McCaig, Dorothy; Cunningham, Scott; McClure, Katie; Harkness, Sally.

In: Family Practice, Vol. 27, No. 5, 10.2010, p. 520-526.

Research output: Contribution to journalArticle

Stewart, D, George, J, Bond, C, Diack, L, Cleland, J, McCaig, D, Cunningham, S, McClure, K & Harkness, S 2010, 'Developing and validating a tool for assessment of pharmacist prescribers' consultations', Family Practice, vol. 27, no. 5, pp. 520-526. https://doi.org/10.1093/fampra/cmq034
Stewart, Derek ; George, Johnson ; Bond, Christine ; Diack, Lesley ; Cleland, Jen ; McCaig, Dorothy ; Cunningham, Scott ; McClure, Katie ; Harkness, Sally. / Developing and validating a tool for assessment of pharmacist prescribers' consultations. In: Family Practice. 2010 ; Vol. 27, No. 5. pp. 520-526.
@article{8a55d32e95a942659e81c6e2bb26dc34,
title = "Developing and validating a tool for assessment of pharmacist prescribers' consultations",
abstract = "Objective. To develop and validate an assessment tool, based on the ‘Royal College of General Practitioners’ (RCGP) Video Assessment Tool’, for assessment of pharmacist prescribers’ consultation skills.Methods. Competency areas of the RCGP tool were left unchanged but performance criteria for each were modified to reflect pharmacist prescribing. Each criterion and the overall consultation were rated from 1 (poor) to 5 (excellent).A purposive sample of 10 experienced prescribing pharmacists was selected. Each pharmacist identified, recruited and consented two patients. Video recordings of consultations were assessed independently by two randomly assigned GPs, experienced in the use of the RCGP tool, using the newly developed scale. Inter-rater reliability was assessed. Construct validity was assessed by comparing the assessor score with a patient satisfaction score. Spearman's rho was used to test the correlation between the two scores.Results. The RCGP tool was modified to give the ‘Pharmacist Consultation Assessment Tool’ (PharmaCAT). The median overall PharmaCAT consultation rating was 3. There was good agreement between the two assessors for total scores (intraclass correlation coefficient = 0.694).Fourteen (78{\%}) patient satisfaction questionnaires were returned; most (n = 13, 93{\%}) agreed/strongly agreed that they were entirely satisfied with the consultation. Correlations between average total scores on PharmaCAT and the patient satisfaction questionnaire were weak (Spearman's rho = 0.142 and 0.242 for both assessors).Conclusions. The PharmaCAT has been tested in the pharmacist prescriber setting. The tool had discriminatory power across different domains and inter-rater reliability. The PharmaCAT has potential to be used as a formative and/or summative assessment tool.",
keywords = "communication skills, consultation, pharmacy, prescribing",
author = "Derek Stewart and Johnson George and Christine Bond and Lesley Diack and Jen Cleland and Dorothy McCaig and Scott Cunningham and Katie McClure and Sally Harkness",
year = "2010",
month = "10",
doi = "10.1093/fampra/cmq034",
language = "English",
volume = "27",
pages = "520--526",
journal = "Family Practice",
issn = "0263-2136",
publisher = "Oxford University Press",
number = "5",

}

TY - JOUR

T1 - Developing and validating a tool for assessment of pharmacist prescribers' consultations

AU - Stewart, Derek

AU - George, Johnson

AU - Bond, Christine

AU - Diack, Lesley

AU - Cleland, Jen

AU - McCaig, Dorothy

AU - Cunningham, Scott

AU - McClure, Katie

AU - Harkness, Sally

PY - 2010/10

Y1 - 2010/10

N2 - Objective. To develop and validate an assessment tool, based on the ‘Royal College of General Practitioners’ (RCGP) Video Assessment Tool’, for assessment of pharmacist prescribers’ consultation skills.Methods. Competency areas of the RCGP tool were left unchanged but performance criteria for each were modified to reflect pharmacist prescribing. Each criterion and the overall consultation were rated from 1 (poor) to 5 (excellent).A purposive sample of 10 experienced prescribing pharmacists was selected. Each pharmacist identified, recruited and consented two patients. Video recordings of consultations were assessed independently by two randomly assigned GPs, experienced in the use of the RCGP tool, using the newly developed scale. Inter-rater reliability was assessed. Construct validity was assessed by comparing the assessor score with a patient satisfaction score. Spearman's rho was used to test the correlation between the two scores.Results. The RCGP tool was modified to give the ‘Pharmacist Consultation Assessment Tool’ (PharmaCAT). The median overall PharmaCAT consultation rating was 3. There was good agreement between the two assessors for total scores (intraclass correlation coefficient = 0.694).Fourteen (78%) patient satisfaction questionnaires were returned; most (n = 13, 93%) agreed/strongly agreed that they were entirely satisfied with the consultation. Correlations between average total scores on PharmaCAT and the patient satisfaction questionnaire were weak (Spearman's rho = 0.142 and 0.242 for both assessors).Conclusions. The PharmaCAT has been tested in the pharmacist prescriber setting. The tool had discriminatory power across different domains and inter-rater reliability. The PharmaCAT has potential to be used as a formative and/or summative assessment tool.

AB - Objective. To develop and validate an assessment tool, based on the ‘Royal College of General Practitioners’ (RCGP) Video Assessment Tool’, for assessment of pharmacist prescribers’ consultation skills.Methods. Competency areas of the RCGP tool were left unchanged but performance criteria for each were modified to reflect pharmacist prescribing. Each criterion and the overall consultation were rated from 1 (poor) to 5 (excellent).A purposive sample of 10 experienced prescribing pharmacists was selected. Each pharmacist identified, recruited and consented two patients. Video recordings of consultations were assessed independently by two randomly assigned GPs, experienced in the use of the RCGP tool, using the newly developed scale. Inter-rater reliability was assessed. Construct validity was assessed by comparing the assessor score with a patient satisfaction score. Spearman's rho was used to test the correlation between the two scores.Results. The RCGP tool was modified to give the ‘Pharmacist Consultation Assessment Tool’ (PharmaCAT). The median overall PharmaCAT consultation rating was 3. There was good agreement between the two assessors for total scores (intraclass correlation coefficient = 0.694).Fourteen (78%) patient satisfaction questionnaires were returned; most (n = 13, 93%) agreed/strongly agreed that they were entirely satisfied with the consultation. Correlations between average total scores on PharmaCAT and the patient satisfaction questionnaire were weak (Spearman's rho = 0.142 and 0.242 for both assessors).Conclusions. The PharmaCAT has been tested in the pharmacist prescriber setting. The tool had discriminatory power across different domains and inter-rater reliability. The PharmaCAT has potential to be used as a formative and/or summative assessment tool.

KW - communication skills

KW - consultation

KW - pharmacy

KW - prescribing

U2 - 10.1093/fampra/cmq034

DO - 10.1093/fampra/cmq034

M3 - Article

VL - 27

SP - 520

EP - 526

JO - Family Practice

JF - Family Practice

SN - 0263-2136

IS - 5

ER -