Does the Intercollegiate Membership of the Royal College of Surgeons (MRCS) examination predict 'on-the-job' performance during UK higher specialty surgical training?

DSG Scrimgeour, P A Brennan, G Griffiths, A J Lee, FCT Smith, J Cleland

Research output: Contribution to journalArticle

Abstract

INTRODUCTION: The Intercollegiate Membership of the Royal College of Surgeons (MRCS) is a mandatory examination to enter higher surgical specialty training in the UK. It is designed to help to ensure that successful candidates are competent to practice as higher surgical trainees. The annual review of competence progression (ARCP) assesses trainees' competence to progress to the next level of training and can be interpreted as a measure of 'on-the-job' performance. We investigated the relationship between MRCS performance and ARCP outcomes.

MATERIALS AND METHODS: All UK medical graduates who passed MRCS (Parts A and B) from 2007 to 2016 were included. MRCS scores, attempts and sociodemographics for each candidate were crosslinked with ARCP outcomes (satisfactory, unsatisfactory and insufficient evidence). Multinomial logistic regression was used to identify potential independent predictors of ARCP outcomes.

RESULTS: A total of 2570 trainees underwent 11,064 ARCPs; 1589 (61.8%) had only satisfactory outcomes recorded throughout training; 510 (19.9%) had at least one unsatisfactory outcome; and 471 (18.3%) supplied insufficient evidence. After adjusting for age, gender, first language and Part A performance, ethnicity (non-white vs white, OR 1.36, 95% CI 1.08 to 1.71), Part B passing score (OR 0.98, 95% CI 0.98 to 1.00) and number of attempts at Part B (two or more attempts vs one attempt, OR 1.50, 95% CI 1.16 to 1.94) were found to be independent predictors of an unsatisfactory ARCP outcome.

CONCLUSIONS: This is the first study to identify predictors of ARCP outcomes during higher surgical specialty training in the UK and provides further evidence of the predictive validity of the MRCS examination.

Original languageEnglish
Pages (from-to)669-675
Number of pages7
JournalAnnals of the Royal College of Surgeons of England
Volume100
Issue number8
Early online date5 Oct 2018
DOIs
Publication statusPublished - 8 Nov 2018

Fingerprint

Surgical Specialties
Mental Competency
Surgeons
Work Performance
Language
Logistic Models

Keywords

  • ARCP
  • MRCS
  • clinical performance
  • predictive validity

Cite this

@article{04cb8203dd6a41b6ac92f82804ac4910,
title = "Does the Intercollegiate Membership of the Royal College of Surgeons (MRCS) examination predict 'on-the-job' performance during UK higher specialty surgical training?",
abstract = "INTRODUCTION: The Intercollegiate Membership of the Royal College of Surgeons (MRCS) is a mandatory examination to enter higher surgical specialty training in the UK. It is designed to help to ensure that successful candidates are competent to practice as higher surgical trainees. The annual review of competence progression (ARCP) assesses trainees' competence to progress to the next level of training and can be interpreted as a measure of 'on-the-job' performance. We investigated the relationship between MRCS performance and ARCP outcomes.MATERIALS AND METHODS: All UK medical graduates who passed MRCS (Parts A and B) from 2007 to 2016 were included. MRCS scores, attempts and sociodemographics for each candidate were crosslinked with ARCP outcomes (satisfactory, unsatisfactory and insufficient evidence). Multinomial logistic regression was used to identify potential independent predictors of ARCP outcomes.RESULTS: A total of 2570 trainees underwent 11,064 ARCPs; 1589 (61.8{\%}) had only satisfactory outcomes recorded throughout training; 510 (19.9{\%}) had at least one unsatisfactory outcome; and 471 (18.3{\%}) supplied insufficient evidence. After adjusting for age, gender, first language and Part A performance, ethnicity (non-white vs white, OR 1.36, 95{\%} CI 1.08 to 1.71), Part B passing score (OR 0.98, 95{\%} CI 0.98 to 1.00) and number of attempts at Part B (two or more attempts vs one attempt, OR 1.50, 95{\%} CI 1.16 to 1.94) were found to be independent predictors of an unsatisfactory ARCP outcome.CONCLUSIONS: This is the first study to identify predictors of ARCP outcomes during higher surgical specialty training in the UK and provides further evidence of the predictive validity of the MRCS examination.",
keywords = "ARCP, MRCS, clinical performance, predictive validity",
author = "DSG Scrimgeour and Brennan, {P A} and G Griffiths and Lee, {A J} and FCT Smith and J Cleland",
note = "Deposit in Pubmed after 12 month embargo PMCID: PMC6204508 [Available on 2019-11-01]",
year = "2018",
month = "11",
day = "8",
doi = "10.1308/rcsann.2018.0153",
language = "English",
volume = "100",
pages = "669--675",
journal = "Annals of the Royal College of Surgeons of England",
issn = "0035-8843",
publisher = "Royal College of Surgeons of England",
number = "8",

}

TY - JOUR

T1 - Does the Intercollegiate Membership of the Royal College of Surgeons (MRCS) examination predict 'on-the-job' performance during UK higher specialty surgical training?

AU - Scrimgeour, DSG

AU - Brennan, P A

AU - Griffiths, G

AU - Lee, A J

AU - Smith, FCT

AU - Cleland, J

N1 - Deposit in Pubmed after 12 month embargo PMCID: PMC6204508 [Available on 2019-11-01]

PY - 2018/11/8

Y1 - 2018/11/8

N2 - INTRODUCTION: The Intercollegiate Membership of the Royal College of Surgeons (MRCS) is a mandatory examination to enter higher surgical specialty training in the UK. It is designed to help to ensure that successful candidates are competent to practice as higher surgical trainees. The annual review of competence progression (ARCP) assesses trainees' competence to progress to the next level of training and can be interpreted as a measure of 'on-the-job' performance. We investigated the relationship between MRCS performance and ARCP outcomes.MATERIALS AND METHODS: All UK medical graduates who passed MRCS (Parts A and B) from 2007 to 2016 were included. MRCS scores, attempts and sociodemographics for each candidate were crosslinked with ARCP outcomes (satisfactory, unsatisfactory and insufficient evidence). Multinomial logistic regression was used to identify potential independent predictors of ARCP outcomes.RESULTS: A total of 2570 trainees underwent 11,064 ARCPs; 1589 (61.8%) had only satisfactory outcomes recorded throughout training; 510 (19.9%) had at least one unsatisfactory outcome; and 471 (18.3%) supplied insufficient evidence. After adjusting for age, gender, first language and Part A performance, ethnicity (non-white vs white, OR 1.36, 95% CI 1.08 to 1.71), Part B passing score (OR 0.98, 95% CI 0.98 to 1.00) and number of attempts at Part B (two or more attempts vs one attempt, OR 1.50, 95% CI 1.16 to 1.94) were found to be independent predictors of an unsatisfactory ARCP outcome.CONCLUSIONS: This is the first study to identify predictors of ARCP outcomes during higher surgical specialty training in the UK and provides further evidence of the predictive validity of the MRCS examination.

AB - INTRODUCTION: The Intercollegiate Membership of the Royal College of Surgeons (MRCS) is a mandatory examination to enter higher surgical specialty training in the UK. It is designed to help to ensure that successful candidates are competent to practice as higher surgical trainees. The annual review of competence progression (ARCP) assesses trainees' competence to progress to the next level of training and can be interpreted as a measure of 'on-the-job' performance. We investigated the relationship between MRCS performance and ARCP outcomes.MATERIALS AND METHODS: All UK medical graduates who passed MRCS (Parts A and B) from 2007 to 2016 were included. MRCS scores, attempts and sociodemographics for each candidate were crosslinked with ARCP outcomes (satisfactory, unsatisfactory and insufficient evidence). Multinomial logistic regression was used to identify potential independent predictors of ARCP outcomes.RESULTS: A total of 2570 trainees underwent 11,064 ARCPs; 1589 (61.8%) had only satisfactory outcomes recorded throughout training; 510 (19.9%) had at least one unsatisfactory outcome; and 471 (18.3%) supplied insufficient evidence. After adjusting for age, gender, first language and Part A performance, ethnicity (non-white vs white, OR 1.36, 95% CI 1.08 to 1.71), Part B passing score (OR 0.98, 95% CI 0.98 to 1.00) and number of attempts at Part B (two or more attempts vs one attempt, OR 1.50, 95% CI 1.16 to 1.94) were found to be independent predictors of an unsatisfactory ARCP outcome.CONCLUSIONS: This is the first study to identify predictors of ARCP outcomes during higher surgical specialty training in the UK and provides further evidence of the predictive validity of the MRCS examination.

KW - ARCP

KW - MRCS

KW - clinical performance

KW - predictive validity

U2 - 10.1308/rcsann.2018.0153

DO - 10.1308/rcsann.2018.0153

M3 - Article

VL - 100

SP - 669

EP - 675

JO - Annals of the Royal College of Surgeons of England

JF - Annals of the Royal College of Surgeons of England

SN - 0035-8843

IS - 8

ER -