Development of a rating system for surgeons' non-technical skills

Steven James Yule, Rhona Flin, S. Paterson-Brown, N. J. Maran, D. Rowley

Research output: Contribution to journalArticle

308 Citations (Scopus)

Abstract

BACKGROUND Analyses of adverse events in surgery reveal that many underlying causes are behavioural, such as communication failure, rather than technical. Non-technical (i.e. cognitive and interpersonal) skills are not addressed explicitly in surgical training. However, surgeons need to demonstrate these skills, which underpin their technical excellence, to maximise patient safety in the operating theatre. This paper describes the method used to identify surgeons' non-technical skills, and the development of a skills taxonomy and behavioural rating system to structure observation and feedback in surgical training.

METHODS Cognitive task analyses (critical incident interviews) were conducted with 27 consultant surgeons in general, cardiac and orthopaedic surgery. The interviews were coded and a multidisciplinary group of surgeons and psychologists used an iterative process to develop a skills taxonomy. This was supported by data gathered from an attitude survey, literature review, analysis of surgical mortality reports and observations in theatre.

RESULTS Five categories of non-technical skills were identified, including situation awareness, decision making, task management, leadership and communication and teamwork. This provided a structure for a prototype skill taxonomy (v1.1), which comprised 14 non-technical skill elements. Observable behaviours (markers) indicative of good and poor performance were developed for each element by 16 consultant surgeons to form a prototype behaviour rating system.

CONCLUSIONS The prototype skills taxonomy and behaviour rating system are grounded empirically in surgery. The reliability of the system is currently being tested using standardised scenarios. If this evaluation proves successful, the system could be used to structure feedback and guide non-technical skills training.

Original languageEnglish
Pages (from-to)1098-1104
Number of pages6
JournalMedical Education
Volume40
Issue number11
Early online date22 Mar 2006
DOIs
Publication statusPublished - Nov 2006

Keywords

  • surgery, education
  • professional practice, standards
  • task performance and analysis
  • interprofessional relations
  • consultants
  • Scotland
  • medical staff, hospital, standards
  • multicenter study [publication type]

Cite this

Development of a rating system for surgeons' non-technical skills. / Yule, Steven James; Flin, Rhona; Paterson-Brown, S.; Maran, N. J.; Rowley, D.

In: Medical Education, Vol. 40, No. 11, 11.2006, p. 1098-1104.

Research output: Contribution to journalArticle

Yule, SJ, Flin, R, Paterson-Brown, S, Maran, NJ & Rowley, D 2006, 'Development of a rating system for surgeons' non-technical skills', Medical Education, vol. 40, no. 11, pp. 1098-1104. https://doi.org/10.1111/J.1365-2929.2006.02610.X
Yule, Steven James ; Flin, Rhona ; Paterson-Brown, S. ; Maran, N. J. ; Rowley, D. / Development of a rating system for surgeons' non-technical skills. In: Medical Education. 2006 ; Vol. 40, No. 11. pp. 1098-1104.
@article{83867d9b1e6c44e989d7c17d583c8902,
title = "Development of a rating system for surgeons' non-technical skills",
abstract = "BACKGROUND Analyses of adverse events in surgery reveal that many underlying causes are behavioural, such as communication failure, rather than technical. Non-technical (i.e. cognitive and interpersonal) skills are not addressed explicitly in surgical training. However, surgeons need to demonstrate these skills, which underpin their technical excellence, to maximise patient safety in the operating theatre. This paper describes the method used to identify surgeons' non-technical skills, and the development of a skills taxonomy and behavioural rating system to structure observation and feedback in surgical training.METHODS Cognitive task analyses (critical incident interviews) were conducted with 27 consultant surgeons in general, cardiac and orthopaedic surgery. The interviews were coded and a multidisciplinary group of surgeons and psychologists used an iterative process to develop a skills taxonomy. This was supported by data gathered from an attitude survey, literature review, analysis of surgical mortality reports and observations in theatre.RESULTS Five categories of non-technical skills were identified, including situation awareness, decision making, task management, leadership and communication and teamwork. This provided a structure for a prototype skill taxonomy (v1.1), which comprised 14 non-technical skill elements. Observable behaviours (markers) indicative of good and poor performance were developed for each element by 16 consultant surgeons to form a prototype behaviour rating system.CONCLUSIONS The prototype skills taxonomy and behaviour rating system are grounded empirically in surgery. The reliability of the system is currently being tested using standardised scenarios. If this evaluation proves successful, the system could be used to structure feedback and guide non-technical skills training.",
keywords = "surgery, education, professional practice, standards, task performance and analysis, interprofessional relations, consultants, Scotland, medical staff, hospital, standards, multicenter study [publication type]",
author = "Yule, {Steven James} and Rhona Flin and S. Paterson-Brown and Maran, {N. J.} and D. Rowley",
year = "2006",
month = "11",
doi = "10.1111/J.1365-2929.2006.02610.X",
language = "English",
volume = "40",
pages = "1098--1104",
journal = "Medical Education",
issn = "0308-0110",
publisher = "WILEY-BLACKWELL",
number = "11",

}

TY - JOUR

T1 - Development of a rating system for surgeons' non-technical skills

AU - Yule, Steven James

AU - Flin, Rhona

AU - Paterson-Brown, S.

AU - Maran, N. J.

AU - Rowley, D.

PY - 2006/11

Y1 - 2006/11

N2 - BACKGROUND Analyses of adverse events in surgery reveal that many underlying causes are behavioural, such as communication failure, rather than technical. Non-technical (i.e. cognitive and interpersonal) skills are not addressed explicitly in surgical training. However, surgeons need to demonstrate these skills, which underpin their technical excellence, to maximise patient safety in the operating theatre. This paper describes the method used to identify surgeons' non-technical skills, and the development of a skills taxonomy and behavioural rating system to structure observation and feedback in surgical training.METHODS Cognitive task analyses (critical incident interviews) were conducted with 27 consultant surgeons in general, cardiac and orthopaedic surgery. The interviews were coded and a multidisciplinary group of surgeons and psychologists used an iterative process to develop a skills taxonomy. This was supported by data gathered from an attitude survey, literature review, analysis of surgical mortality reports and observations in theatre.RESULTS Five categories of non-technical skills were identified, including situation awareness, decision making, task management, leadership and communication and teamwork. This provided a structure for a prototype skill taxonomy (v1.1), which comprised 14 non-technical skill elements. Observable behaviours (markers) indicative of good and poor performance were developed for each element by 16 consultant surgeons to form a prototype behaviour rating system.CONCLUSIONS The prototype skills taxonomy and behaviour rating system are grounded empirically in surgery. The reliability of the system is currently being tested using standardised scenarios. If this evaluation proves successful, the system could be used to structure feedback and guide non-technical skills training.

AB - BACKGROUND Analyses of adverse events in surgery reveal that many underlying causes are behavioural, such as communication failure, rather than technical. Non-technical (i.e. cognitive and interpersonal) skills are not addressed explicitly in surgical training. However, surgeons need to demonstrate these skills, which underpin their technical excellence, to maximise patient safety in the operating theatre. This paper describes the method used to identify surgeons' non-technical skills, and the development of a skills taxonomy and behavioural rating system to structure observation and feedback in surgical training.METHODS Cognitive task analyses (critical incident interviews) were conducted with 27 consultant surgeons in general, cardiac and orthopaedic surgery. The interviews were coded and a multidisciplinary group of surgeons and psychologists used an iterative process to develop a skills taxonomy. This was supported by data gathered from an attitude survey, literature review, analysis of surgical mortality reports and observations in theatre.RESULTS Five categories of non-technical skills were identified, including situation awareness, decision making, task management, leadership and communication and teamwork. This provided a structure for a prototype skill taxonomy (v1.1), which comprised 14 non-technical skill elements. Observable behaviours (markers) indicative of good and poor performance were developed for each element by 16 consultant surgeons to form a prototype behaviour rating system.CONCLUSIONS The prototype skills taxonomy and behaviour rating system are grounded empirically in surgery. The reliability of the system is currently being tested using standardised scenarios. If this evaluation proves successful, the system could be used to structure feedback and guide non-technical skills training.

KW - surgery, education

KW - professional practice, standards

KW - task performance and analysis

KW - interprofessional relations

KW - consultants

KW - Scotland

KW - medical staff, hospital, standards

KW - multicenter study [publication type]

U2 - 10.1111/J.1365-2929.2006.02610.X

DO - 10.1111/J.1365-2929.2006.02610.X

M3 - Article

VL - 40

SP - 1098

EP - 1104

JO - Medical Education

JF - Medical Education

SN - 0308-0110

IS - 11

ER -