Experience matters

Steven James Yule, David Rowley, Rhona Flin, Nikki Maran, George Youngson, John Duncan, Simon Paterson-Brown

Research output: Contribution to journalArticle

64 Citations (Scopus)

Abstract

There is growing evidence that non-technical skills (NTS) are related to surgical outcomes and patient safety. The aim of this study was to further evaluate a behaviour rating system (NOTSS: Non-Technical Skills for Surgeons) which can be used for workplace assessment of the cognitive and social skills which are essential components of NTS. A novice group composed of consultant surgeons (n = 44) from five Scottish hospitals attended one of six experimental sessions and were trained to use the NOTSS system. They then used NOTSS to rate surgeons' behaviors in six simulated scenarios filmed in the operating room. The behaviours demonstrated in each scenario were compared to expert ratings to determine accuracy. The mode rating from the novice group (who received a short training session in behaviour assessment) was the same as the expert group in 50% of ratings. Where there was disagreement, novice raters tended to provide lower ratings than the experts. Novice raters require significant training in this emerging area of competence in order to accurately rate non-technical skills.

Original languageEnglish
Pages (from-to)154-160
Number of pages7
JournalANZ Journal of Surgery
Volume79
Issue number3
DOIs
Publication statusPublished - Mar 2009

Keywords

  • behaviour rating
  • non-technical skill
  • patient safety
  • surgical skill
  • workplace assessment
  • operating-room
  • surgeons
  • reliability
  • performance
  • teams

Cite this

Yule, S. J., Rowley, D., Flin, R., Maran, N., Youngson, G., Duncan, J., & Paterson-Brown, S. (2009). Experience matters. ANZ Journal of Surgery, 79(3), 154-160. https://doi.org/10.1111/j.1445-2197.2008.04833.x

Experience matters. / Yule, Steven James; Rowley, David; Flin, Rhona; Maran, Nikki; Youngson, George; Duncan, John ; Paterson-Brown, Simon.

In: ANZ Journal of Surgery, Vol. 79, No. 3, 03.2009, p. 154-160.

Research output: Contribution to journalArticle

Yule, SJ, Rowley, D, Flin, R, Maran, N, Youngson, G, Duncan, J & Paterson-Brown, S 2009, 'Experience matters', ANZ Journal of Surgery, vol. 79, no. 3, pp. 154-160. https://doi.org/10.1111/j.1445-2197.2008.04833.x
Yule SJ, Rowley D, Flin R, Maran N, Youngson G, Duncan J et al. Experience matters. ANZ Journal of Surgery. 2009 Mar;79(3):154-160. https://doi.org/10.1111/j.1445-2197.2008.04833.x
Yule, Steven James ; Rowley, David ; Flin, Rhona ; Maran, Nikki ; Youngson, George ; Duncan, John ; Paterson-Brown, Simon. / Experience matters. In: ANZ Journal of Surgery. 2009 ; Vol. 79, No. 3. pp. 154-160.
@article{d06b5253a0c24b60b5f75a39c18d3065,
title = "Experience matters",
abstract = "There is growing evidence that non-technical skills (NTS) are related to surgical outcomes and patient safety. The aim of this study was to further evaluate a behaviour rating system (NOTSS: Non-Technical Skills for Surgeons) which can be used for workplace assessment of the cognitive and social skills which are essential components of NTS. A novice group composed of consultant surgeons (n = 44) from five Scottish hospitals attended one of six experimental sessions and were trained to use the NOTSS system. They then used NOTSS to rate surgeons' behaviors in six simulated scenarios filmed in the operating room. The behaviours demonstrated in each scenario were compared to expert ratings to determine accuracy. The mode rating from the novice group (who received a short training session in behaviour assessment) was the same as the expert group in 50{\%} of ratings. Where there was disagreement, novice raters tended to provide lower ratings than the experts. Novice raters require significant training in this emerging area of competence in order to accurately rate non-technical skills.",
keywords = "behaviour rating, non-technical skill, patient safety, surgical skill, workplace assessment, operating-room, surgeons, reliability, performance, teams",
author = "Yule, {Steven James} and David Rowley and Rhona Flin and Nikki Maran and George Youngson and John Duncan and Simon Paterson-Brown",
year = "2009",
month = "3",
doi = "10.1111/j.1445-2197.2008.04833.x",
language = "English",
volume = "79",
pages = "154--160",
journal = "ANZ Journal of Surgery",
issn = "1445-1433",
publisher = "Wiley-Blackwell",
number = "3",

}

TY - JOUR

T1 - Experience matters

AU - Yule, Steven James

AU - Rowley, David

AU - Flin, Rhona

AU - Maran, Nikki

AU - Youngson, George

AU - Duncan, John

AU - Paterson-Brown, Simon

PY - 2009/3

Y1 - 2009/3

N2 - There is growing evidence that non-technical skills (NTS) are related to surgical outcomes and patient safety. The aim of this study was to further evaluate a behaviour rating system (NOTSS: Non-Technical Skills for Surgeons) which can be used for workplace assessment of the cognitive and social skills which are essential components of NTS. A novice group composed of consultant surgeons (n = 44) from five Scottish hospitals attended one of six experimental sessions and were trained to use the NOTSS system. They then used NOTSS to rate surgeons' behaviors in six simulated scenarios filmed in the operating room. The behaviours demonstrated in each scenario were compared to expert ratings to determine accuracy. The mode rating from the novice group (who received a short training session in behaviour assessment) was the same as the expert group in 50% of ratings. Where there was disagreement, novice raters tended to provide lower ratings than the experts. Novice raters require significant training in this emerging area of competence in order to accurately rate non-technical skills.

AB - There is growing evidence that non-technical skills (NTS) are related to surgical outcomes and patient safety. The aim of this study was to further evaluate a behaviour rating system (NOTSS: Non-Technical Skills for Surgeons) which can be used for workplace assessment of the cognitive and social skills which are essential components of NTS. A novice group composed of consultant surgeons (n = 44) from five Scottish hospitals attended one of six experimental sessions and were trained to use the NOTSS system. They then used NOTSS to rate surgeons' behaviors in six simulated scenarios filmed in the operating room. The behaviours demonstrated in each scenario were compared to expert ratings to determine accuracy. The mode rating from the novice group (who received a short training session in behaviour assessment) was the same as the expert group in 50% of ratings. Where there was disagreement, novice raters tended to provide lower ratings than the experts. Novice raters require significant training in this emerging area of competence in order to accurately rate non-technical skills.

KW - behaviour rating

KW - non-technical skill

KW - patient safety

KW - surgical skill

KW - workplace assessment

KW - operating-room

KW - surgeons

KW - reliability

KW - performance

KW - teams

U2 - 10.1111/j.1445-2197.2008.04833.x

DO - 10.1111/j.1445-2197.2008.04833.x

M3 - Article

VL - 79

SP - 154

EP - 160

JO - ANZ Journal of Surgery

JF - ANZ Journal of Surgery

SN - 1445-1433

IS - 3

ER -