Developing a method for evaluating crew resource management skills: A European perspective

P. O'Connor, J. J. Hormann, Rhona Flin, M. Lodge, K. Goeters, JARTEL Grp

Research output: Contribution to journalArticle

56 Citations (Scopus)

Abstract

The European Commission in conjunction with the European Joint Aviation Authorities (Human Factors Project Advisory Group) has been sponsoring a series of studies investigating a culturally robust method for the evaluation of pilots' nontechnical skills (NTS) for multicrew operations. This article outlines the development of a European NTS behavioral marker system for crew resource management evaluation called NOTECHS and presents preliminary results from an ongoing test phase of this system (Joint Aviation Requirements Translation and Elaboration of Legislation [JARTEL]). The JARTEL project has involved 105 instructors from 14 European airlines who were given a short training session to use the NOTECHS system. After the training phase, these instructor pilots used the system to evaluate the individual CRM skills of captains and first officers in 8 different video scenarios filmed in a Boeing 757 simulator. Issues relating to rater training, reliability, and accuracy, as well as the instructors' opinions on the acceptability of the method, are discussed.

Original languageEnglish
Pages (from-to)263-285
Number of pages22
JournalInternational Journal of Aviation Psychology
Volume12
Issue number3
DOIs
Publication statusPublished - Jul 2002

Keywords

  • INTERRATER

Cite this

Developing a method for evaluating crew resource management skills: A European perspective. / O'Connor, P.; Hormann, J. J.; Flin, Rhona; Lodge, M.; Goeters, K.; JARTEL Grp.

In: International Journal of Aviation Psychology, Vol. 12, No. 3, 07.2002, p. 263-285.

Research output: Contribution to journalArticle

O'Connor, P. ; Hormann, J. J. ; Flin, Rhona ; Lodge, M. ; Goeters, K. ; JARTEL Grp. / Developing a method for evaluating crew resource management skills: A European perspective. In: International Journal of Aviation Psychology. 2002 ; Vol. 12, No. 3. pp. 263-285.
@article{04b281946af6448cb80c41e258bf2148,
title = "Developing a method for evaluating crew resource management skills: A European perspective",
abstract = "The European Commission in conjunction with the European Joint Aviation Authorities (Human Factors Project Advisory Group) has been sponsoring a series of studies investigating a culturally robust method for the evaluation of pilots' nontechnical skills (NTS) for multicrew operations. This article outlines the development of a European NTS behavioral marker system for crew resource management evaluation called NOTECHS and presents preliminary results from an ongoing test phase of this system (Joint Aviation Requirements Translation and Elaboration of Legislation [JARTEL]). The JARTEL project has involved 105 instructors from 14 European airlines who were given a short training session to use the NOTECHS system. After the training phase, these instructor pilots used the system to evaluate the individual CRM skills of captains and first officers in 8 different video scenarios filmed in a Boeing 757 simulator. Issues relating to rater training, reliability, and accuracy, as well as the instructors' opinions on the acceptability of the method, are discussed.",
keywords = "INTERRATER",
author = "P. O'Connor and Hormann, {J. J.} and Rhona Flin and M. Lodge and K. Goeters and {JARTEL Grp}",
year = "2002",
month = "7",
doi = "10.1207/S15327108IJAP1203_5",
language = "English",
volume = "12",
pages = "263--285",
journal = "International Journal of Aviation Psychology",
issn = "1050-8414",
publisher = "Taylor and Francis Ltd.",
number = "3",

}

TY - JOUR

T1 - Developing a method for evaluating crew resource management skills: A European perspective

AU - O'Connor, P.

AU - Hormann, J. J.

AU - Flin, Rhona

AU - Lodge, M.

AU - Goeters, K.

AU - JARTEL Grp

PY - 2002/7

Y1 - 2002/7

N2 - The European Commission in conjunction with the European Joint Aviation Authorities (Human Factors Project Advisory Group) has been sponsoring a series of studies investigating a culturally robust method for the evaluation of pilots' nontechnical skills (NTS) for multicrew operations. This article outlines the development of a European NTS behavioral marker system for crew resource management evaluation called NOTECHS and presents preliminary results from an ongoing test phase of this system (Joint Aviation Requirements Translation and Elaboration of Legislation [JARTEL]). The JARTEL project has involved 105 instructors from 14 European airlines who were given a short training session to use the NOTECHS system. After the training phase, these instructor pilots used the system to evaluate the individual CRM skills of captains and first officers in 8 different video scenarios filmed in a Boeing 757 simulator. Issues relating to rater training, reliability, and accuracy, as well as the instructors' opinions on the acceptability of the method, are discussed.

AB - The European Commission in conjunction with the European Joint Aviation Authorities (Human Factors Project Advisory Group) has been sponsoring a series of studies investigating a culturally robust method for the evaluation of pilots' nontechnical skills (NTS) for multicrew operations. This article outlines the development of a European NTS behavioral marker system for crew resource management evaluation called NOTECHS and presents preliminary results from an ongoing test phase of this system (Joint Aviation Requirements Translation and Elaboration of Legislation [JARTEL]). The JARTEL project has involved 105 instructors from 14 European airlines who were given a short training session to use the NOTECHS system. After the training phase, these instructor pilots used the system to evaluate the individual CRM skills of captains and first officers in 8 different video scenarios filmed in a Boeing 757 simulator. Issues relating to rater training, reliability, and accuracy, as well as the instructors' opinions on the acceptability of the method, are discussed.

KW - INTERRATER

U2 - 10.1207/S15327108IJAP1203_5

DO - 10.1207/S15327108IJAP1203_5

M3 - Article

VL - 12

SP - 263

EP - 285

JO - International Journal of Aviation Psychology

JF - International Journal of Aviation Psychology

SN - 1050-8414

IS - 3

ER -