Behavioural Rating of Drillers' Cognitive Skills

Ruby Clyde Roberts, Rhona Flin

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Abstract Objectives/Scope
Large scale drilling disasters, such as Macondo and Montara, as well as recent industry guidelines (e.g. IOGP, 2014) have highlighted the importance of non-technical skills, including Situation Awareness (SA) and Decision Making (DM). Behavioural marker systems have been used in other high risk domains to assess and train non-technical skills. Offshore drillers’ ability to maintain high level SA of the well state and surrounding environment is essential for effective DM. The objective of this study was to develop an evidence–based behavioural rating tool for drillers’ SA and DM.

Methods, Procedure, Process
The Cognitive Task Analysis (CTA) techniques of interviews, observations and video analysis as well as an accident analysis, extracted expert knowledge about a driller's SA and DM, to produce preliminary skills taxonomy. The cognitive elements and exemplar behaviours were refined by a review panel and an online survey was then conducted with 15 drilling personnel to further refine and validate the behaviours.

Results, Observations, Conclusions
A refined taxonomy was produced including the key SA and DM skills, as well as observable examples of good and poor behavioural (markers). Three SA skills were identified: (1) gathers information, (2) understands the well and situation and (3) anticipates how the situation may develop in the future. Three DM skills were identified: (1) identifies and discusses options, (2) selects an option, as well as implements it and (3) reviews the decision taken. A further category of Maintains Own Abilities was identified as being important (e.g. removes distractions). The online evaluation suggested that the identified skills were relevant for maintaining safety and performance. Consequently, the skills taxonomy has the potential to be highly beneficial for assisting training and assessment, particularly when used in conjunction with a rating system.

Novel/Additive Information
Whilst the increase in simulation facilities and non-technical skills is welcomed, to maximise training effectiveness, tools need to be evidence based. This empirical, domain specific taxonomy/tool has direct applications for formative assessment and assisting training in simulated environments so as to improve safety and performance in drilling. Further development of similar non-technical skills sets will facilitate industry standard training and assessment tools to enhance efficiency and safety
Original languageEnglish
Title of host publicationSPE International Conference and Exhibition on Health, Safety, Security, Environment, and Social Responsibility, 11-13 April, Stavanger, Norway
PublisherSociety of Petroleum Engineers (SPE)
Pages1
Number of pages12
VolumeSPE-179270-MS
DOIs
Publication statusPublished - 2016

Fingerprint

Decision making
Taxonomies
Drilling
Personnel rating
Disasters
Industry
Accidents
Personnel

Cite this

Roberts, R. C., & Flin, R. (2016). Behavioural Rating of Drillers' Cognitive Skills. In SPE International Conference and Exhibition on Health, Safety, Security, Environment, and Social Responsibility, 11-13 April, Stavanger, Norway (Vol. SPE-179270-MS, pp. 1). Society of Petroleum Engineers (SPE). https://doi.org/10.2118/179270-MS

Behavioural Rating of Drillers' Cognitive Skills. / Roberts, Ruby Clyde; Flin, Rhona.

SPE International Conference and Exhibition on Health, Safety, Security, Environment, and Social Responsibility, 11-13 April, Stavanger, Norway. Vol. SPE-179270-MS Society of Petroleum Engineers (SPE), 2016. p. 1.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Roberts, RC & Flin, R 2016, Behavioural Rating of Drillers' Cognitive Skills. in SPE International Conference and Exhibition on Health, Safety, Security, Environment, and Social Responsibility, 11-13 April, Stavanger, Norway. vol. SPE-179270-MS, Society of Petroleum Engineers (SPE), pp. 1. https://doi.org/10.2118/179270-MS
Roberts RC, Flin R. Behavioural Rating of Drillers' Cognitive Skills. In SPE International Conference and Exhibition on Health, Safety, Security, Environment, and Social Responsibility, 11-13 April, Stavanger, Norway. Vol. SPE-179270-MS. Society of Petroleum Engineers (SPE). 2016. p. 1 https://doi.org/10.2118/179270-MS
Roberts, Ruby Clyde ; Flin, Rhona. / Behavioural Rating of Drillers' Cognitive Skills. SPE International Conference and Exhibition on Health, Safety, Security, Environment, and Social Responsibility, 11-13 April, Stavanger, Norway. Vol. SPE-179270-MS Society of Petroleum Engineers (SPE), 2016. pp. 1
@inproceedings{8b62e66d66964af58cec852f72b2024a,
title = "Behavioural Rating of Drillers' Cognitive Skills",
abstract = "Abstract Objectives/ScopeLarge scale drilling disasters, such as Macondo and Montara, as well as recent industry guidelines (e.g. IOGP, 2014) have highlighted the importance of non-technical skills, including Situation Awareness (SA) and Decision Making (DM). Behavioural marker systems have been used in other high risk domains to assess and train non-technical skills. Offshore drillers’ ability to maintain high level SA of the well state and surrounding environment is essential for effective DM. The objective of this study was to develop an evidence–based behavioural rating tool for drillers’ SA and DM.Methods, Procedure, ProcessThe Cognitive Task Analysis (CTA) techniques of interviews, observations and video analysis as well as an accident analysis, extracted expert knowledge about a driller's SA and DM, to produce preliminary skills taxonomy. The cognitive elements and exemplar behaviours were refined by a review panel and an online survey was then conducted with 15 drilling personnel to further refine and validate the behaviours.Results, Observations, ConclusionsA refined taxonomy was produced including the key SA and DM skills, as well as observable examples of good and poor behavioural (markers). Three SA skills were identified: (1) gathers information, (2) understands the well and situation and (3) anticipates how the situation may develop in the future. Three DM skills were identified: (1) identifies and discusses options, (2) selects an option, as well as implements it and (3) reviews the decision taken. A further category of Maintains Own Abilities was identified as being important (e.g. removes distractions). The online evaluation suggested that the identified skills were relevant for maintaining safety and performance. Consequently, the skills taxonomy has the potential to be highly beneficial for assisting training and assessment, particularly when used in conjunction with a rating system.Novel/Additive InformationWhilst the increase in simulation facilities and non-technical skills is welcomed, to maximise training effectiveness, tools need to be evidence based. This empirical, domain specific taxonomy/tool has direct applications for formative assessment and assisting training in simulated environments so as to improve safety and performance in drilling. Further development of similar non-technical skills sets will facilitate industry standard training and assessment tools to enhance efficiency and safety",
author = "Roberts, {Ruby Clyde} and Rhona Flin",
year = "2016",
doi = "10.2118/179270-MS",
language = "English",
volume = "SPE-179270-MS",
pages = "1",
booktitle = "SPE International Conference and Exhibition on Health, Safety, Security, Environment, and Social Responsibility, 11-13 April, Stavanger, Norway",
publisher = "Society of Petroleum Engineers (SPE)",

}

TY - GEN

T1 - Behavioural Rating of Drillers' Cognitive Skills

AU - Roberts, Ruby Clyde

AU - Flin, Rhona

PY - 2016

Y1 - 2016

N2 - Abstract Objectives/ScopeLarge scale drilling disasters, such as Macondo and Montara, as well as recent industry guidelines (e.g. IOGP, 2014) have highlighted the importance of non-technical skills, including Situation Awareness (SA) and Decision Making (DM). Behavioural marker systems have been used in other high risk domains to assess and train non-technical skills. Offshore drillers’ ability to maintain high level SA of the well state and surrounding environment is essential for effective DM. The objective of this study was to develop an evidence–based behavioural rating tool for drillers’ SA and DM.Methods, Procedure, ProcessThe Cognitive Task Analysis (CTA) techniques of interviews, observations and video analysis as well as an accident analysis, extracted expert knowledge about a driller's SA and DM, to produce preliminary skills taxonomy. The cognitive elements and exemplar behaviours were refined by a review panel and an online survey was then conducted with 15 drilling personnel to further refine and validate the behaviours.Results, Observations, ConclusionsA refined taxonomy was produced including the key SA and DM skills, as well as observable examples of good and poor behavioural (markers). Three SA skills were identified: (1) gathers information, (2) understands the well and situation and (3) anticipates how the situation may develop in the future. Three DM skills were identified: (1) identifies and discusses options, (2) selects an option, as well as implements it and (3) reviews the decision taken. A further category of Maintains Own Abilities was identified as being important (e.g. removes distractions). The online evaluation suggested that the identified skills were relevant for maintaining safety and performance. Consequently, the skills taxonomy has the potential to be highly beneficial for assisting training and assessment, particularly when used in conjunction with a rating system.Novel/Additive InformationWhilst the increase in simulation facilities and non-technical skills is welcomed, to maximise training effectiveness, tools need to be evidence based. This empirical, domain specific taxonomy/tool has direct applications for formative assessment and assisting training in simulated environments so as to improve safety and performance in drilling. Further development of similar non-technical skills sets will facilitate industry standard training and assessment tools to enhance efficiency and safety

AB - Abstract Objectives/ScopeLarge scale drilling disasters, such as Macondo and Montara, as well as recent industry guidelines (e.g. IOGP, 2014) have highlighted the importance of non-technical skills, including Situation Awareness (SA) and Decision Making (DM). Behavioural marker systems have been used in other high risk domains to assess and train non-technical skills. Offshore drillers’ ability to maintain high level SA of the well state and surrounding environment is essential for effective DM. The objective of this study was to develop an evidence–based behavioural rating tool for drillers’ SA and DM.Methods, Procedure, ProcessThe Cognitive Task Analysis (CTA) techniques of interviews, observations and video analysis as well as an accident analysis, extracted expert knowledge about a driller's SA and DM, to produce preliminary skills taxonomy. The cognitive elements and exemplar behaviours were refined by a review panel and an online survey was then conducted with 15 drilling personnel to further refine and validate the behaviours.Results, Observations, ConclusionsA refined taxonomy was produced including the key SA and DM skills, as well as observable examples of good and poor behavioural (markers). Three SA skills were identified: (1) gathers information, (2) understands the well and situation and (3) anticipates how the situation may develop in the future. Three DM skills were identified: (1) identifies and discusses options, (2) selects an option, as well as implements it and (3) reviews the decision taken. A further category of Maintains Own Abilities was identified as being important (e.g. removes distractions). The online evaluation suggested that the identified skills were relevant for maintaining safety and performance. Consequently, the skills taxonomy has the potential to be highly beneficial for assisting training and assessment, particularly when used in conjunction with a rating system.Novel/Additive InformationWhilst the increase in simulation facilities and non-technical skills is welcomed, to maximise training effectiveness, tools need to be evidence based. This empirical, domain specific taxonomy/tool has direct applications for formative assessment and assisting training in simulated environments so as to improve safety and performance in drilling. Further development of similar non-technical skills sets will facilitate industry standard training and assessment tools to enhance efficiency and safety

U2 - 10.2118/179270-MS

DO - 10.2118/179270-MS

M3 - Conference contribution

VL - SPE-179270-MS

SP - 1

BT - SPE International Conference and Exhibition on Health, Safety, Security, Environment, and Social Responsibility, 11-13 April, Stavanger, Norway

PB - Society of Petroleum Engineers (SPE)

ER -