Validity of a simulated Anaphylaxis station in a final year OSCE as preparedness for practice.

Research output: Contribution to conferenceUnpublished paper

Abstract

Background: Medical graduates feel unprepared to deal with unwell patients (Illing et al, 2008). In 2011-2012 we increased OSCE station lengths, allowing for more in-depth assessment of behaviours and skills. Over the past decade or so the use of simulation as a teaching tool has been increasing. Little has been published on the use of simulation as an assessment tool in the undergraduate OSCE. An 8 minute high-acuity simulation OSCE station, anaphylaxis followed by cardiac arrest, was administered in the 2014 OSCE. Our aim was to assess station “face validity” and whether simulation as an assessment tool was acceptable. Methods: Final year medical students who sat the OSCE (n=203) were sent an email questionnaire. Responses were paired with the student’s criterion-based-score for the station as well as “global score” (an overall performance score awarded by the examiner) (Wilkinson, 2001). Data was collated in SPSS v22. Marks were compared with answers using Mann-Whitney tests, Global scores using chi-squared test. College Ethics Review Board approval was granted. Results: 72 students responded. Median criterion scores and global scores for Yes/No responses to four validity questions were compared. There was no difference in median mark between those who thought the station was good (yes answers) or poor in relation to; demonstrating management of an acutely unwell patient (p=0.069); whether the station helped the examiner understand their decision making (p=0.057); whether mannequin use increased fidelity (p=0.763). Better performers were more likely to answer that the station helped them demonstrate assessment of a critical patient (p=0.008). There was no difference between good-scorers and poor-scorers global scores in 3 of the 4 questions. Higher global scorers were more likely to state that the station helped the examiner understand their decision making steps (p=0.017). Conclusion: Final year students considered an anaphylaxis and cardiac arrest simulated OSCE station acceptable. Medical schools should develop further simulated stations for assessment purposes to prepare students for practice.
Original languageEnglish
Publication statusPublished - 2015
EventSixth International Clinical Skills Conference: ‘Creativity & Diversity in Clinical Skills Education and Research’ - Monash University, Prato, Italy
Duration: 17 May 201520 May 2015

Conference

ConferenceSixth International Clinical Skills Conference
Country/TerritoryItaly
CityPrato
Period17/05/1520/05/15

Bibliographical note

https://www.researchgate.net/publication/279515933_Validity_of_a_simulated_Anaphylaxis_station_in_a_final_year_OSCE_as_preparedness_for_practice

Fingerprint

Dive into the research topics of 'Validity of a simulated Anaphylaxis station in a final year OSCE as preparedness for practice.'. Together they form a unique fingerprint.

Cite this