Examining the impact of audience response systems on student performance in anatomy education

a randomized controlled trial

Stuart J. Fergusson, Justine J Aka, Catherine M. Hennessy, Andrew J. Wilson, Simon H. Parson, Ewen M. Harrison, Gabrielle M. Finn, Thomas H. Gillingwater

Research output: Contribution to journalArticle

5 Downloads (Pure)

Abstract

Background and Aims: Electronic audience response systems (ARSs) offer the potential to enhance learning and improve performance. However, objective research investigating the use of ARSs in undergraduate education has so far produced mixed, inconclusive results. We investigated the impact of ARSs on short- and long-term test performance, as well as student perceptions of the educational experience, when integrated into undergraduate anatomy teaching.
Methods and Results: A cohort of 70 undergraduate medical students were randomly allocated to one of two groups. Both groups received the same anatomy lecture, but one group experienced the addition of ARSs. Multiple-choice tests were conducted before, immediately after the lecture and again 10 weeks later. Self-perceived post-lecture subject knowledge, confidence and enjoyment ratings did not differ between groups. Test performance immediately following the lecture improved when compared against baseline and was modestly but significantly superior in the group taught with ARSs (mean test score of 17.3/20 versus 15.6/20 in the control group, p = 0.01). Tests conducted 10 weeks after the lecture showed no difference between groups (p = 0.61) although overall a small improvement from the baseline test was maintained (p = 0.02).
Conclusions: Whilst ARSs offer opportunities to deliver novel education experiences to students, an initial superiority over standard methods does not necessarily translate into longer-term gains in student performance when employed in the context of anatomy education.
Original languageEnglish
Pages (from-to)16-21
Number of pages6
JournalScottish Medical Journal
Volume63
Issue number1
Early online date17 Jun 2018
DOIs
Publication statusPublished - 2018

Fingerprint

Anatomy
Randomized Controlled Trials
Students
Education
Medical Students
Teaching
Learning
Control Groups
Research

Keywords

  • medical education
  • education methodology
  • education technology
  • audience response systems
  • anatomy

Cite this

Examining the impact of audience response systems on student performance in anatomy education : a randomized controlled trial. / Fergusson, Stuart J. ; Aka, Justine J; Hennessy, Catherine M. ; Wilson, Andrew J.; Parson, Simon H.; Harrison, Ewen M. ; Finn, Gabrielle M. ; Gillingwater, Thomas H.

In: Scottish Medical Journal, Vol. 63, No. 1, 2018, p. 16-21.

Research output: Contribution to journalArticle

Fergusson, Stuart J. ; Aka, Justine J ; Hennessy, Catherine M. ; Wilson, Andrew J. ; Parson, Simon H. ; Harrison, Ewen M. ; Finn, Gabrielle M. ; Gillingwater, Thomas H. / Examining the impact of audience response systems on student performance in anatomy education : a randomized controlled trial. In: Scottish Medical Journal. 2018 ; Vol. 63, No. 1. pp. 16-21.
@article{dbc7b9482d6942fb92b4905582646bf2,
title = "Examining the impact of audience response systems on student performance in anatomy education: a randomized controlled trial",
abstract = "Background and Aims: Electronic audience response systems (ARSs) offer the potential to enhance learning and improve performance. However, objective research investigating the use of ARSs in undergraduate education has so far produced mixed, inconclusive results. We investigated the impact of ARSs on short- and long-term test performance, as well as student perceptions of the educational experience, when integrated into undergraduate anatomy teaching. Methods and Results: A cohort of 70 undergraduate medical students were randomly allocated to one of two groups. Both groups received the same anatomy lecture, but one group experienced the addition of ARSs. Multiple-choice tests were conducted before, immediately after the lecture and again 10 weeks later. Self-perceived post-lecture subject knowledge, confidence and enjoyment ratings did not differ between groups. Test performance immediately following the lecture improved when compared against baseline and was modestly but significantly superior in the group taught with ARSs (mean test score of 17.3/20 versus 15.6/20 in the control group, p = 0.01). Tests conducted 10 weeks after the lecture showed no difference between groups (p = 0.61) although overall a small improvement from the baseline test was maintained (p = 0.02). Conclusions: Whilst ARSs offer opportunities to deliver novel education experiences to students, an initial superiority over standard methods does not necessarily translate into longer-term gains in student performance when employed in the context of anatomy education.",
keywords = "medical education, education methodology, education technology, audience response systems, anatomy",
author = "Fergusson, {Stuart J.} and Aka, {Justine J} and Hennessy, {Catherine M.} and Wilson, {Andrew J.} and Parson, {Simon H.} and Harrison, {Ewen M.} and Finn, {Gabrielle M.} and Gillingwater, {Thomas H.}",
note = "The authors would like to thank academic and technical colleagues at the University of Edinburgh for helpful discussions regarding study design and data interpretation, and for assisting with setting up the technology required for the ARS lectures.",
year = "2018",
doi = "10.1177/0036933017741409",
language = "English",
volume = "63",
pages = "16--21",
journal = "Scottish Medical Journal",
issn = "0036-9330",
publisher = "SAGE PUBLICATIONS LTD",
number = "1",

}

TY - JOUR

T1 - Examining the impact of audience response systems on student performance in anatomy education

T2 - a randomized controlled trial

AU - Fergusson, Stuart J.

AU - Aka, Justine J

AU - Hennessy, Catherine M.

AU - Wilson, Andrew J.

AU - Parson, Simon H.

AU - Harrison, Ewen M.

AU - Finn, Gabrielle M.

AU - Gillingwater, Thomas H.

N1 - The authors would like to thank academic and technical colleagues at the University of Edinburgh for helpful discussions regarding study design and data interpretation, and for assisting with setting up the technology required for the ARS lectures.

PY - 2018

Y1 - 2018

N2 - Background and Aims: Electronic audience response systems (ARSs) offer the potential to enhance learning and improve performance. However, objective research investigating the use of ARSs in undergraduate education has so far produced mixed, inconclusive results. We investigated the impact of ARSs on short- and long-term test performance, as well as student perceptions of the educational experience, when integrated into undergraduate anatomy teaching. Methods and Results: A cohort of 70 undergraduate medical students were randomly allocated to one of two groups. Both groups received the same anatomy lecture, but one group experienced the addition of ARSs. Multiple-choice tests were conducted before, immediately after the lecture and again 10 weeks later. Self-perceived post-lecture subject knowledge, confidence and enjoyment ratings did not differ between groups. Test performance immediately following the lecture improved when compared against baseline and was modestly but significantly superior in the group taught with ARSs (mean test score of 17.3/20 versus 15.6/20 in the control group, p = 0.01). Tests conducted 10 weeks after the lecture showed no difference between groups (p = 0.61) although overall a small improvement from the baseline test was maintained (p = 0.02). Conclusions: Whilst ARSs offer opportunities to deliver novel education experiences to students, an initial superiority over standard methods does not necessarily translate into longer-term gains in student performance when employed in the context of anatomy education.

AB - Background and Aims: Electronic audience response systems (ARSs) offer the potential to enhance learning and improve performance. However, objective research investigating the use of ARSs in undergraduate education has so far produced mixed, inconclusive results. We investigated the impact of ARSs on short- and long-term test performance, as well as student perceptions of the educational experience, when integrated into undergraduate anatomy teaching. Methods and Results: A cohort of 70 undergraduate medical students were randomly allocated to one of two groups. Both groups received the same anatomy lecture, but one group experienced the addition of ARSs. Multiple-choice tests were conducted before, immediately after the lecture and again 10 weeks later. Self-perceived post-lecture subject knowledge, confidence and enjoyment ratings did not differ between groups. Test performance immediately following the lecture improved when compared against baseline and was modestly but significantly superior in the group taught with ARSs (mean test score of 17.3/20 versus 15.6/20 in the control group, p = 0.01). Tests conducted 10 weeks after the lecture showed no difference between groups (p = 0.61) although overall a small improvement from the baseline test was maintained (p = 0.02). Conclusions: Whilst ARSs offer opportunities to deliver novel education experiences to students, an initial superiority over standard methods does not necessarily translate into longer-term gains in student performance when employed in the context of anatomy education.

KW - medical education

KW - education methodology

KW - education technology

KW - audience response systems

KW - anatomy

U2 - 10.1177/0036933017741409

DO - 10.1177/0036933017741409

M3 - Article

VL - 63

SP - 16

EP - 21

JO - Scottish Medical Journal

JF - Scottish Medical Journal

SN - 0036-9330

IS - 1

ER -