Design Issues for Socially Intelligent User Interfaces A Discourse Analysis of a Data-to-text System for Summarizing Clinical Data

A. McKinlay, C. McVittie, Ehud Baruch Reiter, Y. Freer, C. Sykes, R. Logie

Research output: Contribution to journalArticle

13 Citations (Scopus)

Abstract

Objectives: This study aims to demonstrate the usability of discourse analyses as a means of evaluating medical informatics systems by examining one particular computer-based data-to-text system for delivering neonatal health care information.

Methods: Six textual summaries of clinical information, three produced by human clinicians and three by the data-to-text system, were subjected to fine-grain discourse analysis. Analysis was performed 'blind' on all six textual summaries. Analysis focused on the identification of lexical items and on the potential effects of these items on users of these clinical information summaries.

Results: Results showed that there were clear differences between human- and system-generated clinical summaries, with human clinicians providing better narrative flow and textual detail. The data-to-text system successfully produced textual summaries although it fell short of human abilities.

Conclusions: These results indicate potential future improvements to the system. Discourse analysis as used here may offer significant advantages in evaluating and developing similar medical informatics systems.

Original languageEnglish
Pages (from-to)379-387
Number of pages9
JournalMethods of Information in Medicine
Volume49
Issue number4
DOIs
Publication statusPublished - 2010

Keywords

  • Medical informatics applications
  • user-computer interface
  • neonate
  • doctor-patient relations
  • discourse analysis
  • medical informatics
  • weather forecasts
  • progress notes
  • health-care
  • communication
  • generation

Cite this