Is ArguMessage Effective? A Critical Evaluation of the Persuasive Message Generation System

Rosemary J. Thomas*, Judith Masthoff, Nir Oren

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper describes an investigation into the effectiveness of ArguMessage, a system that uses argumentation schemes and limited user input to semi-automatically generate persuasive messages encouraging behaviour change that follow specific argumentation patterns. We conducted user studies in the domains of healthy eating and email security to investigate its effectiveness. Our results show that ArguMessage in general supported users in generating messages based on the argumentation schemes. However, there were some issues in particular with copying the example messages, and some system improvements need to be made. Participants were generally satisfied with the messages produced, with the exception of those produced by two schemes (‘Argument from memory with goal’ and ‘Argument from values with goal’) which were removed after the first study.

Original languageEnglish
Title of host publicationPersuasive Technology
Subtitle of host publicationDevelopment of Persuasive and Behavior Change Support Systems - 14th International Conference, PERSUASIVE 2019, Proceedings
EditorsHarri Oinas-Kukkonen, Khin Than Win, Evangelos Karapanos, Pasi Karppinen, Eleni Kyza
Place of PublicationCham
PublisherSpringer-Verlag
Pages87-99
Number of pages13
ISBN (Electronic)9783030172879
ISBN (Print)9783030172862
DOIs
Publication statusPublished - 2019
Event14th International Conference on Persuasive Technology, PERSUASIVE 2019 - Limassol, Cyprus
Duration: 9 Apr 201911 Apr 2019

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume11433 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference14th International Conference on Persuasive Technology, PERSUASIVE 2019
CountryCyprus
CityLimassol
Period9/04/1911/04/19

Fingerprint

Copying
Argumentation
Electronic mail
Data storage equipment
Evaluation
User Studies
Electronic Mail
Exception

Keywords

  • Argumentation schemes
  • Message generation
  • Persuasion

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Cite this

Thomas, R. J., Masthoff, J., & Oren, N. (2019). Is ArguMessage Effective? A Critical Evaluation of the Persuasive Message Generation System. In H. Oinas-Kukkonen, K. T. Win, E. Karapanos, P. Karppinen, & E. Kyza (Eds.), Persuasive Technology: Development of Persuasive and Behavior Change Support Systems - 14th International Conference, PERSUASIVE 2019, Proceedings (pp. 87-99). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11433 LNCS). Cham: Springer-Verlag. https://doi.org/10.1007/978-3-030-17287-9_8

Is ArguMessage Effective? A Critical Evaluation of the Persuasive Message Generation System. / Thomas, Rosemary J.; Masthoff, Judith; Oren, Nir.

Persuasive Technology: Development of Persuasive and Behavior Change Support Systems - 14th International Conference, PERSUASIVE 2019, Proceedings. ed. / Harri Oinas-Kukkonen; Khin Than Win; Evangelos Karapanos; Pasi Karppinen; Eleni Kyza. Cham : Springer-Verlag, 2019. p. 87-99 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11433 LNCS).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Thomas, RJ, Masthoff, J & Oren, N 2019, Is ArguMessage Effective? A Critical Evaluation of the Persuasive Message Generation System. in H Oinas-Kukkonen, KT Win, E Karapanos, P Karppinen & E Kyza (eds), Persuasive Technology: Development of Persuasive and Behavior Change Support Systems - 14th International Conference, PERSUASIVE 2019, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 11433 LNCS, Springer-Verlag, Cham, pp. 87-99, 14th International Conference on Persuasive Technology, PERSUASIVE 2019, Limassol, Cyprus, 9/04/19. https://doi.org/10.1007/978-3-030-17287-9_8
Thomas RJ, Masthoff J, Oren N. Is ArguMessage Effective? A Critical Evaluation of the Persuasive Message Generation System. In Oinas-Kukkonen H, Win KT, Karapanos E, Karppinen P, Kyza E, editors, Persuasive Technology: Development of Persuasive and Behavior Change Support Systems - 14th International Conference, PERSUASIVE 2019, Proceedings. Cham: Springer-Verlag. 2019. p. 87-99. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-030-17287-9_8
Thomas, Rosemary J. ; Masthoff, Judith ; Oren, Nir. / Is ArguMessage Effective? A Critical Evaluation of the Persuasive Message Generation System. Persuasive Technology: Development of Persuasive and Behavior Change Support Systems - 14th International Conference, PERSUASIVE 2019, Proceedings. editor / Harri Oinas-Kukkonen ; Khin Than Win ; Evangelos Karapanos ; Pasi Karppinen ; Eleni Kyza. Cham : Springer-Verlag, 2019. pp. 87-99 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
@inproceedings{6aa75674b743491b92f6c133a4972e27,
title = "Is ArguMessage Effective? A Critical Evaluation of the Persuasive Message Generation System",
abstract = "This paper describes an investigation into the effectiveness of ArguMessage, a system that uses argumentation schemes and limited user input to semi-automatically generate persuasive messages encouraging behaviour change that follow specific argumentation patterns. We conducted user studies in the domains of healthy eating and email security to investigate its effectiveness. Our results show that ArguMessage in general supported users in generating messages based on the argumentation schemes. However, there were some issues in particular with copying the example messages, and some system improvements need to be made. Participants were generally satisfied with the messages produced, with the exception of those produced by two schemes (‘Argument from memory with goal’ and ‘Argument from values with goal’) which were removed after the first study.",
keywords = "Argumentation schemes, Message generation, Persuasion",
author = "Thomas, {Rosemary J.} and Judith Masthoff and Nir Oren",
note = "The work on cyber-security in this paper was supported by EPSRC award EP/P011829/1.",
year = "2019",
doi = "10.1007/978-3-030-17287-9_8",
language = "English",
isbn = "9783030172862",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
publisher = "Springer-Verlag",
pages = "87--99",
editor = "Harri Oinas-Kukkonen and Win, {Khin Than} and Evangelos Karapanos and Pasi Karppinen and Eleni Kyza",
booktitle = "Persuasive Technology",

}

TY - GEN

T1 - Is ArguMessage Effective? A Critical Evaluation of the Persuasive Message Generation System

AU - Thomas, Rosemary J.

AU - Masthoff, Judith

AU - Oren, Nir

N1 - The work on cyber-security in this paper was supported by EPSRC award EP/P011829/1.

PY - 2019

Y1 - 2019

N2 - This paper describes an investigation into the effectiveness of ArguMessage, a system that uses argumentation schemes and limited user input to semi-automatically generate persuasive messages encouraging behaviour change that follow specific argumentation patterns. We conducted user studies in the domains of healthy eating and email security to investigate its effectiveness. Our results show that ArguMessage in general supported users in generating messages based on the argumentation schemes. However, there were some issues in particular with copying the example messages, and some system improvements need to be made. Participants were generally satisfied with the messages produced, with the exception of those produced by two schemes (‘Argument from memory with goal’ and ‘Argument from values with goal’) which were removed after the first study.

AB - This paper describes an investigation into the effectiveness of ArguMessage, a system that uses argumentation schemes and limited user input to semi-automatically generate persuasive messages encouraging behaviour change that follow specific argumentation patterns. We conducted user studies in the domains of healthy eating and email security to investigate its effectiveness. Our results show that ArguMessage in general supported users in generating messages based on the argumentation schemes. However, there were some issues in particular with copying the example messages, and some system improvements need to be made. Participants were generally satisfied with the messages produced, with the exception of those produced by two schemes (‘Argument from memory with goal’ and ‘Argument from values with goal’) which were removed after the first study.

KW - Argumentation schemes

KW - Message generation

KW - Persuasion

UR - http://www.scopus.com/inward/record.url?scp=85064538225&partnerID=8YFLogxK

UR - http://www.mendeley.com/research/argumessage-effective-critical-evaluation-persuasive-message-generation-system

U2 - 10.1007/978-3-030-17287-9_8

DO - 10.1007/978-3-030-17287-9_8

M3 - Conference contribution

SN - 9783030172862

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 87

EP - 99

BT - Persuasive Technology

A2 - Oinas-Kukkonen, Harri

A2 - Win, Khin Than

A2 - Karapanos, Evangelos

A2 - Karppinen, Pasi

A2 - Kyza, Eleni

PB - Springer-Verlag

CY - Cham

ER -