Everyone's a Critic

Memory Models and Uses for an Artificial Turing Judge

W Joseph MacInnes, Blair C. Armstrong, Dwayne Pare, George S Cree, Steve Joordens

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

The Turing test was originally conceived by Alan Turing [20] to determine if a machine had achieved human-level intelligence. Although no longer taken as a comprehensive measure of human intelligence, passing the Turing test remains an interesting challenge as evidenced by the still unclaimed Loebner prize[7], a high profile prize for the first AI to pass a Turing style test. In this paper, we sketch the development of an artificial "Turing judge" capable of critically evaluating the likelihood that a stream of discourse was generated by a human or a computer. The knowledge our judge uses to make the assessment comes from a model of human lexical semantic memory known as latent semantic analysis[9]. We provide empirical evidence that our implemented judge is capable of distinguishing between human and computer generated language from the Loebner Turing test competition with a degree of success similar to human judges.

Original languageEnglish
Pages (from-to)132-137
Number of pages6
JournalAdvances in Intelligent Systems Research
Volume8
DOIs
Publication statusPublished - 2009

Keywords

  • semantic memory
  • general knowledge
  • decision making
  • machine learning
  • language
  • Turing test
  • latent semantic analysis

Cite this

Everyone's a Critic : Memory Models and Uses for an Artificial Turing Judge. / MacInnes, W Joseph; Armstrong, Blair C.; Pare, Dwayne; Cree, George S; Joordens, Steve.

In: Advances in Intelligent Systems Research, Vol. 8, 2009, p. 132-137.

Research output: Contribution to journalArticle

MacInnes, W Joseph ; Armstrong, Blair C. ; Pare, Dwayne ; Cree, George S ; Joordens, Steve. / Everyone's a Critic : Memory Models and Uses for an Artificial Turing Judge. In: Advances in Intelligent Systems Research. 2009 ; Vol. 8. pp. 132-137.
@article{9d4aefdfe8ae45919bf0a97f41a066b5,
title = "Everyone's a Critic: Memory Models and Uses for an Artificial Turing Judge",
abstract = "The Turing test was originally conceived by Alan Turing [20] to determine if a machine had achieved human-level intelligence. Although no longer taken as a comprehensive measure of human intelligence, passing the Turing test remains an interesting challenge as evidenced by the still unclaimed Loebner prize[7], a high profile prize for the first AI to pass a Turing style test. In this paper, we sketch the development of an artificial {"}Turing judge{"} capable of critically evaluating the likelihood that a stream of discourse was generated by a human or a computer. The knowledge our judge uses to make the assessment comes from a model of human lexical semantic memory known as latent semantic analysis[9]. We provide empirical evidence that our implemented judge is capable of distinguishing between human and computer generated language from the Loebner Turing test competition with a degree of success similar to human judges.",
keywords = "semantic memory, general knowledge, decision making, machine learning, language, Turing test, latent semantic analysis",
author = "MacInnes, {W Joseph} and Armstrong, {Blair C.} and Dwayne Pare and Cree, {George S} and Steve Joordens",
year = "2009",
doi = "10.2991/agi.2009.34",
language = "English",
volume = "8",
pages = "132--137",
journal = "Advances in Intelligent Systems Research",
issn = "1951-6851",

}

TY - JOUR

T1 - Everyone's a Critic

T2 - Memory Models and Uses for an Artificial Turing Judge

AU - MacInnes, W Joseph

AU - Armstrong, Blair C.

AU - Pare, Dwayne

AU - Cree, George S

AU - Joordens, Steve

PY - 2009

Y1 - 2009

N2 - The Turing test was originally conceived by Alan Turing [20] to determine if a machine had achieved human-level intelligence. Although no longer taken as a comprehensive measure of human intelligence, passing the Turing test remains an interesting challenge as evidenced by the still unclaimed Loebner prize[7], a high profile prize for the first AI to pass a Turing style test. In this paper, we sketch the development of an artificial "Turing judge" capable of critically evaluating the likelihood that a stream of discourse was generated by a human or a computer. The knowledge our judge uses to make the assessment comes from a model of human lexical semantic memory known as latent semantic analysis[9]. We provide empirical evidence that our implemented judge is capable of distinguishing between human and computer generated language from the Loebner Turing test competition with a degree of success similar to human judges.

AB - The Turing test was originally conceived by Alan Turing [20] to determine if a machine had achieved human-level intelligence. Although no longer taken as a comprehensive measure of human intelligence, passing the Turing test remains an interesting challenge as evidenced by the still unclaimed Loebner prize[7], a high profile prize for the first AI to pass a Turing style test. In this paper, we sketch the development of an artificial "Turing judge" capable of critically evaluating the likelihood that a stream of discourse was generated by a human or a computer. The knowledge our judge uses to make the assessment comes from a model of human lexical semantic memory known as latent semantic analysis[9]. We provide empirical evidence that our implemented judge is capable of distinguishing between human and computer generated language from the Loebner Turing test competition with a degree of success similar to human judges.

KW - semantic memory

KW - general knowledge

KW - decision making

KW - machine learning

KW - language

KW - Turing test

KW - latent semantic analysis

U2 - 10.2991/agi.2009.34

DO - 10.2991/agi.2009.34

M3 - Article

VL - 8

SP - 132

EP - 137

JO - Advances in Intelligent Systems Research

JF - Advances in Intelligent Systems Research

SN - 1951-6851

ER -