A non-verbal Turing test

differentiating mind from machine in gaze-based social interaction

Ulrich J Pfeiffer, Bert Timmermans, Gary Bente, Kai Vogeley, Leonhard Schilbach

Research output: Contribution to journalArticle

46 Citations (Scopus)
4 Downloads (Pure)

Abstract

In social interaction, gaze behavior provides important signals that have a significant impact on our perception of others. Previous investigations, however, have relied on paradigms in which participants are passive observers of other persons’ gazes and do not adjust their gaze behavior as is the case in real-life social encounters. We used an interactive eye-tracking paradigm that allows participants to interact with an anthropomorphic virtual character whose gaze behavior is responsive to where the participant looks on the stimulus screen in real time. The character’s gaze reactions were systematically varied along a continuum from a maximal probability of gaze aversion to a maximal probability of gaze-following during brief interactions, thereby varying contingency and congruency of the reactions. We investigated how these variations influenced whether participants believed that the character was controlled by another person (i.e., a confederate) or a computer program. In a series of experiments, the human confederate was either introduced as naïve to the task, cooperative, or competitive. Results demonstrate that the ascription of humanness increases with higher congruency of gaze reactions when participants are interacting with a naïve partner. In contrast, humanness ascription is driven by the degree of contingency irrespective of congruency when the confederate was introduced as cooperative. Conversely, during interaction with a competitive confederate, judgments were neither based on congruency nor on contingency. These results offer important insights into what renders the experience of an interaction truly social: Humans appear to have a default expectation of reciprocation that can be influenced drastically by the presumed disposition of the interactor to either cooperate or compete.
Original languageEnglish
Article numbere27591
Number of pages12
JournalPloS ONE
Volume6
Issue number11
DOIs
Publication statusPublished - 9 Nov 2011

Fingerprint

Interpersonal Relations
cooperatives
Computer program listings
testing
Software
eyes
Experiments

Cite this

A non-verbal Turing test : differentiating mind from machine in gaze-based social interaction. / Pfeiffer, Ulrich J; Timmermans, Bert; Bente, Gary; Vogeley, Kai; Schilbach, Leonhard.

In: PloS ONE, Vol. 6, No. 11, e27591, 09.11.2011.

Research output: Contribution to journalArticle

Pfeiffer, Ulrich J ; Timmermans, Bert ; Bente, Gary ; Vogeley, Kai ; Schilbach, Leonhard. / A non-verbal Turing test : differentiating mind from machine in gaze-based social interaction. In: PloS ONE. 2011 ; Vol. 6, No. 11.
@article{fd61c4b1172e4f24956466de28929713,
title = "A non-verbal Turing test: differentiating mind from machine in gaze-based social interaction",
abstract = "In social interaction, gaze behavior provides important signals that have a significant impact on our perception of others. Previous investigations, however, have relied on paradigms in which participants are passive observers of other persons’ gazes and do not adjust their gaze behavior as is the case in real-life social encounters. We used an interactive eye-tracking paradigm that allows participants to interact with an anthropomorphic virtual character whose gaze behavior is responsive to where the participant looks on the stimulus screen in real time. The character’s gaze reactions were systematically varied along a continuum from a maximal probability of gaze aversion to a maximal probability of gaze-following during brief interactions, thereby varying contingency and congruency of the reactions. We investigated how these variations influenced whether participants believed that the character was controlled by another person (i.e., a confederate) or a computer program. In a series of experiments, the human confederate was either introduced as na{\"i}ve to the task, cooperative, or competitive. Results demonstrate that the ascription of humanness increases with higher congruency of gaze reactions when participants are interacting with a na{\"i}ve partner. In contrast, humanness ascription is driven by the degree of contingency irrespective of congruency when the confederate was introduced as cooperative. Conversely, during interaction with a competitive confederate, judgments were neither based on congruency nor on contingency. These results offer important insights into what renders the experience of an interaction truly social: Humans appear to have a default expectation of reciprocation that can be influenced drastically by the presumed disposition of the interactor to either cooperate or compete.",
author = "Pfeiffer, {Ulrich J} and Bert Timmermans and Gary Bente and Kai Vogeley and Leonhard Schilbach",
year = "2011",
month = "11",
day = "9",
doi = "10.1371/journal.pone.0027591",
language = "English",
volume = "6",
journal = "PloS ONE",
issn = "1932-6203",
publisher = "PUBLIC LIBRARY SCIENCE",
number = "11",

}

TY - JOUR

T1 - A non-verbal Turing test

T2 - differentiating mind from machine in gaze-based social interaction

AU - Pfeiffer, Ulrich J

AU - Timmermans, Bert

AU - Bente, Gary

AU - Vogeley, Kai

AU - Schilbach, Leonhard

PY - 2011/11/9

Y1 - 2011/11/9

N2 - In social interaction, gaze behavior provides important signals that have a significant impact on our perception of others. Previous investigations, however, have relied on paradigms in which participants are passive observers of other persons’ gazes and do not adjust their gaze behavior as is the case in real-life social encounters. We used an interactive eye-tracking paradigm that allows participants to interact with an anthropomorphic virtual character whose gaze behavior is responsive to where the participant looks on the stimulus screen in real time. The character’s gaze reactions were systematically varied along a continuum from a maximal probability of gaze aversion to a maximal probability of gaze-following during brief interactions, thereby varying contingency and congruency of the reactions. We investigated how these variations influenced whether participants believed that the character was controlled by another person (i.e., a confederate) or a computer program. In a series of experiments, the human confederate was either introduced as naïve to the task, cooperative, or competitive. Results demonstrate that the ascription of humanness increases with higher congruency of gaze reactions when participants are interacting with a naïve partner. In contrast, humanness ascription is driven by the degree of contingency irrespective of congruency when the confederate was introduced as cooperative. Conversely, during interaction with a competitive confederate, judgments were neither based on congruency nor on contingency. These results offer important insights into what renders the experience of an interaction truly social: Humans appear to have a default expectation of reciprocation that can be influenced drastically by the presumed disposition of the interactor to either cooperate or compete.

AB - In social interaction, gaze behavior provides important signals that have a significant impact on our perception of others. Previous investigations, however, have relied on paradigms in which participants are passive observers of other persons’ gazes and do not adjust their gaze behavior as is the case in real-life social encounters. We used an interactive eye-tracking paradigm that allows participants to interact with an anthropomorphic virtual character whose gaze behavior is responsive to where the participant looks on the stimulus screen in real time. The character’s gaze reactions were systematically varied along a continuum from a maximal probability of gaze aversion to a maximal probability of gaze-following during brief interactions, thereby varying contingency and congruency of the reactions. We investigated how these variations influenced whether participants believed that the character was controlled by another person (i.e., a confederate) or a computer program. In a series of experiments, the human confederate was either introduced as naïve to the task, cooperative, or competitive. Results demonstrate that the ascription of humanness increases with higher congruency of gaze reactions when participants are interacting with a naïve partner. In contrast, humanness ascription is driven by the degree of contingency irrespective of congruency when the confederate was introduced as cooperative. Conversely, during interaction with a competitive confederate, judgments were neither based on congruency nor on contingency. These results offer important insights into what renders the experience of an interaction truly social: Humans appear to have a default expectation of reciprocation that can be influenced drastically by the presumed disposition of the interactor to either cooperate or compete.

U2 - 10.1371/journal.pone.0027591

DO - 10.1371/journal.pone.0027591

M3 - Article

VL - 6

JO - PloS ONE

JF - PloS ONE

SN - 1932-6203

IS - 11

M1 - e27591

ER -