Eyes on the mind: investigating the influence of gaze dynamics on the perception of others in real-time social interaction

Ulrich J. Pfeiffer, Leonhard Schilbach, Bert Timmermans, Mathis Jording, Gary Bente, Kai Vogeley

Research output: Contribution to journalArticle

24 Citations (Scopus)
4 Downloads (Pure)

Abstract

Social gaze provides a window into the interests and intentions of others and allows us to actively point out our own. It enables us to engage in triadic interactions involving human actors and physical objects and to build an indispensable basis for coordinated action and collaborative efforts. The object-related aspect of gaze in combination with the fact that any motor act of looking encompasses both input and output of the minds involved makes this non-verbal cue system particularly interesting for research in embodied social cognition. Social gaze comprises several core components, such as gaze-following or gaze aversion. Gaze-following can result in situations of either “joint attention” or “shared attention.” The former describes situations in which the gaze-follower is aware of sharing a joint visual focus with the gazer. The latter refers to a situation in which gazer and gaze-follower focus on the same object and both are aware of their reciprocal awareness of this joint focus. Here, a novel interactive eye-tracking paradigm suited for studying triadic interactions was used to explore two aspects of social gaze. Experiments 1a and 1b assessed how the latency of another person’s gaze reactions (i.e., gaze-following or gaze version) affected participants’ sense of agency, which was measured by their experience of relatedness of these reactions. Results demonstrate that both timing and congruency of a gaze reaction as well as the other’s action options influence the sense of agency. Experiment 2 explored differences in gaze dynamics when participants were asked to establish either joint or shared attention. Findings indicate that establishing shared attention takes longer and requires a larger number of gaze shifts as compared to joint attention, which more closely seems to resemble simple visual detection. Taken together, novel insights into the sense of agency and the awareness of others in gaze-based interaction are provided.
Original languageEnglish
Article number537
Number of pages11
JournalFrontiers in Psychology
Volume3
DOIs
Publication statusPublished - 3 Dec 2012

Fingerprint

Interpersonal Relations
Joints
Cognition
Cues
Research
gazer

Keywords

  • gaze-following
  • joint attention
  • shared attention
  • social interaction
  • agency
  • mentalizing
  • eye-tracking

Cite this

Eyes on the mind : investigating the influence of gaze dynamics on the perception of others in real-time social interaction. / Pfeiffer, Ulrich J.; Schilbach, Leonhard; Timmermans, Bert; Jording, Mathis; Bente, Gary; Vogeley, Kai.

In: Frontiers in Psychology, Vol. 3, 537, 03.12.2012.

Research output: Contribution to journalArticle

Pfeiffer, Ulrich J. ; Schilbach, Leonhard ; Timmermans, Bert ; Jording, Mathis ; Bente, Gary ; Vogeley, Kai. / Eyes on the mind : investigating the influence of gaze dynamics on the perception of others in real-time social interaction. In: Frontiers in Psychology. 2012 ; Vol. 3.
@article{ffaed6c65891448ba9628d0e41fbadf8,
title = "Eyes on the mind: investigating the influence of gaze dynamics on the perception of others in real-time social interaction",
abstract = "Social gaze provides a window into the interests and intentions of others and allows us to actively point out our own. It enables us to engage in triadic interactions involving human actors and physical objects and to build an indispensable basis for coordinated action and collaborative efforts. The object-related aspect of gaze in combination with the fact that any motor act of looking encompasses both input and output of the minds involved makes this non-verbal cue system particularly interesting for research in embodied social cognition. Social gaze comprises several core components, such as gaze-following or gaze aversion. Gaze-following can result in situations of either “joint attention” or “shared attention.” The former describes situations in which the gaze-follower is aware of sharing a joint visual focus with the gazer. The latter refers to a situation in which gazer and gaze-follower focus on the same object and both are aware of their reciprocal awareness of this joint focus. Here, a novel interactive eye-tracking paradigm suited for studying triadic interactions was used to explore two aspects of social gaze. Experiments 1a and 1b assessed how the latency of another person’s gaze reactions (i.e., gaze-following or gaze version) affected participants’ sense of agency, which was measured by their experience of relatedness of these reactions. Results demonstrate that both timing and congruency of a gaze reaction as well as the other’s action options influence the sense of agency. Experiment 2 explored differences in gaze dynamics when participants were asked to establish either joint or shared attention. Findings indicate that establishing shared attention takes longer and requires a larger number of gaze shifts as compared to joint attention, which more closely seems to resemble simple visual detection. Taken together, novel insights into the sense of agency and the awareness of others in gaze-based interaction are provided.",
keywords = "gaze-following, joint attention, shared attention, social interaction, agency, mentalizing, eye-tracking",
author = "Pfeiffer, {Ulrich J.} and Leonhard Schilbach and Bert Timmermans and Mathis Jording and Gary Bente and Kai Vogeley",
note = "ACKNOWLEDGMENTS This study was partially supported by a grant of the K{\"o}ln Fortune Program of the Medical Faculty at the University of Cologne to Leonhard Schilbach and by a grant “Other Minds” of the German Ministry of Research and Education to Kai Vogeley. The authors would like to thank Stephanie Alexius and Leonhard Engels for their assistance in data collection.",
year = "2012",
month = "12",
day = "3",
doi = "10.3389/fpsyg.2012.00537",
language = "English",
volume = "3",
journal = "Frontiers in Psychology",
issn = "1664-1078",
publisher = "Frontiers Media S.A.",

}

TY - JOUR

T1 - Eyes on the mind

T2 - investigating the influence of gaze dynamics on the perception of others in real-time social interaction

AU - Pfeiffer, Ulrich J.

AU - Schilbach, Leonhard

AU - Timmermans, Bert

AU - Jording, Mathis

AU - Bente, Gary

AU - Vogeley, Kai

N1 - ACKNOWLEDGMENTS This study was partially supported by a grant of the Köln Fortune Program of the Medical Faculty at the University of Cologne to Leonhard Schilbach and by a grant “Other Minds” of the German Ministry of Research and Education to Kai Vogeley. The authors would like to thank Stephanie Alexius and Leonhard Engels for their assistance in data collection.

PY - 2012/12/3

Y1 - 2012/12/3

N2 - Social gaze provides a window into the interests and intentions of others and allows us to actively point out our own. It enables us to engage in triadic interactions involving human actors and physical objects and to build an indispensable basis for coordinated action and collaborative efforts. The object-related aspect of gaze in combination with the fact that any motor act of looking encompasses both input and output of the minds involved makes this non-verbal cue system particularly interesting for research in embodied social cognition. Social gaze comprises several core components, such as gaze-following or gaze aversion. Gaze-following can result in situations of either “joint attention” or “shared attention.” The former describes situations in which the gaze-follower is aware of sharing a joint visual focus with the gazer. The latter refers to a situation in which gazer and gaze-follower focus on the same object and both are aware of their reciprocal awareness of this joint focus. Here, a novel interactive eye-tracking paradigm suited for studying triadic interactions was used to explore two aspects of social gaze. Experiments 1a and 1b assessed how the latency of another person’s gaze reactions (i.e., gaze-following or gaze version) affected participants’ sense of agency, which was measured by their experience of relatedness of these reactions. Results demonstrate that both timing and congruency of a gaze reaction as well as the other’s action options influence the sense of agency. Experiment 2 explored differences in gaze dynamics when participants were asked to establish either joint or shared attention. Findings indicate that establishing shared attention takes longer and requires a larger number of gaze shifts as compared to joint attention, which more closely seems to resemble simple visual detection. Taken together, novel insights into the sense of agency and the awareness of others in gaze-based interaction are provided.

AB - Social gaze provides a window into the interests and intentions of others and allows us to actively point out our own. It enables us to engage in triadic interactions involving human actors and physical objects and to build an indispensable basis for coordinated action and collaborative efforts. The object-related aspect of gaze in combination with the fact that any motor act of looking encompasses both input and output of the minds involved makes this non-verbal cue system particularly interesting for research in embodied social cognition. Social gaze comprises several core components, such as gaze-following or gaze aversion. Gaze-following can result in situations of either “joint attention” or “shared attention.” The former describes situations in which the gaze-follower is aware of sharing a joint visual focus with the gazer. The latter refers to a situation in which gazer and gaze-follower focus on the same object and both are aware of their reciprocal awareness of this joint focus. Here, a novel interactive eye-tracking paradigm suited for studying triadic interactions was used to explore two aspects of social gaze. Experiments 1a and 1b assessed how the latency of another person’s gaze reactions (i.e., gaze-following or gaze version) affected participants’ sense of agency, which was measured by their experience of relatedness of these reactions. Results demonstrate that both timing and congruency of a gaze reaction as well as the other’s action options influence the sense of agency. Experiment 2 explored differences in gaze dynamics when participants were asked to establish either joint or shared attention. Findings indicate that establishing shared attention takes longer and requires a larger number of gaze shifts as compared to joint attention, which more closely seems to resemble simple visual detection. Taken together, novel insights into the sense of agency and the awareness of others in gaze-based interaction are provided.

KW - gaze-following

KW - joint attention

KW - shared attention

KW - social interaction

KW - agency

KW - mentalizing

KW - eye-tracking

U2 - 10.3389/fpsyg.2012.00537

DO - 10.3389/fpsyg.2012.00537

M3 - Article

VL - 3

JO - Frontiers in Psychology

JF - Frontiers in Psychology

SN - 1664-1078

M1 - 537

ER -