Stereotypical trust and bias in dynamic multi-agent systems

Chris Burnett, Timothy J Norman, Katia Sycara

Research output: Contribution to journalArticle

30 Citations (Scopus)

Abstract

Large-scale multi-agent systems have the potential to be highly dynamic. Trust and reputation are crucial concepts in these environments, as it may be necessary for agents to rely on their peers to perform as expected, and learn to avoid untrustworthy partners. However, aspects of highly dynamic systems introduce issues which make the formation of trust relationships difficult. For example, they may be short-lived, precluding agents from gaining the necessary experiences to make an accurate trust evaluation. This paper describes a new approach, inspired by theories of human organisational behaviour, whereby agents generalise their experiences with previously encountered partners as stereotypes, based on the observable features of those partners and their behaviours. Subsequently, these stereotypes are applied when evaluating new and unknown partners. Furthermore, these stereotypical opinions can be communicated within the society, resulting in the notion of stereotypical reputation. We show how this approach can complement existing state-of-the-art trust models, and enhance the confidence in the evaluations that can be made about trustees when direct and reputational information is lacking or limited. Furthermore, we show how a stereotyping approach can help agents detect unwanted biases in the reputational opinions they receive from others in the society.
Original languageEnglish
Article number26
Number of pages22
JournalACM Transactions on Intelligent Systems and Technology
Volume4
Issue number2
DOIs
Publication statusPublished - Mar 2013

Fingerprint

Multi agent systems
Multi-agent Systems
Dynamic Systems
Trust Model
Necessary
Evaluation
Large-scale Systems
Confidence
Dynamical systems
Complement
Unknown
Generalise
Experience
Reputation

Keywords

  • Multi-agent systems
  • Trust

Cite this

Stereotypical trust and bias in dynamic multi-agent systems. / Burnett, Chris; Norman, Timothy J; Sycara, Katia .

In: ACM Transactions on Intelligent Systems and Technology, Vol. 4, No. 2, 26, 03.2013.

Research output: Contribution to journalArticle

Burnett, Chris ; Norman, Timothy J ; Sycara, Katia . / Stereotypical trust and bias in dynamic multi-agent systems. In: ACM Transactions on Intelligent Systems and Technology. 2013 ; Vol. 4, No. 2.
@article{0c3bc8e55d8c436aacf06c62858ba049,
title = "Stereotypical trust and bias in dynamic multi-agent systems",
abstract = "Large-scale multi-agent systems have the potential to be highly dynamic. Trust and reputation are crucial concepts in these environments, as it may be necessary for agents to rely on their peers to perform as expected, and learn to avoid untrustworthy partners. However, aspects of highly dynamic systems introduce issues which make the formation of trust relationships difficult. For example, they may be short-lived, precluding agents from gaining the necessary experiences to make an accurate trust evaluation. This paper describes a new approach, inspired by theories of human organisational behaviour, whereby agents generalise their experiences with previously encountered partners as stereotypes, based on the observable features of those partners and their behaviours. Subsequently, these stereotypes are applied when evaluating new and unknown partners. Furthermore, these stereotypical opinions can be communicated within the society, resulting in the notion of stereotypical reputation. We show how this approach can complement existing state-of-the-art trust models, and enhance the confidence in the evaluations that can be made about trustees when direct and reputational information is lacking or limited. Furthermore, we show how a stereotyping approach can help agents detect unwanted biases in the reputational opinions they receive from others in the society.",
keywords = "Multi-agent systems, Trust",
author = "Chris Burnett and Norman, {Timothy J} and Katia Sycara",
year = "2013",
month = "3",
doi = "10.1145/2438653.2438661",
language = "English",
volume = "4",
journal = "ACM Transactions on Intelligent Systems and Technology",
issn = "2157-6904",
publisher = "Association for Computing Machinery (ACM)",
number = "2",

}

TY - JOUR

T1 - Stereotypical trust and bias in dynamic multi-agent systems

AU - Burnett, Chris

AU - Norman, Timothy J

AU - Sycara, Katia

PY - 2013/3

Y1 - 2013/3

N2 - Large-scale multi-agent systems have the potential to be highly dynamic. Trust and reputation are crucial concepts in these environments, as it may be necessary for agents to rely on their peers to perform as expected, and learn to avoid untrustworthy partners. However, aspects of highly dynamic systems introduce issues which make the formation of trust relationships difficult. For example, they may be short-lived, precluding agents from gaining the necessary experiences to make an accurate trust evaluation. This paper describes a new approach, inspired by theories of human organisational behaviour, whereby agents generalise their experiences with previously encountered partners as stereotypes, based on the observable features of those partners and their behaviours. Subsequently, these stereotypes are applied when evaluating new and unknown partners. Furthermore, these stereotypical opinions can be communicated within the society, resulting in the notion of stereotypical reputation. We show how this approach can complement existing state-of-the-art trust models, and enhance the confidence in the evaluations that can be made about trustees when direct and reputational information is lacking or limited. Furthermore, we show how a stereotyping approach can help agents detect unwanted biases in the reputational opinions they receive from others in the society.

AB - Large-scale multi-agent systems have the potential to be highly dynamic. Trust and reputation are crucial concepts in these environments, as it may be necessary for agents to rely on their peers to perform as expected, and learn to avoid untrustworthy partners. However, aspects of highly dynamic systems introduce issues which make the formation of trust relationships difficult. For example, they may be short-lived, precluding agents from gaining the necessary experiences to make an accurate trust evaluation. This paper describes a new approach, inspired by theories of human organisational behaviour, whereby agents generalise their experiences with previously encountered partners as stereotypes, based on the observable features of those partners and their behaviours. Subsequently, these stereotypes are applied when evaluating new and unknown partners. Furthermore, these stereotypical opinions can be communicated within the society, resulting in the notion of stereotypical reputation. We show how this approach can complement existing state-of-the-art trust models, and enhance the confidence in the evaluations that can be made about trustees when direct and reputational information is lacking or limited. Furthermore, we show how a stereotyping approach can help agents detect unwanted biases in the reputational opinions they receive from others in the society.

KW - Multi-agent systems

KW - Trust

U2 - 10.1145/2438653.2438661

DO - 10.1145/2438653.2438661

M3 - Article

VL - 4

JO - ACM Transactions on Intelligent Systems and Technology

JF - ACM Transactions on Intelligent Systems and Technology

SN - 2157-6904

IS - 2

M1 - 26

ER -