Truth Discovery in Crowdsourced Detection of Spatial Events

Robin Wentao Ouyang, Mani Srivastava, Alice Toniolo, Timothy J. Norman

Research output: Contribution to journalArticle

21 Citations (Scopus)
15 Downloads (Pure)

Abstract

The ubiquity of smartphones has led to the emergence of mobile crowdsourcing tasks such as the detection of spatial events when smartphone users move around in their daily lives. However, the credibility of those detected events can be negatively impacted by unreliable participants with low-quality data. Consequently, a major challenge in mobile crowdsourcing is truth discovery, i.e., to discover true events from diverse and noisy participants’ reports. This problem is uniquely distinct from its online counterpart in that it involves uncertainties in both participants’ mobility and reliability. Decoupling these two types of uncertainties through location tracking will raise severe privacy and energy issues, whereas simply ignoring missing reports or treating them as negative reports will significantly degrade the accuracy of truth discovery. In this paper, we propose two new unsupervised models, i.e., Truth finder for Spatial Events (TSE) and Personalized Truth finder for Spatial Events (PTSE), to tackle this problem. In TSE, we model location popularity, location visit indicators, truths of events, and three-way participant reliability in a unified framework. In PTSE, we further model personal location visit tendencies. These proposed models are capable of effectively handling various types of uncertainties and automatically discovering truths without any supervision or location tracking. Experimental results on both real-world and synthetic datasets demonstrate that our proposed models outperform existing state-of-the-art truth discovery approaches in the mobile crowdsourcing environment.
Original languageEnglish
Pages (from-to)1047-1060
Number of pages14
JournalIEEE Transactions on Knowledge and Data Engineering
Volume28
Issue number4
Early online date3 Dec 2015
DOIs
Publication statusPublished - 1 Apr 2016

Fingerprint

Smartphones
Uncertainty

Keywords

  • Mobile crowdsourcing
  • truth discovery
  • probabilistic graphical models

Cite this

Truth Discovery in Crowdsourced Detection of Spatial Events. / Ouyang, Robin Wentao; Srivastava, Mani; Toniolo, Alice; Norman, Timothy J.

In: IEEE Transactions on Knowledge and Data Engineering, Vol. 28, No. 4, 01.04.2016, p. 1047-1060.

Research output: Contribution to journalArticle

Ouyang, Robin Wentao ; Srivastava, Mani ; Toniolo, Alice ; Norman, Timothy J. / Truth Discovery in Crowdsourced Detection of Spatial Events. In: IEEE Transactions on Knowledge and Data Engineering. 2016 ; Vol. 28, No. 4. pp. 1047-1060.
@article{49c38fba68794fd58199b37835d4544e,
title = "Truth Discovery in Crowdsourced Detection of Spatial Events",
abstract = "The ubiquity of smartphones has led to the emergence of mobile crowdsourcing tasks such as the detection of spatial events when smartphone users move around in their daily lives. However, the credibility of those detected events can be negatively impacted by unreliable participants with low-quality data. Consequently, a major challenge in mobile crowdsourcing is truth discovery, i.e., to discover true events from diverse and noisy participants’ reports. This problem is uniquely distinct from its online counterpart in that it involves uncertainties in both participants’ mobility and reliability. Decoupling these two types of uncertainties through location tracking will raise severe privacy and energy issues, whereas simply ignoring missing reports or treating them as negative reports will significantly degrade the accuracy of truth discovery. In this paper, we propose two new unsupervised models, i.e., Truth finder for Spatial Events (TSE) and Personalized Truth finder for Spatial Events (PTSE), to tackle this problem. In TSE, we model location popularity, location visit indicators, truths of events, and three-way participant reliability in a unified framework. In PTSE, we further model personal location visit tendencies. These proposed models are capable of effectively handling various types of uncertainties and automatically discovering truths without any supervision or location tracking. Experimental results on both real-world and synthetic datasets demonstrate that our proposed models outperform existing state-of-the-art truth discovery approaches in the mobile crowdsourcing environment.",
keywords = "Mobile crowdsourcing, truth discovery, probabilistic graphical models",
author = "Ouyang, {Robin Wentao} and Mani Srivastava and Alice Toniolo and Norman, {Timothy J.}",
note = "ACKNOWLEDGMENTS This research is based upon work supported in part by the US ARL and UK Ministry of Defense under Agreement Number W911NF-06-3-0001, and by the NSF under award CNS-1213140. Any opinions, findings and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views or represent the official policies of the NSF, the US ARL, the US Government, the UK Ministry of Defense or the UK Government. The US and UK Governments are authorized to reproduce and distribute reprints for Government purposes notwithstanding any copyright notation hereon.",
year = "2016",
month = "4",
day = "1",
doi = "10.1109/TKDE.2015.2504928",
language = "English",
volume = "28",
pages = "1047--1060",
journal = "IEEE Transactions on Knowledge and Data Engineering",
issn = "1041-4347",
publisher = "IEEE COMPUTER SOC",
number = "4",

}

TY - JOUR

T1 - Truth Discovery in Crowdsourced Detection of Spatial Events

AU - Ouyang, Robin Wentao

AU - Srivastava, Mani

AU - Toniolo, Alice

AU - Norman, Timothy J.

N1 - ACKNOWLEDGMENTS This research is based upon work supported in part by the US ARL and UK Ministry of Defense under Agreement Number W911NF-06-3-0001, and by the NSF under award CNS-1213140. Any opinions, findings and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views or represent the official policies of the NSF, the US ARL, the US Government, the UK Ministry of Defense or the UK Government. The US and UK Governments are authorized to reproduce and distribute reprints for Government purposes notwithstanding any copyright notation hereon.

PY - 2016/4/1

Y1 - 2016/4/1

N2 - The ubiquity of smartphones has led to the emergence of mobile crowdsourcing tasks such as the detection of spatial events when smartphone users move around in their daily lives. However, the credibility of those detected events can be negatively impacted by unreliable participants with low-quality data. Consequently, a major challenge in mobile crowdsourcing is truth discovery, i.e., to discover true events from diverse and noisy participants’ reports. This problem is uniquely distinct from its online counterpart in that it involves uncertainties in both participants’ mobility and reliability. Decoupling these two types of uncertainties through location tracking will raise severe privacy and energy issues, whereas simply ignoring missing reports or treating them as negative reports will significantly degrade the accuracy of truth discovery. In this paper, we propose two new unsupervised models, i.e., Truth finder for Spatial Events (TSE) and Personalized Truth finder for Spatial Events (PTSE), to tackle this problem. In TSE, we model location popularity, location visit indicators, truths of events, and three-way participant reliability in a unified framework. In PTSE, we further model personal location visit tendencies. These proposed models are capable of effectively handling various types of uncertainties and automatically discovering truths without any supervision or location tracking. Experimental results on both real-world and synthetic datasets demonstrate that our proposed models outperform existing state-of-the-art truth discovery approaches in the mobile crowdsourcing environment.

AB - The ubiquity of smartphones has led to the emergence of mobile crowdsourcing tasks such as the detection of spatial events when smartphone users move around in their daily lives. However, the credibility of those detected events can be negatively impacted by unreliable participants with low-quality data. Consequently, a major challenge in mobile crowdsourcing is truth discovery, i.e., to discover true events from diverse and noisy participants’ reports. This problem is uniquely distinct from its online counterpart in that it involves uncertainties in both participants’ mobility and reliability. Decoupling these two types of uncertainties through location tracking will raise severe privacy and energy issues, whereas simply ignoring missing reports or treating them as negative reports will significantly degrade the accuracy of truth discovery. In this paper, we propose two new unsupervised models, i.e., Truth finder for Spatial Events (TSE) and Personalized Truth finder for Spatial Events (PTSE), to tackle this problem. In TSE, we model location popularity, location visit indicators, truths of events, and three-way participant reliability in a unified framework. In PTSE, we further model personal location visit tendencies. These proposed models are capable of effectively handling various types of uncertainties and automatically discovering truths without any supervision or location tracking. Experimental results on both real-world and synthetic datasets demonstrate that our proposed models outperform existing state-of-the-art truth discovery approaches in the mobile crowdsourcing environment.

KW - Mobile crowdsourcing

KW - truth discovery

KW - probabilistic graphical models

U2 - 10.1109/TKDE.2015.2504928

DO - 10.1109/TKDE.2015.2504928

M3 - Article

VL - 28

SP - 1047

EP - 1060

JO - IEEE Transactions on Knowledge and Data Engineering

JF - IEEE Transactions on Knowledge and Data Engineering

SN - 1041-4347

IS - 4

ER -