Task allocation for crowdsourcing using AI planning

Leticia Machado; Rafael Prikladnicki; Felipe Meneguzzi; Cleidson R. B.  de Souza; Erran  Carmel

doi:10.1145/2897659.2897666

Task allocation for crowdsourcing using AI planning

Leticia Machado, Rafael Prikladnicki, Felipe Meneguzzi, Cleidson R. B. de Souza, Erran Carmel

Computing Science

Research output: Chapter in Book/Report/Conference proceeding › Published conference contribution

15 Citations (Scopus)

Abstract

Crowdsourcing is a relatively new phenomenon in computer science and software engineering. In crowdsourcing a task is delivered to a crowd of participants who will work on this task. Task allocation is then an important aspect in the context of crowdsourcing. If done properly, it delivers successful results based on the answers provided by the crowd. However, task allocation in crowdsourcing is not a trivial problem. Factors like a task’s requirements, the knowledge required for its resolution, and the size and heterogeneity of the participants in the crowd all impact task allocation, and therefore, the expected quality of the task results. In this case, the execution of actions from a plan, which assist the dynamic tasks’ allocation in crowdsourcing systems, become relevant as an alternative solution. This paper formalizes task allocation in crowdsourcing scenarios as an artificial intelligence planning problem. Our results suggest that task allocation has several challenges when it is observed in distributed, undefined and dynamic environments, like in crowdsourcing scenarios. Our goal is to evaluate if automated planning is appropriate for providing a plan to match skills of crowd workers for the right tasks in software engineering projects.

Original language	English
Title of host publication	CrowdSourcing in Software Engineering (CSI-SE), 2016 IEEE/ACM 3rd International Workshop on
Publisher	IEEE Explore
Pages	36-40
Number of pages	5
Edition	January 2017
ISBN (Electronic)	9781450341585
DOIs	https://doi.org/10.1145/2897659.2897666
Publication status	Published - 14 May 2016
Event	2016 IEEE/ACM 3rd International Workshop on CrowdSourcing in Software Engineering (CSI-SE) - Austin, United States Duration: 16 May 2016 → 16 May 2016 https://ieeexplore.ieee.org/xpl/conhome/7808224/proceeding

Publication series

Name	IEEE/ACM International Workshop on CrowdSourcing in Software Engineering (CSI-SE)
Publisher	IEEE
Volume	3rd

Conference

Conference	2016 IEEE/ACM 3rd International Workshop on CrowdSourcing in Software Engineering (CSI-SE)
Country/Territory	United States
City	Austin
Period	16/05/16 → 16/05/16
Internet address	https://ieeexplore.ieee.org/xpl/conhome/7808224/proceeding

Bibliographical note

ACKNOWLEDGMENT
This work is partially sponsored by the Brazilian Law 8.248/91. This
research is also partially funded by CNPq (406692/2013-0 and
301136/2014-9). Rafael Prikladnicki is a CNPq researcher
(312127/2015-4). Felipe Meneguzzi thanks CNPq for support within process numbers 306864/2013-4 under the PQ fellowship and 482156/2013-9 under the Universal project programs.

Copyright: © 2016 ACM

Keywords

Crowdsourcing
automated planning
task allocation
software engineering

Access to Document

10.1145/2897659.2897666Licence: Unspecified

Cite this

Machado, L., Prikladnicki, R., Meneguzzi, F., de Souza, C. R. B., & Carmel, E. (2016). Task allocation for crowdsourcing using AI planning. In CrowdSourcing in Software Engineering (CSI-SE), 2016 IEEE/ACM 3rd International Workshop on (January 2017 ed., pp. 36-40). Article 7809396 (IEEE/ACM International Workshop on CrowdSourcing in Software Engineering (CSI-SE); Vol. 3rd ). IEEE Explore. https://doi.org/10.1145/2897659.2897666

Task allocation for crowdsourcing using AI planning. / Machado, Leticia; Prikladnicki, Rafael; Meneguzzi, Felipe et al.
CrowdSourcing in Software Engineering (CSI-SE), 2016 IEEE/ACM 3rd International Workshop on. January 2017. ed. IEEE Explore, 2016. p. 36-40 7809396 (IEEE/ACM International Workshop on CrowdSourcing in Software Engineering (CSI-SE); Vol. 3rd ).

Research output: Chapter in Book/Report/Conference proceeding › Published conference contribution

Machado, L, Prikladnicki, R, Meneguzzi, F, de Souza, CRB & Carmel, E 2016, Task allocation for crowdsourcing using AI planning. in CrowdSourcing in Software Engineering (CSI-SE), 2016 IEEE/ACM 3rd International Workshop on. January 2017 edn, 7809396, IEEE/ACM International Workshop on CrowdSourcing in Software Engineering (CSI-SE), vol. 3rd , IEEE Explore, pp. 36-40, 2016 IEEE/ACM 3rd International Workshop on CrowdSourcing in Software Engineering (CSI-SE), Austin, Texas, United States, 16/05/16. https://doi.org/10.1145/2897659.2897666

Machado L, Prikladnicki R, Meneguzzi F, de Souza CRB, Carmel E. Task allocation for crowdsourcing using AI planning. In CrowdSourcing in Software Engineering (CSI-SE), 2016 IEEE/ACM 3rd International Workshop on. January 2017 ed. IEEE Explore. 2016. p. 36-40. 7809396. (IEEE/ACM International Workshop on CrowdSourcing in Software Engineering (CSI-SE)). doi: 10.1145/2897659.2897666

@inproceedings{432d0fb4e0fe4aac83c37a05da25cf18,

title = "Task allocation for crowdsourcing using AI planning",

abstract = "Crowdsourcing is a relatively new phenomenon in computer science and software engineering. In crowdsourcing a task is delivered to a crowd of participants who will work on this task. Task allocation is then an important aspect in the context of crowdsourcing. If done properly, it delivers successful results based on the answers provided by the crowd. However, task allocation in crowdsourcing is not a trivial problem. Factors like a task{\textquoteright}s requirements, the knowledge required for its resolution, and the size and heterogeneity of the participants in the crowd all impact task allocation, and therefore, the expected quality of the task results. In this case, the execution of actions from a plan, which assist the dynamic tasks{\textquoteright} allocation in crowdsourcing systems, become relevant as an alternative solution. This paper formalizes task allocation in crowdsourcing scenarios as an artificial intelligence planning problem. Our results suggest that task allocation has several challenges when it is observed in distributed, undefined and dynamic environments, like in crowdsourcing scenarios. Our goal is to evaluate if automated planning is appropriate for providing a plan to match skills of crowd workers for the right tasks in software engineering projects.",

keywords = "Crowdsourcing, automated planning, task allocation, software engineering",

author = "Leticia Machado and Rafael Prikladnicki and Felipe Meneguzzi and {de Souza}, {Cleidson R. B.} and Erran Carmel",

note = "ACKNOWLEDGMENT This work is partially sponsored by the Brazilian Law 8.248/91. This research is also partially funded by CNPq (406692/2013-0 and 301136/2014-9). Rafael Prikladnicki is a CNPq researcher (312127/2015-4). Felipe Meneguzzi thanks CNPq for support within process numbers 306864/2013-4 under the PQ fellowship and 482156/2013-9 under the Universal project programs. Copyright: {\textcopyright} 2016 ACM; 2016 IEEE/ACM 3rd International Workshop on CrowdSourcing in Software Engineering (CSI-SE) ; Conference date: 16-05-2016 Through 16-05-2016",

year = "2016",

month = may,

day = "14",

doi = "10.1145/2897659.2897666",

language = "English",

series = "IEEE/ACM International Workshop on CrowdSourcing in Software Engineering (CSI-SE)",

publisher = "IEEE Explore",

pages = "36--40",

booktitle = "CrowdSourcing in Software Engineering (CSI-SE), 2016 IEEE/ACM 3rd International Workshop on",

edition = "January 2017",

url = "https://ieeexplore.ieee.org/xpl/conhome/7808224/proceeding",

}

TY - GEN

T1 - Task allocation for crowdsourcing using AI planning

AU - Machado, Leticia

AU - Prikladnicki, Rafael

AU - Meneguzzi, Felipe

AU - de Souza, Cleidson R. B.

AU - Carmel, Erran

N1 - ACKNOWLEDGMENT This work is partially sponsored by the Brazilian Law 8.248/91. This research is also partially funded by CNPq (406692/2013-0 and 301136/2014-9). Rafael Prikladnicki is a CNPq researcher (312127/2015-4). Felipe Meneguzzi thanks CNPq for support within process numbers 306864/2013-4 under the PQ fellowship and 482156/2013-9 under the Universal project programs. Copyright: © 2016 ACM

PY - 2016/5/14

Y1 - 2016/5/14

N2 - Crowdsourcing is a relatively new phenomenon in computer science and software engineering. In crowdsourcing a task is delivered to a crowd of participants who will work on this task. Task allocation is then an important aspect in the context of crowdsourcing. If done properly, it delivers successful results based on the answers provided by the crowd. However, task allocation in crowdsourcing is not a trivial problem. Factors like a task’s requirements, the knowledge required for its resolution, and the size and heterogeneity of the participants in the crowd all impact task allocation, and therefore, the expected quality of the task results. In this case, the execution of actions from a plan, which assist the dynamic tasks’ allocation in crowdsourcing systems, become relevant as an alternative solution. This paper formalizes task allocation in crowdsourcing scenarios as an artificial intelligence planning problem. Our results suggest that task allocation has several challenges when it is observed in distributed, undefined and dynamic environments, like in crowdsourcing scenarios. Our goal is to evaluate if automated planning is appropriate for providing a plan to match skills of crowd workers for the right tasks in software engineering projects.

AB - Crowdsourcing is a relatively new phenomenon in computer science and software engineering. In crowdsourcing a task is delivered to a crowd of participants who will work on this task. Task allocation is then an important aspect in the context of crowdsourcing. If done properly, it delivers successful results based on the answers provided by the crowd. However, task allocation in crowdsourcing is not a trivial problem. Factors like a task’s requirements, the knowledge required for its resolution, and the size and heterogeneity of the participants in the crowd all impact task allocation, and therefore, the expected quality of the task results. In this case, the execution of actions from a plan, which assist the dynamic tasks’ allocation in crowdsourcing systems, become relevant as an alternative solution. This paper formalizes task allocation in crowdsourcing scenarios as an artificial intelligence planning problem. Our results suggest that task allocation has several challenges when it is observed in distributed, undefined and dynamic environments, like in crowdsourcing scenarios. Our goal is to evaluate if automated planning is appropriate for providing a plan to match skills of crowd workers for the right tasks in software engineering projects.

KW - Crowdsourcing

KW - automated planning

KW - task allocation

KW - software engineering

U2 - 10.1145/2897659.2897666

DO - 10.1145/2897659.2897666

M3 - Published conference contribution

T3 - IEEE/ACM International Workshop on CrowdSourcing in Software Engineering (CSI-SE)

SP - 36

EP - 40

BT - CrowdSourcing in Software Engineering (CSI-SE), 2016 IEEE/ACM 3rd International Workshop on

PB - IEEE Explore

T2 - 2016 IEEE/ACM 3rd International Workshop on CrowdSourcing in Software Engineering (CSI-SE)

Y2 - 16 May 2016 through 16 May 2016

ER -

Task allocation for crowdsourcing using AI planning

Abstract

Publication series

Conference

Bibliographical note

Keywords

Access to Document

Fingerprint

Cite this