Personalized and Diverse Task Composition in Crowdsourcing

作者: Maha Alsayasneh , Sihem Amer-Yahia , Eric Gaussier , Vincent Leroy , Julien Pilourdault

DOI: 10.1109/TKDE.2017.2755660

关键词:

摘要: We study task composition in crowdsourcing and the effect of personalization diversity on performance. A central process is assignment, mechanism through which workers find tasks. On popular platforms such as Amazon Mechanical Turk, assignment facilitated by ability to sort tasks dimensions creation date or reward amount. Task improves producing for each worker, a personalized summary , referred Composite (CT). propose different ways CTs formulate an optimization problem that finds most relevant diverse . show empirically workers’ experience greatly improved due enforces adequation with skills preferences. also formalize various diversifying CT. grounded organization studies have shown its impact worker motivation  [33] Our experiments contribute improving outcome quality. More specifically, we while throughput retention are best ranked lists, crowdwork quality reaches diversified requesters, thereby confirming look expose their “good” work many requesters.

参考文章(57)
Thimo Schulze, Nicolas Kaufmann, Daniel J. Veit, More than fun and money. Worker motivation in crowdsourcing - a study on mechanical turk americas conference on information systems. ,(2011)
Eric Horvitz, Christopher H. Lin, Ece Kamar, Signals in the silence: models of implicit feedback in a recommendation system for crowdsourcing national conference on artificial intelligence. pp. 908- 914 ,(2014)
Chien-Ju Ho, Jennifer Wortman Vaughan, Shahin Jabbari, Adaptive Task Assignment for Crowdsourced Classification international conference on machine learning. pp. 534- 542 ,(2013)
Afshin Nikzad, Gagan Goel, Adish Singla, Mechanism Design for Crowdsourcing Markets with Heterogeneous Tasks national conference on artificial intelligence. ,(2014)
David M Blei, Andrew Y Ng, Michael I Jordan, None, Latent dirichlet allocation Journal of Machine Learning Research. ,vol. 3, pp. 993- 1022 ,(2003) , 10.5555/944919.944937
Walter Lasecki, Christopher Miller, Adam Sadilek, Andrew Abumoussa, Donato Borrello, Raja Kushalnagar, Jeffrey Bigham, Real-time captioning by groups of non-experts Proceedings of the 25th annual ACM symposium on User interface software and technology - UIST '12. pp. 23- 34 ,(2012) , 10.1145/2380116.2380122
Onn Shehory, Sarit Kraus, Methods for task allocation via agent coalition formation Artificial Intelligence. ,vol. 101, pp. 165- 200 ,(1998) , 10.1016/S0004-3702(98)00045-9
Alexandar Jaffe, Mor Naaman, Tamir Tassa, Marc Davis, Generating summaries and visualization for large collections of geo-referenced photographs multimedia information retrieval. pp. 89- 98 ,(2006) , 10.1145/1178677.1178692
Senjuti Basu Roy, Ioanna Lykourentzou, Saravanan Thirumuruganathan, Sihem Amer-Yahia, Gautam Das, Task assignment optimization in knowledge-intensive crowdsourcing very large data bases. ,vol. 24, pp. 467- 491 ,(2015) , 10.1007/S00778-015-0385-2
James C. Bezdek, Robert Ehrlich, William Full, FCM: The fuzzy c-means clustering algorithm Computers & Geosciences. ,vol. 10, pp. 191- 203 ,(1984) , 10.1016/0098-3004(84)90020-7