Context-aware result inference in crowdsourcing

作者: Yili Fang , Hailong Sun , Guoliang Li , Richong Zhang , Jingpeng Huai

DOI: 10.1016/J.INS.2018.05.050

关键词:

摘要: Abstract Many result inference methods have been proposed to address the quality-control problem in crowdsourcing. However, existing are ineffective for context-sensitive tasks ( CSTs ), e.g., handwriting recognition, translation, speech transcription, where context correlation within a task cannot be ignored two reasons. Firstly, it is crowdsource whole CST (e.g., recognizing handwritten texts) and use task-level infer answer, because rather hard correctly complete complicated task. Secondly, although composed of set atomic subtasks word), unsuitable split into multiple adopt subtask-level algorithm result, this will lose phrases) among increase difficulty Thus calls new approach handling . In work, we study propose context-aware algorithm. We design an by incorporating information. Furthermore, introduce iterative method improve quality. The results experiments on real-world demonstrated superiority our compared with state-of-the-art methods.

参考文章(50)
Mark Dredze, Koby Crammer, Partha Pratim Talukdar, Sequence Learning from Data with Multiple Labels ,(2009)
A. P. Dawid, A. M. Skene, Maximum Likelihood Estimation of Observer Error‐Rates Using the EM Algorithm Journal of The Royal Statistical Society Series C-applied Statistics. ,vol. 28, pp. 20- 28 ,(1979) , 10.2307/2346806
Long Tran-Thanh, Trung Dong Huynh, Sarvapali D. Ramchurn, Nicholas R. Jennings, Avi Rosenfeld, Crowdsourcing complex workflows under budget constraints national conference on artificial intelligence. pp. 1298- 1304 ,(2015)
Aashish Sheshadri, Matthew Lease, None, SQUARE: A Benchmark for Research on Computing Crowd Consensus national conference on artificial intelligence. ,(2013)
Alex Waibel, Kai-Fu Lee, Readings in speech recognition Morgan Kaufmann Publishers Inc.. ,(1990)
Tao Gu, Hung Keng Pung, Da Qing Zhang, A middleware for building context-aware mobile services vehicular technology conference. ,vol. 5, pp. 2656- 2660 ,(2004) , 10.1109/VETECS.2004.1391402
Yves Normandin, Maximum Mutual Information Estimation of Hidden Markov Models Springer, Boston, MA. pp. 57- 81 ,(1996) , 10.1007/978-1-4613-1367-0_3
Anind K. Dey, Understanding and Using Context ubiquitous computing. ,vol. 5, pp. 4- 7 ,(2001) , 10.1007/S007790170019
Yan Wang, Jianmin Jiang, Tingting Mu, Context-Aware and Energy-Driven Route Optimization for Fully Electric Vehicles via Crowdsourcing IEEE Transactions on Intelligent Transportation Systems. ,vol. 14, pp. 1331- 1345 ,(2013) , 10.1109/TITS.2013.2261064