Design Patterns for Hybrid Algorithmic-Crowdsourcing Workflows

作者: Christoph Lofi , Kinda El Maarry

DOI: 10.1109/CBI.2014.16

关键词:

摘要: Crowd sourcing has shown to be a powerful technique for over-coming many challenges in data and information processing where current state-of-the-art algorithms are still struggling. This is especially true workflows that transparently combine algorithmic heuristics dynamically crowd sourced tasks performed by human workers, which promise solve even more complex effectively efficiently. But still, such hybrid can difficult approach, they often designed an ad-hoc fashion. Therefore, this paper, we extensively investigate as described the literature, abstract generic design patterns, codify commonly recurring their best-practice solutions. Each pattern discussed with special focus on its requirements, constraints, effects overall workflow. We illustrate practicality of these patterns providing real-world application examples or have been applied. Furthermore, show-case how individual extended combined support workflows. Our provide extensive overview workflows' space, allow efficient modeling, analysis, documentation

参考文章(37)
Christoph Lofi, Kinda El Maarry, Wolf-Tilo Balke, Skyline Queries over Incomplete Data - Error Models for Focused Crowd-Sourcing international conference on conceptual modeling. pp. 298- 312 ,(2013) , 10.1007/978-3-642-41924-9_25
Martin Schader, Stefan Seedorf, Thimo Schulze, Robert C. Nickerson, David Geiger, Managing the Crowd: Towards a Taxonomy of Crowdsourcing Processes americas conference on information systems. ,(2011)
Omar Alonso, Ricardo Baeza-Yates, Design and Implementation of Relevance Assessments Using Crowdsourcing Lecture Notes in Computer Science. pp. 153- 164 ,(2011) , 10.1007/978-3-642-20161-5_16
Vamshi Ambati, Jaime G. Carbonell, Stephan Vogel, Active Learning and Crowd-Sourcing for Machine Translation language resources and evaluation. pp. 2169- 2174 ,(2010)
Anne C. Rouse, A Preliminary Taxonomy of Crowdsourcing ACIS 2010 : Information Systems : Defining and Establishing a High Impact Discipline : Proceedings of the 21st Australasian Conference on Information Systems. pp. 1- 10 ,(2010)
Richard Helm, John Vlissides, Ralph Johnson, Erich Gamma, Design Patterns: Elements of Reusable Object-Oriented Software ,(1994)
Romesh Ranawana, Vasile Palade, Multi-Classifier Systems: Review and a roadmap for developers hybrid intelligent systems. ,vol. 3, pp. 35- 61 ,(2006) , 10.3233/HIS-2006-3104
Saravanan . M.S, Rama Sree .R.J, Workflow driven Process controlling for unstructured activities European Journal of Business and Management. ,vol. 3, pp. 106- 110 ,(2011)
Pádraig Cunningham, Derek Greene, Anthony Brew, Using Crowdsourcing and Active Learning to Track Sentiment in Online Media european conference on artificial intelligence. pp. 145- 150 ,(2010) , 10.3233/978-1-60750-606-5-145