A Modeling Language for MapReduce Programing in a Storage System Perspective

作者: Yuxin Jing , Hanpin Wang , Yu Huang , Lei Zhang , Yongzhi Cao

DOI: 10.1007/S11265-017-1298-7

关键词:

摘要: MapReduce is a powerful distributed data analysis programming model. It runs on big storage systems and processes in parallel way. An appropriate way to ensure the correctness of programs formal method analysis, which requires firstly model MapReduce. In this paper we propose modeling language establish framework. Unlike other approaches, our describes processing from perspective underlying files blocks, so that details can be clearly demonstrated. The based previous work, describing management massive systems, with extensions two aspects: block content refinement concurrency support. Based language, features discussed.

参考文章(34)
Inna Pereverzeva, Michael Butler, Asieh Salehi Fathabadi, Linas Laibinis, Elena Troubitsyna, Formal Derivation of Distributed MapReduce ABZ 2014 Proceedings of the 4th International Conference on Abstract State Machines, Alloy, B, TLA, VDM, and Z - Volume 8477. pp. 238- 254 ,(2014) , 10.1007/978-3-662-43652-3_21
Kosuke Ono, Yoichi Hirai, Yoshinori Tanabe, Natsuko Noda, Masami Hagiya, Using Coq in specification and program extraction of hadoop mapreduce applications international conference on software engineering. pp. 350- 365 ,(2011) , 10.1007/978-3-642-24690-6_24
Robin Milner, Communication and Concurrency ,(1989)
Fei Hu, Meikang Qiu, Jiayin Li, Travis Grant, Drew Taylor, Seth McCaleb, Lee Butler, Richard Hamner, A Review on Cloud Computing: Design Challenges in Architecture and Security computer and information technology. ,vol. 19, pp. 25- 55 ,(2011) , 10.2498/CIT.1001864
Edsger W. Dijkstra, Cooperating sequential processes The origin of concurrent programming. pp. 65- 138 ,(2002) , 10.1007/978-1-4757-3472-0_2
Susan Owicki, David Gries, Verifying properties of parallel programs Communications of the ACM. ,vol. 19, pp. 279- 285 ,(1976) , 10.1145/360051.360224
Zhi Chen, Meikang Qiu, Zhong Ming, Laurence T. Yang, Yongxin Zhu, Clustering scheduling for hardware tasks in reconfigurable computing systems Journal of Systems Architecture. ,vol. 59, pp. 1424- 1432 ,(2013) , 10.1016/J.SYSARC.2013.05.015
Alberto Núñez, Mercedes G. Merayo, A formal framework to analyze cost and performance in Map-Reduce based applications Journal of Computational Science. ,vol. 5, pp. 106- 118 ,(2014) , 10.1016/J.JOCS.2013.04.003
Howard Karloff, Siddharth Suri, Sergei Vassilvitskii, A model of computation for MapReduce symposium on discrete algorithms. pp. 938- 948 ,(2010) , 10.5555/1873601.1873677