Incremental Parallel and Distributed Systems

作者: Pramod Kumar Bhatotia

DOI: 10.22028/D291-25419

关键词:

摘要: Incremental computation strives for efficient successive runs of applications by reexecuting only those parts the that are affected a given input change instead recomputing everything from scratch. To realize benefits incremental computation, researchers and practitioners developing new systems where application programmer can provide an update mechanism changing data. Unfortunately, most existing solutions limiting because they not depart programming models, but also require programmers to devise (or dynamic algorithm) on per-application basis. In this thesis, we present parallel distributed enable real-world automatically benefit updates. Our approach neither requires departure current models programming, nor design implementation algorithms. achieve these goals, have designed built following systems: (i) Incoop — system MapReduce computation; (ii) Shredder GPU-accelerated storage; (iii) Slider stream processing platform slidingwindow analytics; (iv) iThreads threading library computation. experience with shows significant performance be achieved without requiring any additional effort programmers.

参考文章(120)
Fred Douglis, Philip Shilane, Sazzala Reddy, Kai Li, Wei Dong, Hugo Patterson, Tradeoffs in scalable data routing for deduplication clusters file and storage technologies. pp. 2- 2 ,(2011) , 10.5555/1960475.1960477
Marcel Dischinger, Krishna P. Gummadi, Ratul Mahajan, Massimiliano Marcon, Stefan Saroiu, Saikat Guha, Glasnost: enabling end users to detect traffic differentiation networked systems design and implementation. pp. 27- 27 ,(2010) , 10.5555/1855711.1855738
Jerzy Szczepkowski, Michal Welnicki, Lukasz Heldt, Wojciech Kilian, Cristian Ungureanu, Michal Kaczmarczyk, Przemyslaw Strzelczak, Cezary Dubnicki, Leszek Gryz, HYDRAstor: a Scalable Secondary Storage file and storage technologies. pp. 197- 210 ,(2009)
Kave Eshghi, Mark Lillibridge, Deepavali Bhagwat, Peter Camble, Vinay Deolalikar, Greg Trezise, Sparse indexing: large scale, inline deduplication using sampling and locality file and storage technologies. pp. 111- 123 ,(2009)
Irfan Ahmad, Austin T. Clements, Murali Vilayannur, Jinyuan Li, Decentralized deduplication in SAN cluster file systems usenix annual technical conference. pp. 8- 8 ,(2009)
Soyeon Park, Weiwei Xiong, Zhiqiang Ma, Yuanyuan Zhou, Jiaqi Zhang, Ad hoc synchronization considered harmful operating systems design and implementation. pp. 163- 176 ,(2010) , 10.5555/1924943.1924955
Petros Efstathopoulos, Fanglu Guo, Building a high-performance deduplication system usenix annual technical conference. pp. 25- 25 ,(2011)
Sangjin Han, KyoungSoo Park, Keon Jang, Seungyeop Han, Sue Moon, SSLShader: cheap SSL acceleration with commodity processors networked systems design and implementation. pp. 1- 14 ,(2011) , 10.5555/1972457.1972459
Kai Li, Hugo Patterson, Benjamin Zhu, Avoiding the disk bottleneck in the data domain deduplication file system file and storage technologies. pp. 18- ,(2008)
Incremental MapReduce Computations Taylor and Francis. pp. 127- 150 ,(2014) , 10.1201/B17112-5