Data processing method and apparatus for distributed systems

作者: Guan Cheng Chen , Jian Li , Yan Li , Qiming Teng , Xin Li

DOI:

关键词: Node (computer science)Computer hardwareData processingDistributed computingData fileComputer science

摘要: A data processing method for a distributed system, the system comprising master storage node and multiple slave nodes, includes: storing, responsive to request writing file, replications of file on each being segmented into blocks same size, wherein sizes at least two are different; storing distribution information replications.

参考文章(15)
Roger Critchlow, Ronald Lachman, Stephen Ness, Robert Swartz, Timothy S. Murphy, Elan Pavlov, Methods and apparatus for distributed data storage ,(2011)
Himabindu Pucha, Renu Tewari, Prashant Pandey, Prasenjit Sarkar, Rajagopal Ananthanarayanan, Mansi Shah, Karan Gupta, Cloud analytics: do we really need to reinvent the storage stack? ieee international conference on cloud computing technology and science. pp. 15- ,(2009)
Tomasz Nowak, Antoni Sawicki, Network Distributed File System ,(2008)
Bin Cui, Xiaoming Li, Bo Peng, Implementation Issues of A Cloud Computing Platform. IEEE Data(base) Engineering Bulletin. ,vol. 32, pp. 59- 66 ,(2009)
Eric Sven-Johan Swildens, Vikas Garg, Richard David Day, Zaide "Edward" Liu, Distributed on-demand computing system ,(2006)
Andreas L. Bauer, Gregory W. Lazar, Richard J. Nordin, Sriram Krishnan, Data replication facility for distributed computing environments ,(2001)
Zoran Cakeljic, Sharon Galtzur, Samuel Krikler, Peter Kamvysselis, Dan Arnon, Yuval Ofek, Michael Hirsch, Apparatus and methods for copying, backing up, and restoring data using a backup segment size larger than the storage block size ,(1998)
Jeffrey Shafer, Scott Rixner, Alan L Cox, The Hadoop distributed filesystem: Balancing portability and performance international symposium on performance analysis of systems and software. pp. 122- 133 ,(2010) , 10.1109/ISPASS.2010.5452045