Research and performance evaluation of data replication technology in distributed storage systems

作者: Yijie Wang , Sijun Li

DOI: 10.1016/J.CAMWA.2006.05.002

关键词:

摘要: Replication is a key technology of distributed storage systems. In this paper, an indirect replication algorithm is proposed following the intrinsic characteristic of distributed storage systems and the peer-to-peer model. In the indirect replication algorithm, the data object is partitioned into several data blocks. These data blocks are encoded in order that there is data redundancy between data blocks. Comparing with the traditional replication algorithm, the indirect replication algorithm has less granularity of replication, less bandwidth and …

参考文章(10)
Eran Gabber, Banu Özden, Michael Flaster, Elizabeth A. M. Shriver, Wee Teck Ng, Fengrui Gu, Bruce Hillyer, Jeff Fellin, StarFish: Highly Available Block Storage usenix annual technical conference. pp. 151- 163 ,(2003)
Dongsheng Li, Xinxin Fang, Yijie Wang, Xicheng Lu, Kai Lu, Nong Xiao, A Scalable Peer-to-Peer Network with Constant Degree Lecture Notes in Computer Science. pp. 414- 424 ,(2003) , 10.1007/978-3-540-39425-9_49
Michael Luby, Tornado Codes: Practical Erasure Codes Based on Random Irregular Graphs randomization and approximation techniques in computer science. ,vol. 1518, pp. 171- 171 ,(1998) , 10.1007/3-540-49543-6_14
P. Druschel, A. Rowstron, PAST: a large-scale, persistent peer-to-peer storage utility Proceedings Eighth Workshop on Hot Topics in Operating Systems. pp. 75- 80 ,(2001) , 10.1109/HOTOS.2001.990064
John Kubiatowicz, David Bindel, Yan Chen, Steven Czerwinski, Patrick Eaton, Dennis Geels, Ramakrishan Gummadi, Sean Rhea, Hakim Weatherspoon, Westley Weimer, Chris Wells, Ben Zhao, OceanStore: an architecture for global-scale persistent storage architectural support for programming languages and operating systems. ,vol. 35, pp. 190- 201 ,(2000) , 10.1145/356989.357007
D.A. Spielman, Linear-time encodable and decodable error-correcting codes IEEE Transactions on Information Theory. ,vol. 42, pp. 1723- 1731 ,(1996) , 10.1109/18.556668
Edith Cohen, Scott Shenker, Replication strategies in unstructured peer-to-peer networks Proceedings of the 2002 conference on Applications, technologies, architectures, and protocols for computer communications - SIGCOMM '02. ,vol. 32, pp. 177- 190 ,(2002) , 10.1145/633025.633043
Jussi Kangasharju, James Roberts, Keith W. Ross, Object replication strategies in content distribution networks Computer Communications. ,vol. 25, pp. 376- 383 ,(2002) , 10.1016/S0140-3664(01)00409-1
Ion Stoica, Robert Morris, David Karger, M. Frans Kaashoek, Hari Balakrishnan, Chord Proceedings of the 2001 conference on Applications, technologies, architectures, and protocols for computer communications - SIGCOMM '01. ,vol. 31, pp. 149- 160 ,(2001) , 10.1145/383059.383071
Ian Clarke, Oskar Sandberg, Brandon Wiley, Theodore W. Hong, Freenet: a distributed anonymous information storage and retrieval system privacy enhancing technologies. pp. 46- 66 ,(2001) , 10.1007/3-540-44702-4_4