Fast large file distribution in data grid

作者: Tao Li , Binghang Yan , Zhongzhi Luan

DOI: 10.1109/ICISS.2010.5655344

关键词: Parallel computingComputer scienceReliability (computer networking)Node (networking)Key (cryptography)Transfer (computing)Grid computingGrid fileData grid

摘要: With more and data created by grid computing, large file distribution is a key issue in grid. Current usually style site-to-site this mechanism not efficient wastes bandwidth. In paper, we propose novel algorithm to distribute efficiently We split the into n subfiles transfer each subfile different node. And then node which receives transfers other nodes. The size of network environment. must compute using our simple but before splitting. To verify performance algorithm, build simulation system compare with Multiunicast FastReplica [1]. result shows significantly reduce time.

参考文章(17)
Qin Lv, Pei Cao, Edith Cohen, Kai Li, Scott Shenker, Search and replication in unstructured peer-to-peer networks international conference on supercomputing. pp. 84- 95 ,(2002) , 10.1145/2591635.2667182
Jangwon Lee, Gustavo de Veciana, On application-level load balancing in FastReplica Computer Communications. ,vol. 30, pp. 3218- 3231 ,(2007) , 10.1016/J.COMCOM.2007.01.013
Geoff Coulson, Gordon Blair, Paul Grace, Francois Taiani, Ackbar Joolia, Kevin Lee, Jo Ueyama, Thirunavukkarasu Sivaharan, A generic component model for building systems software ACM Transactions on Computer Systems. ,vol. 26, pp. 1- 42 ,(2008) , 10.1145/1328671.1328672
Yunhong Gu, Robert L. Grossman, UDT: UDP-based data transfer for high-speed wide area networks Computer Networks. ,vol. 51, pp. 1777- 1799 ,(2007) , 10.1016/J.COMNET.2006.11.009
C. Gkantsidis, P.R. Rodriguez, Network coding for large scale content distribution international conference on computer communications. ,vol. 4, pp. 2235- 2245 ,(2005) , 10.1109/INFCOM.2005.1498511
X. Zheng, C. Cho, Y. Xia, Optimal Peer-to-Peer Technique for Massive Content Distribution international conference on computer communications. pp. 151- 155 ,(2008) , 10.1109/INFOCOM.2008.39
Shui Yu, Zhongwen Li, None, Massive Data Delivery in Unstructured Peer-to-Peer Networks with Network Coding annual acis international conference on computer and information science. pp. 592- 597 ,(2007) , 10.1109/ICIS.2007.130
Xiaojun Hei, Chao Liang, Chao Liang, Keith W. Ross, Jian Liang, Yong Liu, Insights into PPLive: A Measurement Study of a Large-Scale P2P IPTV System ,(2006)
Dejan Kostić, Alex C. Snoeren, Amin Vahdat, Ryan Braud, Charles Killian, James W. Anderson, Jeannie Albrecht, Adolfo Rodriguez, Erik Vandekieft, High-bandwidth data dissemination for large-scale distributed systems ACM Transactions on Computer Systems. ,vol. 26, pp. 1- 61 ,(2008) , 10.1145/1328671.1328674
A. Benoit, V. Rehn-Sonigo, Y. Robert, Replica Placement and Access Policies in Tree Networks IEEE Transactions on Parallel and Distributed Systems. ,vol. 19, pp. 1614- 1627 ,(2008) , 10.1109/TPDS.2008.25