PPMS: A Peer to Peer Metadata Management Strategy for Distributed File Systems

作者: Di Yang , Weigang Wu , Zhansong Li , Jiongyu Yu , Yong Li

DOI: 10.1007/978-3-662-44917-2_36

关键词:

摘要: Distributed file system is one of the key blocks cloud computing systems. With fast increase user scale and data amount, metadata management has become a crucial point affecting overall performance distributed system. In this paper, we design implement PPMS, novel strategy in peer to way. Different from existing methods, adopt two layer structure achieve high scalability low latency. The upper index server, which used store directories, while lower consists servers files. More importantly, organized way further improve scalability. We prototype based on PPMS evaluate its via experiments. results show that our can with terms time latency throughput.

参考文章(15)
Shankar Pasupathy, Andrew W. Leung, Timothy Bisson, Ethan L. Miller, Minglong Shao, Spyglass: fast, scalable metadata search for large-scale storage systems file and storage technologies. pp. 153- 166 ,(2009)
Swapnil Patil, Garth Gibson, Scale and concurrency of GIGA+: file system directories with millions of files file and storage technologies. ,vol. 2011, pp. 13- 13 ,(2011) , 10.5555/1960475.1960488
Drew Roselli, Thomas E. Anderson, Jacob R. Lorch, A comparison of file system workloads usenix annual technical conference. pp. 4- 4 ,(2000)
S.A. Weil, K.T. Pollack, S.A. Brandt, E.L. Miller, Dynamic Metadata Management for Petabyte-Scale File Systems conference on high performance computing (supercomputing). pp. 4- 4 ,(2004) , 10.1109/SC.2004.22
Andrei Broder, Michael Mitzenmacher, Network Applications of Bloom Filters: A Survey Internet Mathematics. ,vol. 1, pp. 485- 509 ,(2004) , 10.1080/15427951.2004.10129096
Carlos Maltzahn, Sage A. Weil, Ethan L. Miller, Darrell D. E. Long, Scott A. Brandt, Ceph: a scalable, high-performance distributed file system operating systems design and implementation. pp. 307- 320 ,(2006) , 10.5555/1298455.1298485
Juan Wang, Dan Feng, Fang Wang, Chengtao Lu, MHS: A distributed metadata management strategy Journal of Systems and Software. ,vol. 82, pp. 2004- 2011 ,(2009) , 10.1016/J.JSS.2009.06.042
Jiongyu Yu, Weigang Wu, Huaguan Li, DMooseFS: Design and implementation of distributed files system with distributed metadata server 2012 IEEE Asia Pacific Cloud Computing Congress (APCloudCC). pp. 42- 47 ,(2012) , 10.1109/APCLOUDCC.2012.6486509
Peter F. Corbett, Dror G. Feitelson, The Vesta parallel file system ACM Transactions on Computer Systems. ,vol. 14, pp. 225- 264 ,(1996) , 10.1145/233557.233558