Reducing access latency in erasure coded cloud storage with local block migration

作者: Yaochen Hu , Di Niu

DOI: 10.1109/INFOCOM.2016.7524628

关键词:

摘要: Erasure coding has been applied in many cloud storage systems to enhance reliability at a lower cost than replication. While large amount of prior work aims recovery performance and reliability, the overall access delay coded still needs be optimized. As most production adopt systematic code place original copy each block on only one server read normally, it is harder balance loads more likely incur latency tails three-way replication, where can from any 3 servers storing block. In this paper, we propose reduce by moving blocks with anti-correlated demands onto same for statistical load balancing. We formulate optimal placement as problem similar Min-k-Partition, local migration scheme, derive an approximation ratio function demand variation across blocks. Based request traces Windows Azure Storage, demonstrate that our scheme significantly few moves, especially when skewed.

参考文章(23)
Nicolas Bonvin, Thanasis G. Papaioannou, Karl Aberer, A self-organized, fault-tolerant and scalable replication scheme for cloud storage Proceedings of the 1st ACM symposium on Cloud computing - SoCC '10. pp. 205- 216 ,(2010) , 10.1145/1807128.1807162
Sanjay Ghemawat, Howard Gobioff, Shun-Tak Leung, The Google file system symposium on operating systems principles. ,vol. 37, pp. 29- 43 ,(2003) , 10.1145/1165389.945450
K.V. Rashmi, Nihar B. Shah, Dikang Gu, Hairong Kuang, Dhruba Borthakur, Kannan Ramchandran, A "hitchhiker's" guide to fast and efficient data reconstruction in erasure-coded data centers acm special interest group on data communication. ,vol. 44, pp. 331- 342 ,(2014) , 10.1145/2619239.2626325
B. W. Kernighan, S. Lin, An Efficient Heuristic Procedure for Partitioning Graphs Bell System Technical Journal. ,vol. 49, pp. 291- 307 ,(1970) , 10.1002/J.1538-7305.1970.TB01770.X
Richard M. Karp, Reducibility Among Combinatorial Problems. Complexity of Computer Computations. pp. 85- 103 ,(1972)
K.V. Rashmi, Nihar B. Shah, Dikang Gu, Hairong Kuang, Dhruba Borthakur, Kannan Ramchandran, A "hitchhiker's" guide to fast and efficient data reconstruction in erasure-coded data centers Computer Communication Review. ,(2014) , 10.1145/2740070.2626325
Paul Morris, The breakout method for escaping from local minima national conference on artificial intelligence. pp. 40- 45 ,(1993)
Cheng Huang, Yikang Xu, Brad Calder, Huseyin Simitci, Sergey Yekhanin, Aaron Ogus, Parikshit Gopalan, Jin Li, Erasure coding in windows azure storage usenix annual technical conference. pp. 2- 2 ,(2012)
James Plank, Randal Burns, Cheng Huang, Osama Khan, William Pierce, Rethinking erasure codes for cloud file systems: minimizing I/O for recovery and degraded reads file and storage technologies. pp. 20- 20 ,(2012) , 10.5555/2208461.2208481