D3N: A multi-layer cache for the rest of us
作者： Emine Ugur Kaynar , Mania Abdi , Mohammad Hossein Hajkazemi , Ata Turk , Raja R. Sambasivan
DOI: 10.1109/BIGDATA47090.2019.9006396
关键词: Network congestion 、 Bandwidth (computing) 、 Server 、 Computer science 、 Computer network 、 Upstream (networking) 、 Default gateway 、 Cache 、 Network topology
摘要: Current caching methods for improving the performance of big-data jobs assume high (e.g., full bi-section) bandwidth; however many enterprise data centers and co-location facilities have large network imbalances due to over-subscription incremental networking upgrades. We describe D3N, a multi-layer cooperative architecture that mitigates by on access side each layer hierarchical topology, adaptively adjusting cache sizes based observed workload patterns congestion. added (and submitted upstream) 2-layer D3N Ceph RADOS Gateway; read bandwidth achieves 5GB/s speed our SSDs, we show it substantially improves job while reducing traffic.
computer.org
sci-hub.se 参考文章(36)
Peter Vajgel, Jason Sobel, Sanjeev Kumar, Doug Beaver, Harry C. Li, Finding a needle in Haystack: facebook's photo storage operating systems design and implementation. pp. 47- 60 ,(2010) , 10.5555/1924943.1924947
Ashley Flavel, Pradeepkumar Mani, David Maltz, Nick Holt, Jie Liu, Yingying Chen, Oleg Surmachev, None, FastRoute: a scalable load-aware anycast routing architecture for modern CDNs networked systems design and implementation. pp. 381- 394 ,(2015)
Viswanath Sivakumar, Wyatt Lloyd, Linpeng Tang, Sanjeev Kumar, Sabyasachi Roy, Satadru Pan, Ernest Lin, Subramanian Muralidhar, Cory Hill, Shiva Shankar, Weiwen Liu, f4: Facebook's warm BLOB storage system operating systems design and implementation. pp. 383- 398 ,(2014) , 10.5555/2685048.2685078
Scott Shenker, Ali Ghodsi, Dhruba Borthakur, Srikanth Kandula, Ganesh Ananthanarayanan, Ion Stoica, Andrew Wang, PACMan: coordinated memory caching for parallel jobs networked systems design and implementation. pp. 20- 20 ,(2012)
Amin Vahdat, Barath Raghavan, Nelson Huang, Sivasankar Radhakrishnan, Mohammad Al-Fares, Hedera: dynamic flow scheduling for data center networks networked systems design and implementation. pp. 19- 19 ,(2010) , 10.5555/1855711.1855730
Asaf Cidon, Sachin Katti, Assaf Eisenman, Mohammad Alizadeh, Dynacache: dynamic cloud caching ieee international conference on cloud computing technology and science. pp. 19- 19 ,(2015)
A. Ford, C. Raiciu, M. Handley, O. Bonaventure, C. Paasch, TCP Extensions for Multipath Operation with Multiple Addresses Internet Engineering Task Force (IEFT). ,vol. 6824, pp. 1- 65 ,(2020) , 10.17487/RFC8684
Nimrod Megiddo, Dharmendra S. Modha, ARC: a self-tuning, low overhead replacement cache file and storage technologies. pp. 115- 130 ,(2003)
David Mazières, Michael J. Freedman, Siddhartha Annapureddy, Shark: scaling file servers via cooperative caching networked systems design and implementation. pp. 129- 142 ,(2005) , 10.5555/1251203.1251213
Robert Sedgewick, J. Ian Munro, Thomas Papadakis, Deterministic skip lists symposium on discrete algorithms. pp. 367- 375 ,(1992)