Datacomp: Locally Independent Adaptive Compression for Real-World Systems

作者: Peter A. H. Peterson , Peter L. Reiher

DOI: 10.1109/ICDCS.2016.106

关键词: Compression (functional analysis)Uncompressed videoAdaptive compressionDistributed computingComputer science

摘要: Non-lossy compression can save time and energy during communication if the cost to compress send input is less than of sending it uncompressed. Unfortunately, also degrade performance, no single method always beneficial, outcomes depend on many factors. As a result, choices in real systems are coarsely grained manually controlled, resulting suboptimal or even poor performance. Adaptive Compression (AC) make dynamically optimize utility. Existing AC limited ways that reduce their suitability for general-purpose computers. Datacomp an system operates locally includes significant hard-coded knowledge. Using real-world data, broad range environments Comptool "AC Oracle," we show Datacomp's performance equivalent close ideal at bandwidths between 1-100Mbit/s, when static strategies more costly compression. While struggles perform well 1Gbit/s, understanding why illustrates important challenges suggests solutions.

参考文章(15)
William Culhane, Statistical Measures as Predictors of Compression Savings The Ohio State University. ,(2008)
Bogdan Nicolae, On the Benefits of Transparent Compression for Cost-Effective Cloud Data Storage Transactions on Large-Scale Data- and Knowledge-Centered Systems III. ,vol. 3, pp. 167- 184 ,(2011) , 10.1007/978-3-642-23074-5_7
Kenneth C. Barr, Krste Asanović, Energy-aware lossless data compression ACM Transactions on Computer Systems. ,vol. 24, pp. 250- 291 ,(2006) , 10.1145/1151690.1151692
Yair Wiseman, Karsten Schwan, Patrick Widener, Efficient end to end data exchange using configurable compression Operating Systems Review. ,vol. 39, pp. 4- 23 ,(2005) , 10.1145/1075395.1075396
Yu Xiao, Matti Siekkinen, Antti Ylä-Jääski, Framework for Energy-Aware Lossless Compression in Mobile Services: The Case of E-Mail 2010 IEEE International Conference on Communications. pp. 1- 6 ,(2010) , 10.1109/ICC.2010.5502590
Björn Knutsson, Mats Björkman, Adaptive end-to-end compression for variable-bandwidth communication Computer Networks. ,vol. 31, pp. 767- 779 ,(1999) , 10.1016/S0169-7552(98)00299-2
E. Jeannot, Improving middleware performance with AdOC: an adaptive online compression library for data transfer international parallel and distributed processing symposium. pp. 70- 70 ,(2005) , 10.1109/IPDPS.2005.254
C. Krintz, S. Sucu, Adaptive on-the-fly compression IEEE Transactions on Parallel and Distributed Systems. ,vol. 17, pp. 15- 24 ,(2006) , 10.1109/TPDS.2006.3
N. Motgi, A. Mukherjee, Network conscious text compression system (NCTCSys) international conference on information technology coding and computing. pp. 440- 446 ,(2001) , 10.1109/ITCC.2001.918836