Independent counter estimation buckets

作者: Gil Einziger , Benny Fellman , Yaron Kassner

DOI: 10.1109/INFOCOM.2015.7218646

关键词:

摘要: Measurement capabilities are essential for a variety of network applications, such as load balancing, routing, fairness and intrusion detection. These require large counter arrays in order to monitor the traffic all flows. While commodity SRAM memories capable operating at line speed, they too small accommodate arrays. Previous works suggested estimators, which trade precision reduced space. However, accurately estimate largest counter, these methods compromise accuracy rest counters. In this work we present closed form representation optimal estimation function. We then introduce Independent Counter Estimation Buckets (ICE-Buckets), novel algorithm that improves This is achieved by separating flows buckets configuring function according each bucket's scale. prove an improved upper bound on relative error demonstrate improvement up 57 times real Internet packet traces.

参考文章(26)
Andreas Herkersdorf, Gero Dittmann, Network Processor Load Balancing for High-Speed Links ,(2000)
Cristian Estan, George Varghese, New directions in traffic measurement and accounting Proceedings of the First ACM SIGCOMM Workshop on Internet Measurement - IMW '01. ,vol. 32, pp. 323- 336 ,(2001) , 10.1145/505202.505212
Baek-Young Choi, Jaesung Park, Zhi-Li Zhang, Adaptive random sampling for load change detection measurement and modeling of computer systems. ,vol. 30, pp. 272- 273 ,(2002) , 10.1145/511334.511376
Petra Šparl, Janez Žerovnik, 2-local 4/3-competitive algorithm for multicoloring hexagonal graphs Journal of Algorithms. ,vol. 55, pp. 29- 41 ,(2005) , 10.1016/J.JALGOR.2004.09.001
Yi Lu, Andrea Montanari, Balaji Prabhakar, Sarang Dharmapurikar, Abdul Kabbani, Counter braids Proceedings of the 2008 ACM SIGMETRICS international conference on Measurement and modeling of computer systems - SIGMETRICS '08. ,vol. 36, pp. 121- 132 ,(2008) , 10.1145/1375457.1375472
Robert Morris, None, Counting large numbers of events in small registers Communications of the ACM. ,vol. 21, pp. 840- 842 ,(1978) , 10.1145/359619.359627
D. Shah, S. Iyer, B. Prahhakar, N. McKeown, Maintaining statistics counters in router line cards IEEE Micro. ,vol. 22, pp. 76- 81 ,(2002) , 10.1109/40.988692
Graham Cormode, S. Muthukrishnan, An improved data stream summary: the count-min sketch and its applications Journal of Algorithms. ,vol. 55, pp. 58- 75 ,(2005) , 10.1016/J.JALGOR.2003.12.001
Erez Tsidon, Iddo Hanniel, Isaac Keslassy, Estimators also need shared values to grow together international conference on computer communications. pp. 1889- 1897 ,(2012) , 10.1109/INFCOM.2012.6195564
Yeonhee Lee, Youngseok Lee, Toward scalable internet traffic measurement and analysis with Hadoop acm special interest group on data communication. ,vol. 43, pp. 5- 13 ,(2012) , 10.1145/2427036.2427038