Building high accuracy bloom filters using partitioned hashing

作者: Fang Hao , Murali Kodialam , T. V. Lakshman

DOI: 10.1145/1254882.1254916

关键词:

摘要: The growing importance of operations such as packet-content inspection, packet classification based on non-IP headers, maintaining flow-state, etc. has led to increased interest in the networking applications Bloom filters. This is because filters provide a relatively easy method for hardware implementation set-membership queries. However, tradeoff that only probabilistic test and membership queries can result false positives. Ideally, we would like this positive probability be very low. main contribution paper significantly reducing comparison existing schemes. done by developing partitioned hashing which results choice hash functions set far fewer bits filter bit vector than case otherwise. lower fill factor translates much probability. We show experimentally improved ten-fold increase accuracy over standard also scheme performs better other proposed schemes improving

参考文章(14)
Li Fan, Pei Cao, J. Almeida, A.Z. Broder, Summary cache: a scalable wide-area web cache sharing protocol IEEE ACM Transactions on Networking. ,vol. 8, pp. 281- 293 ,(2000) , 10.1109/90.851975
Udi Manber, Sun Wu, An algorithm for approximate membership checking with application to password security Information Processing Letters. ,vol. 50, pp. 191- 197 ,(1994) , 10.1016/0020-0190(94)00032-8
Adam Kirsch, Michael Mitzenmacher, Less Hashing, Same Performance: Building a Better Bloom Filter Lecture Notes in Computer Science. pp. 456- 467 ,(2006) , 10.1007/11841036_42
Anna Ostlin, Rasmus Pagh, Uniform hashing in constant time and linear space symposium on the theory of computing. pp. 622- 628 ,(2003) , 10.1145/780542.780633
Rajeev Motwani, Prabhakar Raghavan, Randomized Algorithms ,(1995)
Eugene H. Spafford, Refereed articles: OPUS: Preventing weak password choices Computers & Security. ,vol. 11, pp. 273- 278 ,(1992) , 10.1016/0167-4048(92)90207-8
Robert Sedgewick, Algorithms in C ,(1990)
Cristian Estan, George Varghese, New directions in traffic measurement and accounting Proceedings of the First ACM SIGCOMM Workshop on Internet Measurement - IMW '01. ,vol. 32, pp. 323- 336 ,(2001) , 10.1145/505202.505212
Andrei Broder, Michael Mitzenmacher, Network Applications of Bloom Filters: A Survey Internet Mathematics. ,vol. 1, pp. 485- 509 ,(2004) , 10.1080/15427951.2004.10129096
Ronitt Rubinfeld, Bernard Chazelle, Joe Kilian, Ayellet Tal, The Bloomier filter: an efficient data structure for static support lookup tables symposium on discrete algorithms. pp. 30- 39 ,(2004) , 10.5555/982792.982797