DIPStorage: Distributed storage of IP flow records
作者： Cristian Morariu , Thierry Kramis , Burkhard Stiller
DOI: 10.1109/LANMAN.2008.4675853
关键词: Internet traffic 、 Leverage (statistics) 、 Distributed database 、 Scalability 、 Gigabyte 、 Distributed data store 、 Computer science 、 Computer network 、 Group method of data handling 、 Software
摘要: The storage of IP traffic traces increasingly grows more complex, since data flows tend to increase largely over time. Network operatorpsilas backbones generate each day hundreds gigabyte flow records that need be stored and analyzed. Handling such amount requires a high-performance hardware software. One way leverage performance requirements storing analysis is design distributed platform replace centralized solutions existing today. This paper designs scalable for records. evaluation the implemented prototype shows an approach can offer good practical solution retrieving high amounts
sci-hub.se 参考文章(10)
Se-Hee Han, Myung-Sup Kim, Hong-Taek Ju, James Won-Ki Hong, The Architecture of NG-MON: A Passive Network Monitoring System for High-Speed IP Networks distributed systems operations and management. pp. 16- 27 ,(2002) , 10.1007/3-540-36110-3_5
Kimberly C. Claffy, George C. Polyzos, Hans-Werner Braun, Application of sampling methodologies to network traffic characterization acm special interest group on data communication. ,vol. 23, pp. 194- 203 ,(1993) , 10.1145/166237.166256
John Kubiatowicz, David Bindel, Yan Chen, Steven Czerwinski, Patrick Eaton, Dennis Geels, Ramakrishan Gummadi, Sean Rhea, Hakim Weatherspoon, Westley Weimer, Chris Wells, Ben Zhao, OceanStore: an architecture for global-scale persistent storage architectural support for programming languages and operating systems. ,vol. 35, pp. 190- 201 ,(2000) , 10.1145/356989.357007
Daniela Brauckhoff, Bernhard Tellenbach, Arno Wagner, Martin May, Anukool Lakhina, Impact of packet sampling on anomaly detection metrics internet measurement conference. pp. 159- 164 ,(2006) , 10.1145/1177080.1177101
Nick Duffield, Carsten Lund, Mikkel Thorup, Charging from sampled network usage Proceedings of the First ACM SIGCOMM Workshop on Internet Measurement - IMW '01. pp. 245- 256 ,(2001) , 10.1145/505202.505232
Jianning Mai, Chen-Nee Chuah, Ashwin Sridharan, Tao Ye, Hui Zang, Is sampled data sufficient for anomaly detection internet measurement conference. pp. 165- 176 ,(2006) , 10.1145/1177080.1177102
Y. Kitatsuji, K. Yamazaki, A distributed real-time tool for IP-flow measurement symposium on applications and the internet. pp. 91- 98 ,(2004) , 10.1109/SAINT.2004.1266103
N. Duffield, C. Lund, M. Thorup, Learn more, sample less: control of volume and variance in network measurement IEEE Transactions on Information Theory. ,vol. 51, pp. 1756- 1775 ,(2005) , 10.1109/TIT.2005.846400
N.G. Duffield, M. Grossglauser, Trajectory sampling for direct traffic observation IEEE ACM Transactions on Networking. ,vol. 9, pp. 280- 292 ,(2001) , 10.1109/90.929851
Tanja Zseby, Statistical Sampling for Non-Intrusive Measurements in IP Networks ,(2005) , 10.14279/DEPOSITONCE-1269