Big data and semantics management system for computer networks

作者: Bassem Mokhtar , Mohamed Eltoweissy

DOI: 10.1016/J.ADHOC.2016.06.013

关键词: Big dataComputer scienceMachine learningSocial networkSyntax (programming languages)Network managementThe InternetHidden Markov modelLatent Dirichlet allocationArtificial intelligenceMemory managementSemanticsData mining

摘要: We define Big Networks as those that generate big data and can benefit from management in their operations. Examples of networks include the current Internet emerging things social networks. The ever-increasing scale, complexity heterogeneity make it harder to discover emergent anomalous behavior network traffic. hypothesize endowing otherwise semantically-oblivious with memory mimicking human functionalities would help advance capability learn, conceptualize effectively efficiently store traffic behavior, more accurately predict future events. Inspired by memory, we proposed a distributed system, termed NetMem, extract utilize semantics matching prediction processes. In particular, explore Hidden Markov Models (HMM), Latent Dirichlet Allocation (LDA), simple statistical analysis-based techniques for semantic reasoning NetMem. Additionally, propose hybrid intelligence technique integrating LDA HMM based on learning patterns features syntax dependencies. also locality sensitive hashing reducing dimensionality. Our simulation study using real demonstrates benefits NetMem highlights advantages limitations aforementioned techniques.

参考文章(46)
István Bíró, Jácint Szabó, Latent Dirichlet allocation for automatic document categorization european conference on machine learning. pp. 430- 441 ,(2009) , 10.1007/978-3-642-04174-7_28
David M Blei, Andrew Y Ng, Michael I Jordan, None, Latent dirichlet allocation Journal of Machine Learning Research. ,vol. 3, pp. 993- 1022 ,(2003) , 10.5555/944919.944937
Taketoshi Mori, Akinori Fujii, Masamichi Shimosaka, Hiroshi Noguchi, Tomomasa Sato, Typical Behavior Patterns Extraction and Anomaly Detection Algorithm Based on Accumulated Home Sensor Data international conference on future generation communication and networking. ,vol. 2, pp. 12- 18 ,(2007) , 10.1109/FGCN.2007.226
Sujni Paul, An Optimized Distributed Association Rule Mining Algorithm in Parallel and Distributed Data Mining with XML Data for Improved Response Time International Journal of Computer Science and Information Technology. ,vol. 2, pp. 90- 103 ,(2010) , 10.5121/IJCSIT.2010.2208
Gulshan Kumar, Krishan Kumar, Monika Sachdeva, The use of artificial intelligence based techniques for intrusion detection: a review Artificial Intelligence Review. ,vol. 34, pp. 369- 387 ,(2010) , 10.1007/S10462-010-9179-5
Manabu Nii, Kazuki Nakai, Yutaka Takahashi, Kohei Higuchi, Kazusuke Maenaka, Behavior extraction from multiple sensors information for human activity monitoring systems, man and cybernetics. pp. 1157- 1161 ,(2011) , 10.1109/ICSMC.2011.6083831
Joakim Jiten, Bernard Merialdo, Benoit Huet, Semantic feature extraction with multidimensional hidden Markov model electronic imaging. ,vol. 6073, ,(2006) , 10.1117/12.650590
Shehroz S. Khan, Michelle E. Karg, Jesse Hoey, Dana Kulic, Towards the detection of unusual temporal events during activities using HMMs ubiquitous computing. pp. 1075- 1084 ,(2012) , 10.1145/2370216.2370444
Kees Dorst, Pieter E. Vermaas, John Gero’s Function-Behaviour-Structure model of designing: a critical analysis Research in Engineering Design. ,vol. 16, pp. 17- 26 ,(2005) , 10.1007/S00163-005-0058-Z