A Variable Markovian Based Outlier Detection Method for Multi-Dimensional Sequence over Data Stream

作者: Dongsheng Yang , Yijie Wang , Yongmou Li , Xingkong Ma

DOI: 10.1109/PDCAT.2016.049

关键词:

摘要: Nowadays sequence data tends to be multi-dimensional over stream, it has a large state space and arrives at unprecedented speed. It is big challenge design outlier detection method meet the accurate high speed requirements. The traditional methods can't handle effectively as they have poor abilities for modeling, detect timely computational complexity. In this paper we propose variable Markovian based VMOD, which consists of two algorithms: mutual information feature selection algorithm (MIFS), sequential analysis (VMSA). uses MIFS reduce redundant features, VMSA accelerate detection. Through VMOD method, can improve rate similarity measures adopt clustering strategy select modeling through reducing consequently, rate. use random sample index structure model construction complexity, quicken experiments show that effectively, time by least 50% compared with methods.

参考文章(12)
Mohamed Cherif Dani, Cassiano Freixo, Francois-Xavier Jollois, Mohamed Nadif, Unsupervised anomaly detection for Aircraft Condition Monitoring System ieee aerospace conference. pp. 1- 7 ,(2015) , 10.1109/AERO.2015.7119138
Yuan Wang, Yijie Wang, Xiaoyong Li, Xiaoling Li, A survey of queries over uncertain data Knowledge and Information Systems. ,vol. 37, pp. 485- 530 ,(2013) , 10.1007/S10115-013-0638-6
V. Chandola, A. Banerjee, V. Kumar, Anomaly Detection for Discrete Sequences: A Survey IEEE Transactions on Knowledge and Data Engineering. ,vol. 24, pp. 823- 839 ,(2012) , 10.1109/TKDE.2010.235
Qian Quan, Wu Jinlin, Zhu Wei, Xin Mingjun, None, Improved Edit Distance Method for System Call Anomaly Detection computer and information technology. pp. 1097- 1102 ,(2012) , 10.1109/CIT.2012.223
Eamonn Keogh, Kaushik Chakrabarti, Michael Pazzani, Sharad Mehrotra, Dimensionality reduction for fast similarity search in large time series databases Knowledge and Information Systems. ,vol. 3, pp. 263- 286 ,(2001) , 10.1007/PL00011669
Xiaoyong Li, Yijie Wang, Xiaoling Li, Yuan Wang, Parallelizing skyline queries over uncertain data streams with sliding window partitioning and grid index Knowledge and Information Systems. ,vol. 41, pp. 277- 309 ,(2014) , 10.1007/S10115-013-0725-8
Varun Chandola, Arindam Banerjee, Vipin Kumar, Anomaly detection: A survey ACM Computing Surveys. ,vol. 41, pp. 15- ,(2009) , 10.1145/1541880.1541882
PALLABI PARVEEN, NATHAN MCDANIEL, ZACKARY WEGER, JONATHAN EVANS, BHAVANI THURAISINGHAM, KEVIN HAMLEN, LATIFUR KHAN, EVOLVING INSIDER THREAT DETECTION STREAM MINING PERSPECTIVE International Journal on Artificial Intelligence Tools. ,vol. 22, pp. 1360013- ,(2013) , 10.1142/S0218213013600130
Tengke Xiong, Shengrui Wang, Qingshan Jiang, Joshua Zhexue Huang, A New Markov Model for Clustering Categorical Sequences international conference on data mining. pp. 854- 863 ,(2011) , 10.1109/ICDM.2011.13
J. Yang, W. Wang, CLUSEQ: efficient and effective sequence clustering international conference on data engineering. pp. 101- 112 ,(2003) , 10.1109/ICDE.2003.1260785