Real-time adaptive algorithm for resource monitoring

作者: Mauro Andreolini , Michele Colajanni , Marcello Pietri , Stefania Tosi

DOI: 10.1109/CNSM.2013.6727811

关键词: Adaptive algorithmDistributed computingScalabilityCloud computingAdaptive samplingComputer scienceOverhead (computing)Real-time computingSampling (statistics)System monitoringServer

摘要: In large scale systems, real-time monitoring of hardware and software resources is a crucial means for any management purpose. architectures consisting thousands servers hundreds component resources, the amount data monitored at high sampling frequencies represents an overhead on system performance communication, while reducing may cause quality degradation. We present adaptive algorithm scalable that able to adapt frequency updating twofold goal: minimize computational communication costs, guarantee reduced samples do not affect accuracy information about resources. Experiments carried out heterogeneous traces referring synthetic real environments confirm proposed approach reduces utilization without penalizing with respect existing algorithms.

参考文章(25)
Ariel Rabkin, Randy Katz, Chukwa: a system for reliable large-scale log collection usenix large installation systems administration conference. pp. 1- 15 ,(2010)
Alexander Keller, Heiko Ludwig, The WSLA Framework: Specifying and Monitoring Service Level Agreements for Web Services Journal of Network and Systems Management. ,vol. 11, pp. 57- 81 ,(2003) , 10.1023/A:1022445108617
Eamonn J. Keogh, Michael J. Pazzani, A Simple Dimensionality Reduction Technique for Fast Similarity Search in Large Time Series Databases pacific asia conference on knowledge discovery and data mining. pp. 122- 133 ,(2000) , 10.1007/3-540-45571-X_14
Davood Rafiei, Alberto O. Mendelzon, Efficient Retrieval of Similar Time Sequences Using DFT. FODO. pp. 249- 257 ,(1998)
S Bohm, C Engelmann, S L Scott, Aggregation of Real-Time System Monitoring Data for Analyzing Large-Scale Parallel and Distributed Computing Environments high performance computing and communications. pp. 72- 78 ,(2010) , 10.1109/HPCC.2010.32
Jessica Lin, Eamonn Keogh, Stefano Lonardi, Bill Chiu, A symbolic representation of time series, with implications for streaming algorithms Proceedings of the 8th ACM SIGMOD workshop on Research issues in data mining and knowledge discovery - DMKD '03. pp. 2- 11 ,(2003) , 10.1145/882082.882086
Ulrich Appel, Achim V. Brandt, Adaptive sequential segmentation of piecewise stationary time series Information Sciences. ,vol. 29, pp. 27- 56 ,(1983) , 10.1016/0020-0255(83)90008-7
Brian Babcock, Shivnath Babu, Mayur Datar, Rajeev Motwani, Jennifer Widom, Models and issues in data stream systems symposium on principles of database systems. pp. 1- 16 ,(2002) , 10.1145/543613.543615
Mauro Andreolini, Michele Colajanni, Marcello Pietri, A Scalable Architecture for Real-Time Monitoring of Large Information Systems ieee international conference on cloud computing technology and science. pp. 143- 150 ,(2012) , 10.1109/NCCA.2012.24
J. R. Fienup, Invariant error metrics for image reconstruction Applied Optics. ,vol. 36, pp. 8352- 8357 ,(1997) , 10.1364/AO.36.008352