A flexible architecture integrating monitoring and analytics for managing large-scale data centers

作者: Chengwei Wang , Karsten Schwan , Vanish Talwar , Greg Eisenhauer , Liting Hu

DOI: 10.1145/1998582.1998605

关键词:

摘要: To effectively manage large-scale data centers and utility clouds, operators must understand current system application behaviors. This requires continuous, real-time monitoring along with on-line analysis of the captured by system, i.e., integrated analytics -- Monalytics [28]. A key challenge such integration is to balance costs incurred associated delays, against benefits attained from identifying reacting to, in a timely fashion, undesirable or non-performing states. paper presents novel, flexible architecture for which trade-offs are easily made dynamically constructing software overlays called Distributed Computation Graphs (DCGs) implement desired functions. The prototype implementing this evaluated motivating use cases small scale center experiments, series analytical models used above at large scales. Results show that approach provides flexibility needed meet demands autonomic management considerably better performance/cost than traditional brute force solutions.

参考文章(29)
Karsten Schwan, Liting Hu, Arpan Ghosh, Renuka Apte, Look who's talking: discovering dependencies between virtual machines using CPU utilization ieee international conference on cloud computing technology and science. pp. 17- 17 ,(2010)
Richard C. Harlan, Network management with Nagios Linux Journal. ,vol. 2003, pp. 3- ,(2003)
Justin Cappos, John H. Hartman, San Fermín: aggregating large data sets using a binomial swap forest networked systems design and implementation. pp. 147- 160 ,(2008)
Richard Mortier, Rebecca Isaacs, Austin Donnelly, Paul Barham, Using magpie for request extraction and workload modelling operating systems design and implementation. pp. 18- 18 ,(2004)
Emmanuel Cecchet, Sameh Elnikety, Anupam Chanda, Willy Zwaenepoel, Julie Marguerite, Performance comparison of middleware architectures for generating dynamic web content acm ifip usenix international conference on middleware. pp. 242- 261 ,(2003) , 10.5555/1515915.1515933
Nir Friedman, Dan Geiger, Moises Goldszmidt, Bayesian Network Classifiers Machine Learning. ,vol. 29, pp. 131- 163 ,(1997) , 10.1023/A:1007465528199
Dejan Milojicic, Praveen Yalagandula, Steven Y. Ko, Indranil Gupta, Vanish Talwar, Subu Iyer, Moara: flexible and scalable group-based querying system acm ifip usenix international conference on middleware. pp. 408- 428 ,(2008) , 10.5555/1496950.1496975
Robbert Van Renesse, Kenneth P. Birman, Werner Vogels, Astrolabe ACM Transactions on Computer Systems. ,vol. 21, pp. 164- 206 ,(2003) , 10.1145/762483.762485
Fazli Can, Incremental clustering for dynamic information processing ACM Transactions on Information Systems. ,vol. 11, pp. 143- 164 ,(1993) , 10.1145/130226.134466
Abhishek Kumar, Minho Sung, Jun (Jim) Xu, Jia Wang, Data streaming algorithms for efficient and accurate estimation of flow size distribution Proceedings of the joint international conference on Measurement and modeling of computer systems - SIGMETRICS 2004/PERFORMANCE 2004. ,vol. 32, pp. 177- 188 ,(2004) , 10.1145/1005686.1005709