I/O Characterization of Big Data Workloads in Data Centers

作者: Fengfeng Pan , Yinliang Yue , Jin Xiong , Daxiang Hao

DOI: 10.1007/978-3-319-13021-7_7

关键词:

摘要: As the amount of data explodes rapidly, more and organizations tend to use centers make effective decisions gain a competitive edge. Big applications have gradually dominated workloads, hence it has been increasingly important understand their behaviour in order further improve performance centers. Due constantly increased gap between I/O devices CPUs, dominates overall system performance, so characterizing big workloads is imperative.

参考文章(21)
Yanpei Chen, Sara Alspaugh, Randy H. Katz, Design Insights for MapReduce from Diverse Production Workloads Defense Technical Information Center. ,(2012) , 10.21236/ADA555881
Christoph Kirsch, Gernot Heiser, Proceedings of the sixth conference on Computer systems european conference on computer systems. ,(2011)
Guy Blelloch, Aapo Kyrola, Carlos Guestrin, GraphChi: large-scale graph computation on just a PC operating systems design and implementation. ,vol. 2012, pp. 31- 46 ,(2012) , 10.5555/2387880.2387884
Cristina L. Abad, Nathan Roberts, Yi Lu, Roy H. Campbell, A storage-centric analysis of MapReduce workloads: File popularity, temporal locality and arrival patterns ieee international symposium on workload characterization. pp. 100- 109 ,(2012) , 10.1109/IISWC.2012.6402909
Cristina L. Abad, Yi Lu, Roy H. Campbell, DARE: Adaptive Data Replication for Efficient Cluster Scheduling 2011 IEEE International Conference on Cluster Computing. pp. 159- 168 ,(2011) , 10.1109/CLUSTER.2011.26
Sriram Sankar, Kushagra Vaid, Storage characterization for unstructured data in online services applications ieee international symposium on workload characterization. pp. 148- 157 ,(2009) , 10.1109/IISWC.2009.5306786
Zujie Ren, Xianghua Xu, Jian Wan, Weisong Shi, Min Zhou, Workload characterization on a production Hadoop cluster: A case study on Taobao ieee international symposium on workload characterization. pp. 3- 13 ,(2012) , 10.1109/IISWC.2012.6402895
Yanpei Chen, Kiran Srinivasan, Garth Goodson, Randy Katz, Design implications for enterprise storage systems via multi-dimensional trace analysis Proceedings of the Twenty-Third ACM Symposium on Operating Systems Principles - SOSP '11. pp. 43- 56 ,(2011) , 10.1145/2043556.2043562
Christina Delimitrou, Sriram Sankar, Kushagra Vaid, Christos Kozyrakis, Decoupling datacenter studies from access to large-scale applications: A modeling approach for storage workloads ieee international symposium on workload characterization. pp. 51- 60 ,(2011) , 10.1109/IISWC.2011.6114196
Ganesh Ananthanarayanan, Sameer Agarwal, Srikanth Kandula, Albert Greenberg, Ion Stoica, Duke Harlan, Ed Harris, Scarlett Proceedings of the sixth conference on Computer systems - EuroSys '11. pp. 287- 300 ,(2011) , 10.1145/1966445.1966472