Provisioning, Placement and Pipelining Strategies for Data-Intensive Applications in Cloud Environments

作者: Devarshi Ghoshal , Lavanya Ramakrishnan

DOI: 10.1109/IC2E.2014.66

关键词: Cloud testingData transmissionSet (abstract data type)TestbedScalabilityDistributed computingCloud computingComputer scienceReliability (computer networking)Provisioning

摘要: Clouds are increasingly being used for running data-intensive scientific applications. Data-intensive science applications need performance, scalability and reliability. However, these can be hard to achieve in cloud environments. Intelligent strategies required obtain better reliability on platforms. In this paper, we propose a set of pipelining effectively utilize provisioned resources. Our experiments the ExoGENI testbed demonstrates effectiveness our approach increasing performance reducing failures.

参考文章(17)
Ilia Baldine, Yufeng Xin, Anirban Mandal, Paul Ruth, Chris Heerman, Jeff Chase, ExoGENI: A Multi-domain Infrastructure-as-a-Service Testbed Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering. pp. 97- 113 ,(2012) , 10.1007/978-3-642-35576-9_12
Xiao Qin Jiong Xie, Shu Yin, Xiaojun Ruan, Zhiyang Ding, Yun Tian, James Majors, Adam Manzanares, None, Improving MapReduce performance through data placement in heterogeneous Hadoop clusters ieee international symposium on parallel distributed processing workshops and phd forum. pp. 1- 9 ,(2010) , 10.1109/IPDPSW.2010.5470880
Devarshi Ghoshal, Richard Shane Canon, Lavanya Ramakrishnan, I/O performance of virtualized cloud environments Proceedings of the second international workshop on Data intensive computing in the clouds. pp. 71- 80 ,(2011) , 10.1145/2087522.2087535
Devarshi Ghoshal, Lavanya Ramakrishnan, FRIEDA: Flexible Robust Intelligent Elastic Data Management in Cloud Environments ieee international conference on high performance computing data and analytics. pp. 1096- 1105 ,(2012) , 10.1109/SC.COMPANION.2012.132
Vinod Kumar Vavilapalli, Arun C. Murthy, Chris Douglas, Sharad Agarwal, Mahadev Konar, Robert Evans, Thomas Graves, Jason Lowe, Hitesh Shah, Siddharth Seth, Bikas Saha, Carlo Curino, Owen O'Malley, Sanjay Radia, Benjamin Reed, Eric Baldeschwieler, Apache Hadoop YARN: yet another resource negotiator symposium on cloud computing. pp. 5- ,(2013) , 10.1145/2523616.2523633
A.L. Chervenak, R. Schuler, M. Ripeanu, M. Ali Amer, S. Bharathi, I. Foster, A. Iamnitchi, C. Kesselman, The Globus Replica Location Service: Design and Experience IEEE Transactions on Parallel and Distributed Systems. ,vol. 20, pp. 1260- 1272 ,(2009) , 10.1109/TPDS.2008.151
Zacharia Fadika, Madhusudhan Govindaraju, Richard Canon, Lavanya Ramakrishnan, Evaluating Hadoop for Data-Intensive Scientific Operations international conference on cloud computing. pp. 67- 74 ,(2012) , 10.1109/CLOUD.2012.118
Sivadon Chaisiri, Bu-Sung Lee, Dusit Niyato, Optimization of Resource Provisioning Cost in Cloud Computing IEEE Transactions on Services Computing. ,vol. 5, pp. 164- 177 ,(2012) , 10.1109/TSC.2011.7
Guohui Wang, T. S. Eugene Ng, The Impact of Virtualization on Network Performance of Amazon EC2 Data Center international conference on computer communications. pp. 1163- 1171 ,(2010) , 10.1109/INFCOM.2010.5461931