Galileo: A Framework for Distributed Storage of High-Throughput Data Streams

作者: M. Malensek , S. L. Pallickara , S. Pallickara

DOI: 10.1109/UCC.2011.13

关键词:

摘要: We describe the design of a high-throughput storage system, Galileo, for data streams generated in observational settings. The shared-nothing architecture Galileo supports incremental assimilation nodes, while accounting heterogeneity their capabilities, to cope with volumes. To achieve efficient and retrievals data, accounts geospatial chronological characteristics such time-series streams. Our benchmarks demonstrate that specific portions large datasets supporting different types queries.

参考文章(16)
Fay Chang, Jeffrey Dean, Sanjay Ghemawat, Wilson C. Hsieh, Deborah A. Wallach, Mike Burrows, Tushar Chandra, Andrew Fikes, Robert E. Gruber, Bigtable ACM Transactions on Computer Systems. ,vol. 26, pp. 1- 26 ,(2008) , 10.1145/1365815.1365816
R. Rew, G. Davis, NetCDF: an interface for scientific data access IEEE Computer Graphics and Applications. ,vol. 10, pp. 76- 82 ,(1990) , 10.1109/38.56302
Paul G. Brown, Overview of sciDB Proceedings of the 2010 international conference on Management of data - SIGMOD '10. pp. 963- 968 ,(2010) , 10.1145/1807167.1807271
P. Cudre-Mauroux, H. Kimura, K.-T. Lim, J. Rogers, R. Simakov, E. Soroush, P. Velikhov, D. L. Wang, M. Balazinska, J. Becla, D. DeWitt, B. Heath, D. Maier, S. Madden, J. Patel, M. Stonebraker, S. Zdonik, A demonstration of SciDB: a science-oriented DBMS very large data bases. ,vol. 2, pp. 1534- 1537 ,(2009) , 10.14778/1687553.1687584
Yonggang Wang, Sheng Wang, Research and implementation on spatial data storage and operation based on Hadoop platform international conference on geoscience and remote sensing. ,vol. 2, pp. 275- 278 ,(2010) , 10.1109/IITA-GRS.2010.5603956
Avinash Lakshman, Prashant Malik, Cassandra: a decentralized structured storage system Operating Systems Review. ,vol. 44, pp. 35- 40 ,(2010) , 10.1145/1773912.1773922
Afsin Akdogan, Ugur Demiryurek, Farnoush Banaei-Kashani, Cyrus Shahabi, Voronoi-Based Geospatial Query Processing with MapReduce ieee international conference on cloud computing technology and science. pp. 9- 16 ,(2010) , 10.1109/CLOUDCOM.2010.92
Sanjay Ghemawat, Howard Gobioff, Shun-Tak Leung, The Google file system symposium on operating systems principles. ,vol. 37, pp. 29- 43 ,(2003) , 10.1145/1165389.945450
Konstantin Shvachko, Hairong Kuang, Sanjay Radia, Robert Chansler, The Hadoop Distributed File System ieee conference on mass storage systems and technologies. pp. 1- 10 ,(2010) , 10.1109/MSST.2010.5496972
Shrideep Pallickara, Jaliya Ekanayake, Geoffrey Fox, Granules: A lightweight, streaming runtime for cloud computing with support, for Map-Reduce international conference on cluster computing. pp. 1- 10 ,(2009) , 10.1109/CLUSTR.2009.5289160