Positioning Dynamic Storage Caches for Transient Data

作者: Sudharshan S. Vazhkudai , Douglas Thain , Xiaosong Ma , Vincent W. Freeh

DOI: 10.1109/CLUSTR.2006.311900

关键词:

摘要: Simulations, experiments and observatories are generating a deluge of scientific data. Even more staggering is the ever growing application demand to process assimilate these datasets. Application users perform range data operations, collaborate share in many novel ways. The current storage landscape struggling keep up with trends processing. pay price due over-crowded shared filesystems, or expensive area networks, not enough local storage, high-latency archival wide-area transfers. In order sustain maximize I/O bandwidth relative increasing CPU speeds, applications must take advantage large amounts intermediate commodity However, presents new challenges above beyond traditional distributed file system paradigm: persistent scheduling, storage/CPU coallo-cation, namespace management, lifetime interfaces. this paper, we describe that require suggest several open research problems, illustrate two systems - Freeloader Tactical Storage attack different aspects problems

参考文章(22)
Wael R. Elwasif, Martin Swany, James S. Plank, Rich Wolski, Micah Beck, Terence Moore, The Internet Backplane Protocol: Storage in the Network ,(1999)
Jonathan Ilroy, Cyrille Randriamaro, Gil Utard, Improving MPI-I/O Performance on PVFS european conference on parallel processing. pp. 911- 915 ,(2001) , 10.1007/3-540-44681-8_126
Miron Livny, Douglas Thain, Parrot: Transparent User-Level Middleware for Data-Intensive Computing Scalable Computing: Practice and Experience. ,vol. 6, ,(2005) , 10.12694/SCPE.V6I3.333
Robert Kim Yates, Terry Jones, Richard Hedges, John May, Performance of an MPI-IO Implementation Using Third-Party Transfer. IEEE Symposium on Mass Storage Systems. pp. 75- 88 ,(2000)
Arie Shoshani, Alexander Sim, Junmin Gu, Storage resource managers: essential components for the Grid Grid resource management. pp. 321- 340 ,(2004)
Thomas Fuerle, Erich Schikuta, Christoph Loeffelhardt, Kurt Stockinger, Helmut Wanek, On the Implementation of a Portable, Client-Server Based MPI-IO Interface european pvm mpi users group meeting on recent advances in parallel virtual machine and message passing interface. pp. 172- 179 ,(1998) , 10.1007/BFB0056573
Jean-Pierre Prost, Richard Treumann, Richard Hedges, Alice Koniges, Alison White, Towards a High-Performance Implementation of MPI-IO on Top of GPFS european conference on parallel processing. pp. 1253- 1262 ,(2000) , 10.1007/3-540-44520-X_177
Stephen M. Kent, Sloan Digital Sky Survey Science with Astronomical Near-Infrared Sky Surveys. ,vol. 217, pp. 27- 30 ,(1994) , 10.1007/978-94-011-0946-8_6
G. Bell, J. Gray, A. Szalay, Petascale computational systems IEEE Computer. ,vol. 39, pp. 110- 112 ,(2006) , 10.1109/MC.2006.29
Xiaosong Ma, Vincent W. Freeh, Tao Yang, Sudharshan S. Vazhkudai, Tyler A. Simon, Stephen L. Scott, Coupling prefix caching and collective downloads for remote dataset access Proceedings of the 20th annual international conference on Supercomputing - ICS '06. pp. 229- 238 ,(2006) , 10.1145/1183401.1183435