The Vesta parallel file system

作者: Peter F. Corbett , Dror G. Feitelson

DOI: 10.1145/233557.233558

关键词:

摘要: The Vesta parallel file system is designed to provide access application programs running on multicomputers with I/O subsystems. uses a new abstraction of files: not sequence bytes, but rather it can be partitioned into multiple disjoint sequences that are accessed in parallel. partitioning—which also changed dynamically—reduces the need for synchronization and coordination during access. Some control over layout data provided, so matched anticipated patterns. fully implemented forms basis AIX Parallel File System IBM SP2. implementation does compromise scalability or parallelism. In fact, all accesses done directly node contains requested data, without any indirection shared metadata. Disk mapping caching functions confined each node, there no keep coherent across nodes. Performance measurements shown good increased resources. Moreover, different patterns show achieve similar performance.

参考文章(37)
Rick Wheeler, Andy Nanopoulos, Ewan Milne, Bill Nesheim, Susan J. LoVerso, Marshall Isman, sfs: a parallel file system for the CM-5 usenix summer technical conference. pp. 19- ,(1993)
Paul J. Roy, Unix File Access and Caching in a Multicomputer Environment MSYM'93 Proceedings of the 3rd conference on USENIX MACH III Symposium - Volume 1. pp. 21- 38 ,(1993)
E.A. Brewer, B.C. Kuszmaul, How to get good performance from the CM-5 data network international parallel processing symposium. pp. 858- 867 ,(1994) , 10.1109/IPPS.1994.288205
D.G. Feitelson, Terminal I/O for massively parallel systems ieee international conference on high performance computing data and analytics. pp. 263- 270 ,(1994) , 10.1109/SHPCC.1994.296653
C.B. Stunkel, D.G. Shea, D.G. Grice, P.H. Hochschild, M. Tsao, The SP1 high-performance switch ieee international conference on high performance computing data and analytics. pp. 150- 157 ,(1994) , 10.1109/SHPCC.1994.296638
J. S. Vitter, E. A. M. Shriver, Optimal disk I/O with parallel block transfer symposium on the theory of computing. pp. 159- 169 ,(1990) , 10.1145/100216.100234
P. F. Corbett, D. G. Feitelson, J.-P. Prost, G. S. Almasi, S. J. Baylor, A. S. Bolmarcich, Y. Hsu, J. Satran, M. Snir, R. Colao, B. D. Herr, J. Kavaky, T. R. Morgan, A. Zlotek, Parallel file systems for the IBM SP computers Ibm Systems Journal. ,vol. 34, pp. 222- 248 ,(1995) , 10.1147/SJ.342.0222
Eliezer Levy, Abraham Silberschatz, None, Distributed file systems: concepts and examples ACM Computing Surveys. ,vol. 22, pp. 321- 374 ,(1990) , 10.1145/98163.98169
J.C. French, T.W. Pratt, M. Das, Performance measurement of the concurrent file system of the Intel iPSC/2 hypercube Journal of Parallel and Distributed Computing. ,vol. 17, pp. 115- 121 ,(1993) , 10.1006/JPDC.1993.1009
Mark H. Nodine, Jeffrey Scott Vitter, Large-scale sorting in parallel memories (extended abstract) Proceedings of the third annual ACM symposium on Parallel algorithms and architectures - SPAA '91. pp. 29- 39 ,(1991) , 10.1145/113379.113382