SUIF-Adapt: An Integrated Compiler/Run-Time System for Global and Dynamic Data Distributions

作者: D. Brent Weatherly , Donald G. Morris , Franklin Lowenthal , David K. Lowenthal

DOI:

关键词: Parallel computingKey (cryptography)Computer scienceSoftware distributed shared memoryInitial distributionCompilerTime systemDistributed computingDistribution (mathematics)Context (language use)Dynamic data

摘要: Distributing data is one of the key problems in implementing efficient distributed-memory parallel programs. The problem especially difficult programs where (1) redistribution between computational phases considered or (2) participating processors (nodes) executing a application are not dedicated. In either case, commonly usedBLOCK andCYCLIC distributions no longer suffice. We have investigated this context software distributed shared memory (SDSM) system. developed integrated compile- and run-time analysis for SDSM systems to support both single- multi-phase applications on potentially non-dedicated workstation clusters. Our system, SUIF-Adapt, selects an effective initial distribution per phase, finds global distribution, adapts changes underlying computing environment, including dynamic removal addition nodes. Each these features contributes good performance; particular, SUIF-Adapt performs significantly better than hand-coded static many distributions.

参考文章(27)
Liviu Iftode, Home-based shared virtual memory Princeton University. ,(1998)
Kai Zhang, John Mellor-Crummey, Robert J. Fowler, Compilation and Runtime-Optimizations for Software Distributed Shared Memory Lecture Notes in Computer Science. pp. 182- 191 ,(2000) , 10.1007/3-540-40889-4_14
Sotiris Ioannidis, Sandhya Dwarkadas, Compiler and Run-Time Support for Adaptive Load Balancing in Software Distributed Shared Memory Systems Lecture Notes in Computer Science. pp. 107- 122 ,(1998) , 10.1007/3-540-49530-4_8
Sandhya Dwarkadas, Alan L. Cox, Willy Zwaenepoel, Pete Keleher, TreadMarks: distributed shared memory on standard workstations and operating systems usenix winter technical conference. pp. 10- 10 ,(1994)
D.K. Lowenthal, G.R. Andrews, An adaptive approach to data placement international conference on parallel processing. pp. 349- 353 ,(1996) , 10.1109/IPPS.1996.508081
R. Wolski, N. Spring, J. Hayes, Predicting the CPU availability of time-shared Unix systems on the computational grid high performance distributed computing. pp. 12- ,(1999) , 10.1109/HPDC.1999.805288
Daniel J. Palermo, Prithviraj Banerjee, Automatic selection of dynamic data partitioning schemes for distributed-memory multicomputers Languages and Compilers for Parallel Computing. pp. 392- 406 ,(1996) , 10.1007/BFB0014213
Jaswinder Pal Singh, Wolf-Dietrich Weber, Anoop Gupta, SPLASH: Stanford parallel applications for shared-memory ACM Sigarch Computer Architecture News. ,vol. 20, pp. 5- 44 ,(1992) , 10.1145/130823.130824