Dynamic load balancing in MPI jobs

作者: Gladys Utrera , Julita Corbalán , Jesús Labarta

DOI: 10.1007/978-3-540-77704-5_10

关键词:

摘要: There are at least three dimensions of overhead to be considered by any parallel job scheduling algorithm: load balancing, synchronization, and communication overhead. In this work we first study several heuristics choose the next run from a global processes queue. After that present mechanism decide runtime weather apply Local process queue per processor or Global job, depending on balancing degree without previous knowledge it.

参考文章(33)
William R. Crowther, Robert H. Thomas, The Uniform System: An approach to runtime support for large scale shared memory parallel processors. international conference on parallel processing. pp. 245- 254 ,(1988)
Hung-Yang Chang, Bryan S. Rosenburg, Ray Bryant, Experience Developing the RP3 Operating System. Computing Systems. ,vol. 4, pp. 183- 216 ,(1991)
Xavier Martorell, Julita Corbalán, Dimitrios S. Nikolopoulos, Nacho Navarro, Eleftherios D. Polychronopoulos, Theodore S., JesÚs Labarta, A Tool to Schedule Parallel Applications on Multiprocessors: The NANOS CPU MANAGER job scheduling strategies for parallel processing. pp. 87- 112 ,(2000) , 10.1007/3-540-39997-6_7
F. Hofmann, M. Cin, A. Grygier, H. Hessenauer, U. Hildebrand, C.-U. Linster, T. Thiel, S. Turowski, MEMSY - A Modular Expandable Multiprocessor System Parallel Computer Architectures: Theory, Hardware, Software, Applications. pp. 15- 30 ,(1993) , 10.1007/3-540-57307-0_23
Eric de Sturler, Milind Bhandarkar, L. V. Kalé, Object-Based Adaptive Load Balancing for MPI Programs∗ ,(2000)
Toni Cortes, Nacho Navarro, Albert Serra, DITools: application-level support for dynamic extension and flexible composition usenix annual technical conference. pp. 19- 19 ,(2000)
Dror G. Feitelson, Morris A. Jettee, Improved Utilization and Responsiveness with Gang Scheduling job scheduling strategies for parallel processing. pp. 238- 261 ,(1997) , 10.1007/3-540-63574-2_24
Gladys Utrera, Julita Corbalán, Jesús Labarta, Scheduling of MPI Applications: Self-co-scheduling Lecture Notes in Computer Science. pp. 238- 245 ,(2004) , 10.1007/978-3-540-27866-5_31
Message P Forum, None, MPI: A Message-Passing Interface Standard University of Tennessee. ,(1994)
Milind Bhandarkar, Laxmikant V Kalé, Eric de Sturler, Jay Hoeflinger, Adaptive Load Balancing for MPI Programs international conference on computational science. pp. 108- 117 ,(2001) , 10.1007/3-540-45718-6_13