Load Balancing of Irregular Parallel Divide-and-Conquer Algorithms in Group-SPMD Programming Environments

作者: Mikhail Chalabine , Christoph Kessler , Mattias Eriksson

DOI:

关键词:

摘要: We study strategies for local load balancing of irregular parallel divide-and- conquer algorithms such as Quicksort and Quickhull in SPMD-parallel environments MPI Fork that allow to exploit nested parallelism by dynamic group split- ting. propose two new strategies, repivoting serialisation, develop a hybrid strategy, which is calibrated parameters are derived off-line from programming optimisation. While the approach generic, we have implemented evaluated our method very different plat- forms. found strategy superior global on Linux cluster, while latter performs better tightly synchronised shared- memory platform with nonblocking, cheap task queue access.

参考文章(10)
William D. Gropp, Ewing L. Lusk, Anthony Skjellum, Using MPI-2nd Edition ,(1999)
Jesper Larsson Träff, Jörg Keller, Christoph Kessler, Practical PRAM programming ,(2000)
William D. Gropp, Ewing L. Lusk, Anthony Skjellum, Toolseeram Ramjeawon, Portable Parallel Programming with the Message-Passing Interface ,(1996)
Hui Li, Kenneth C. Sevcik, Parallel sorting by over partitioning Proceedings of the sixth annual ACM symposium on Parallel algorithms and architectures - SPAA '94. pp. 46- 56 ,(1994) , 10.1145/181014.192329
Thomas Rauber, Gudula Rünger, Tlib-a library to support programming with hierarchical multi-processor tasks Journal of Parallel and Distributed Computing. ,vol. 65, pp. 347- 360 ,(2005) , 10.1016/J.JPDC.2004.10.006
CHRISTOPH A. HERRMANN, CHRISTIAN LENGAUER, Parallelization of divide-and-conquer by translation to nested loops Journal of Functional Programming. ,vol. 9, pp. 279- 310 ,(1999) , 10.1017/S0956796899003287
Christoph W. Keßler, NestStep: Nested Parallelism and Virtual Shared Memory for the BSP Model The Journal of Supercomputing. ,vol. 17, pp. 245- 262 ,(2000) , 10.1023/A:1026511306490
David Culler, Richard Karp, David Patterson, Abhijit Sahay, Klaus Erik Schauser, Eunice Santos, Ramesh Subramonian, Thorsten von Eicken, LogP: towards a realistic model of parallel computation Proceedings of the fourth ACM SIGPLAN symposium on Principles and practice of parallel programming - PPOPP '93. ,vol. 28, pp. 1- 12 ,(1993) , 10.1145/155332.155333
Thomas T. Cormen, Ronald L. Rivest, Charles E. Leiserson, Introduction to Algorithms ,(1990)
M.Komp, Adhi Harmoko S, Joseph Marie Jacquard, Eniac, Konrad Zuse, Introduction to Algorithms ,(2005)