Mixing ranks, tasks, progress and nonblocking collectives

作者: Jean-Baptiste Besnard , Julien Jaeger , Allen D. Malony , Sameer Shende , Hugo Taboada

DOI: 10.1145/3343211.3343221

关键词:

摘要: Since the beginning, MPI has defined rank as an implicit attribute associated with process' environment. In particular, each process generally runs inside a given UNIX and is fixed identifier in its WORLD communicator. However, this state of things about to change rise new abstractions such Sessions. paper, we propose outline how evolution could enable optimizations which were previously linked specific runtimes executing processes shared memory (e.g. thread-based MPI). By implementing runtime-level work-sharing through what define tasks, enabling ability progress indifferently from stream context show that there potential for improved asynchronous progress. absence Session implementation, assumption validated where nonblocking Collective (NBC) implemented on top Extended Generic Requests progressed by any node thanks extension threads dynamically share their context.

参考文章(31)
Stas Negara, Gengbin Zheng, Kuo-Chuan Pan, Natasha Negara, Ralph E. Johnson, Laxmikant V. Kalé, Paul M. Ricker, Automatic MPI to AMPI program transformation using photran european conference on parallel processing. pp. 531- 539 ,(2010) , 10.1007/978-3-642-21878-1_65
Robert Latham, William Gropp, Robert Ross, Rajeev Thakur, Extending the MPI-2 generalized request interface PVM/MPI'07 Proceedings of the 14th European conference on Recent Advances in Parallel Virtual Machine and Message Passing Interface. ,vol. 4757, pp. 223- 232 ,(2007) , 10.1007/978-3-540-75416-9_33
Min Si, Antonio J. Pena, Jeff Hammond, Pavan Balaji, Masamichi Takagi, Yutaka Ishikawa, Casper: An Asynchronous Progress Model for MPI RMA on Many-Core Architectures international parallel and distributed processing symposium. pp. 665- 676 ,(2015) , 10.1109/IPDPS.2015.35
Torsten Hoefler, Greg Bronevetsky, Brian Barrett, Bronis R. de Supinski, Andrew Lumsdaine, Efficient MPI Support for Advanced Hybrid Programming Models Recent Advances in the Message Passing Interface. pp. 50- 61 ,(2010) , 10.1007/978-3-642-15646-5_6
Marc Pérache, Hervé Jourdren, Raymond Namyst, MPC: A Unified Parallel Runtime for Clusters of NUMA Machines european conference on parallel processing. ,vol. 5168, pp. 78- 88 ,(2008) , 10.1007/978-3-540-85451-7_9
Al Geist, William Gropp, Steve Huss-Lederman, Andrew Lumsdaine, Ewing Lusk, William Saphir, Tony Skjellum, Marc Snir, MPI-2: Extending the Message-Passing Interface european conference on parallel processing. pp. 128- 135 ,(1996) , 10.1007/3-540-61626-8_16
Sangmin Seo, Robert Latham, Junchao Zhang, Pavan Balaji, Implementation and evaluation of MPI nonblocking collective I/O ieee acm international symposium cluster cloud and grid computing. pp. 1084- 1091 ,(2015) , 10.1109/CCGRID.2015.81
Said Derradji, Thibaut Palfer-Sollier, Jean-Pierre Panziera, Axel Poudes, Francois Wellenreiter Atos, The BXI Interconnect Architecture 2015 IEEE 23rd Annual Symposium on High-Performance Interconnects. pp. 18- 25 ,(2015) , 10.1109/HOTI.2015.15
James Dinan, Pavan Balaji, David Goodell, Douglas Miller, Marc Snir, Rajeev Thakur, Enabling MPI interoperability through flexible communication endpoints Proceedings of the 20th European MPI Users' Group Meeting on - EuroMPI '13. pp. 13- 18 ,(2013) , 10.1145/2488551.2488553