Advanced Memory Data Structures for Scalable Event Trace Analysis

作者: Andreas Knüpfer

DOI:

关键词:

摘要: This dissertation presents a novel approach for the analysis of event traces from parallel program runs. Event tracing is an established method and optimization performance scalability High Performance Computing (HPC) applications. The Complete Call Graph (CCG) data structure introduced as alternative in-memory representation huge traces. It exploits frequently found redundancies provides customized reduction in combination lossless lossy compression. achieves compression by factors ten to hundred requires no explicit decompression during analysis. Furthermore, adapted evaluation procedures allow reduce computational effort same order magnitude thesis includes comprehensive discussion state-of-the-art related work, detailed presentation design CCG structure, elaborate description algorithms construction, compression, CCGs, extensive experimental validation all components.

参考文章(48)
Andreas Knüpfer, Dieter Kranzlmüller, Wolfgang E. Nagel, Detection of Collective MPI Operation Patterns Lecture Notes in Computer Science. pp. 259- 267 ,(2004) , 10.1007/978-3-540-30218-6_38
Andreas Knüpfer, A new data compression technique for event based program traces international conference on computational science. pp. 956- 965 ,(2003) , 10.1007/3-540-44863-2_94
Holger Brunst, Allen D. Malony, Sameer S. Shende, Robert Bell, Online Remote Trace Analysis of Parallel Applications on High-Performance Clusters ieee international conference on high performance computing data and analytics. pp. 440- 449 ,(2003) , 10.1007/978-3-540-39707-6_39
Wolfgang E. Nagel, Alfred Arnold, Performance Visualization of Parallel Programs - The PARvis Environment Intel Supercomputer Users Group Conference 1994. ,(1994)
David Alan Grier, When Computers Were Human ,(2005)
Markus Geimer, Felix Wolf, Brian J. N. Wylie, Bernd Mohr, Scalable Parallel Trace-Based Performance Analysis Recent Advances in Parallel Virtual Machine and Message Passing Interface. ,vol. 4, pp. 303- 312 ,(2006) , 10.1007/11846802_43
Andreas Knüpfer, Ronny Brendel, Holger Brunst, Hartmut Mix, Wolfgang E. Nagel, Introducing the open trace format (OTF) international conference on computational science. pp. 526- 533 ,(2006) , 10.1007/11758525_71
Holger Brunst, Manuela Winkler, Wolfgang E. Nagel, Hans-Christian Hoppe, Performance Optimization for Large Scale Computing: The Scalable VAMPIR Approach international conference on computational science. pp. 751- 760 ,(2001) , 10.1007/3-540-45718-6_80
Felix Wolf, Bernd Mohr, EARL - A Programmable and Extensible Toolkit for Analyzing Event Traces of Message Passing Programs ieee international conference on high performance computing data and analytics. pp. 503- 512 ,(1999) , 10.1007/BFB0100611
Felix Wolf, Bernd Mohr, Automatic Performance Analysis of MPI Applications Based on Event Traces european conference on parallel processing. pp. 123- 132 ,(2000) , 10.1007/3-540-44520-X_16