Enabling rapid development of parallel tree search applications

作者: Jeffrey P. Gardner , Cameron McBride , Andrew Connolly

DOI: 10.1145/1273404.1273410

关键词:

摘要: Virtual observatories will give astronomers easy access to anunprecedented amount of data. Extracting scientific knowledge from these data increasingly demand both efficient algorithms as well the power parallel computers. Nearly all analyses large astronomical datasets use trees their fundamental structure. Writing tree-based techniques, a task that is time-consuming even on single-processor computers, exceedingly cumbersome massively platforms (MPPs). Most applications run MPPs are simulation codes, since expense developing them offset by fact they be used for many years researchers. In contrast, analysis codes change far more rapidly, often unique individual researchers, and therefore accommodate little reuse. Consequently, economics current high-performance computing development paradigm does not favor applications. We have built library, called Ntropy, provides flexible, extensible, easy-to-use way serial platforms. Our experience has shown only our library save time, it can also deliver excellent performance scalability. Furthermore, Ntropy makes an astronomer with or noparallel programming quickly scale application distributed multiprocessor environment. By minimizing time scalable analysis, we enable wide-scale discovery massive datasets.

参考文章(19)
Andrew Moore, Brigham Anderson, ADtrees for fast counting and for fast learning of association rules knowledge discovery and data mining. pp. 134- 138 ,(1998)
Yossi Shiloach, Uzi Vishkin, An O(logn) parallel connectivity algorithm Journal of Algorithms. ,vol. 3, pp. 57- 67 ,(1982) , 10.1016/0196-6774(82)90008-6
I. Kayo, I. Kayo, Neta Bahcall, I. Szapudi, I. Csabai, R. H. Wechsler, I. Zehavi, I. Zehavi, A. Pope, A. Pope, F. Marin, D. Schneider, B. Jain, R. C. Nichol, R. C. Nichol, J. Brinkmann, M. Blanton, J. Schneider, A. W. Moore, R. K. Sheth, A. J. Gray, A. Szalay, J. Pun, J. Pun, G. Kulkarni, A. J. Connolly, Y. Suto, J. P. Gardner, C. J. Miller, The Effect of Large-Scale Structure on the SDSS Galaxy Three-Point Correlation Function Monthly Notices of the Royal Astronomical Society. ,vol. 368, pp. 1507- 1514 ,(2006) , 10.1111/J.1365-2966.2006.10239.X
Andreas Müller, Roland Rühl, Extending high performance Fortran for the support of unstructured computations Proceedings of the 9th international conference on Supercomputing - ICS '95. pp. 127- 136 ,(1995) , 10.1145/224538.224552
M. Davis, G. Efstathiou, C. S. Frenk, S. D. M. White, The evolution of large-scale structure in a universe dominated by cold dark matter The Astrophysical Journal. ,vol. 292, pp. 371- 394 ,(1985) , 10.1086/163168
John Reid, Robert W. Numrich, Co-arrays in the next Fortran Standard Scientific Programming. ,vol. 15, pp. 9- 26 ,(2007) , 10.1155/2007/954503
Douglas G. York, Don Q. Lamb, Constance Rockosi, Joshua A. Frieman, Joshua A. Frieman, Neta A. Bahcall, Roman Scoccimarro, Masataka Fukugita, István Szapudi, István Csabai, Brian Yanny, Andrew J. Connolly, James Annis, Robert H. Lupton, Željko Ivezić, Michael S. Vogeley, Albert Stebbins, Scott Dodelson, Scott Dodelson, Avery Meiksin, David Johnston, David Johnston, Stephen Kent, Rita S. J. Kim, David Schlegel, James E. Gunn, Robert C. Nichol, Daniel J. Eisenstein, Daniel J. Eisenstein, Gillian R. Knapp, Mamoru Doi, Jon Loveday, Douglas L. Tucker, Alexander S. Szalay, J. Brinkman, Brian C. Lee, John Peoples, Timothy A. McKay, Christopher Stoughton, Jeff Pier, Ryan Scranton, Ryan Scranton, Jeff Munn, Higher Order Moments of the Angular Distribution of Galaxies from Early Sloan Digital Sky Survey Data The Astrophysical Journal. ,vol. 570, pp. 75- 85 ,(2002) , 10.1086/339574
David E. Culler, Tarek A. El-Ghazawi, Kathy Yelick, William W. Carlson, Jesse M. Draper, Eugene Brooks, George Washington, UPC Language Specifications V1.1.1 ,(2003)
Laxmikant V. Kale, Sanjeev Krishnan, CHARM++ Proceedings of the eighth annual conference on Object-oriented programming systems, languages, and applications - OOPSLA '93. ,vol. 28, pp. 91- 108 ,(1993) , 10.1145/165854.165874
Jarek Nieplocha, Bruce Palmer, Vinod Tipparaju, Manojkumar Krishnan, Harold Trease, Edoardo Aprà, Advances, Applications and Performance of the Global Arrays Shared Memory Programming Toolkit ieee international conference on high performance computing data and analytics. ,vol. 20, pp. 203- 231 ,(2006) , 10.1177/1094342006064503