Distributed processing of very large datasets with DataCutter

作者: Michael D Beynon , Tahsin Kurc , Umit Catalyurek , Chialin Chang , Alan Sussman

DOI: 10.1016/S0167-8191(01)00099-0

关键词:

摘要: … datasets (sizes up to petabytes). In DataCutter, a dataset consists of a set of data files and a set of … Data files contain the data elements of a dataset; data files can be distributed across …

参考文章(22)
Michael D. Beynon, Alan Sussman, Joel H. Saltz, Tahsin M. Kurç, Renato Ferreira, DataCutter: Middleware for Filtering Very Large Scientific Datasets on Archival Storage Systems. IEEE Symposium on Mass Storage Systems. pp. 119- 134 ,(2000)
Loukas F. Kallivokas, Bruce Lowekamp, David R. O'Hallaron, Peter A. Dinda, Julio C. López, Martin Aeschlimann, Preliminary Report on the Design of a Framework for Distributed Visualization. parallel and distributed processing techniques and applications. pp. 1833- 1839 ,(1999)
Paul H. Smith, John van Rosendale, Data and Visualization Corridors: Report on the 1998 DVC Workshop Series California Institute of Technology, Pasadena, CA (US). ,(1998)
Khalil Amiri, David Petrou, Gregory Ganger, Garth Gibson, Dynamic Function Placement in Active Storage Clusters Defense Technical Information Center. ,(1999) , 10.21236/ADA461222
Brian Tierney, William E. Johnston, Tony Butzer, Jay Feuquay, A distributed parallel storage architecture and its potential application within EOSDIS Goddard conference on mass storage and technolgies, College Park, MD (United States), 28-30 Mar 1995. ,(1995)
B. Plale, K. Schwan, dQCOB: managing large data flows using dynamic embedded queries high performance distributed computing. pp. 263- 270 ,(2000) , 10.1109/HPDC.2000.868658
Ian Foster, David Kohr, Rakesh Krishnaiyer, Jace Mogill, Remote I/O: fast access to distant storage workshop on i/o in parallel and distributed systems. pp. 14- 25 ,(1997) , 10.1145/266220.266222
Michael D. Beynon, Alan Sussman, Joel Saltz, Performance impact of proxies in data intensive client-server applications international conference on supercomputing. pp. 383- 390 ,(1999) , 10.1145/305138.305216