dQCOB: managing large data flows using dynamic embedded queries

作者: B. Plale , K. Schwan

DOI: 10.1109/HPDC.2000.868658

关键词:

摘要: The dQUOB system satisfies client need for specific information from high-volume data streams. streams we speak of are the flow existing during large-scale visualizations, video streaming to large numbers distributed users, and high volume business transactions. We introduce notion conceptualizing a stream as set relational database tables so that scientist can request with an SQL-like query. Transformation or computation often needs be performed on en-route conceptualized consecutive views data, associated each view. moves query code into quoblet; compiled code. model has significant advantage presenting opportunities efficient reoptimizations queries sets queries. Using examples global atmospheric modeling, illustrate usefulness system. carry through experiments establish viability approach performance computing baseline benchmark. define cost-metric end-to-end latency used determine realistic cases where optimization should applied. Finally, show controlled probability assigned will evaluate true.

参考文章(10)
Peter A. Dinda, Bruce Lowekamp, Loukas F. Kallivokas, David R. O’Hallaron, The Case for Prediction-Based Best-Effort Real-Time Systems international parallel processing symposium. pp. 309- 318 ,(1999) , 10.1007/BFB0097913
Thomas Kindler, Karsten Schwan, Dilma Silva, Mary Trauner, Fred Alyea, A parallel spectral model for atmospheric transport processes Concurrency and Computation: Practice and Experience. ,vol. 8, pp. 639- 666 ,(1996) , 10.1002/(SICI)1096-9128(199611)8:9<639::AID-CPE233>3.0.CO;2-9
RENATO FERREIRA, TAHSIN KURC, MICHAEL BEYNON, CHIALIN CHANG, ALAN SUSSMAN, JOEL SALTZ, OBJECT-RELATIONAL QUERIES INTO MULTIDIMENSIONAL DATABASES WITH THE ACTIVE DATA REPOSITORY Parallel Processing Letters. ,vol. 9, pp. 173- 195 ,(1999) , 10.1142/S0129626499000190
Jifeng Xu, Hesheng Bao, Jacobo Bielak, Omar Ghattas, Loukas F. Kallivokas, David R. O'Hallaron, Jonathan R. Shewchuk, Earthquake ground motion modeling on parallel computers conference on high performance computing (supercomputing). pp. 13- ,(1996) , 10.1145/369028.369053
R.L. Ribler, J.S. Vetter, H. Simitci, D.A. Reed, Autopilot: adaptive control of distributed applications high performance distributed computing. pp. 172- 179 ,(1998) , 10.1109/HPDC.1998.709970
E. Franke, M. Magee, Reducing data distribution bottlenecks by employing data visualization filters high performance distributed computing. pp. 41- ,(1999) , 10.1109/HPDC.1999.805305
C. Isert, K. Schwan, ACDS: Adapting computational data streams for high performance international parallel and distributed processing symposium. pp. 641- 646 ,(2000) , 10.1109/IPDPS.2000.846046
A.A. Afjeh, P.T. Homer, H. Lewandowski, J.A. Reed, R.D. Schlichting, Development of an intelligent monitoring and control system for a heterogeneous numerical propulsion system simulation annual simulation symposium. pp. 278- 287 ,(1995) , 10.1109/SIMSYM.1995.393571
B. Plale, K. Schwan, Run-time detection in parallel and distributed systems: application to safety-critical systems international conference on distributed computing systems. pp. 163- 170 ,(1999) , 10.1109/ICDCS.1999.776517
B. Plale, K. Schwan, V. Martin, G. Eisenhauer, V. Elling, D. King, Realizing distributed computational laboratories International Journal of Parallel and Distributed Systems and Networks. ,vol. 2, pp. 180- 190 ,(1999)