D3: Declarative Distributed Debugging

作者: Scott Shenker , Byung-Gon Chun , Gunho Lee , Kuang Chen , Randy H. Katz

DOI:

关键词: Algorithmic program debuggingDeclarative programmingOverhead (computing)Bandwidth (signal processing)Programming languageComputer scienceDistributed computingDebuggingFrame (networking)

摘要: Large-scale distributed systems, like MapReduce, are increasingly being used, but debugging such systems is still very difficult. In this paper, we propose D3, a new system that answers diverse queries by processing logs formally and efficiently. D3 specifies concisely in declarative language executes the fashion, thereby lowering overhead bandwidth consumed. We demonstrate effectiveness of our design on local cluster with Hadoop, an open-source MapReduce frame-

参考文章(17)
Richard Mortier, Rebecca Isaacs, Austin Donnelly, Paul Barham, Using magpie for request extraction and workload modelling operating systems design and implementation. pp. 18- 18 ,(2004)
Scott Shenker, George Porter, Ion Stoica, Randy H. Katz, Rodrigo Fonseca, X-trace: a pervasive network tracing framework networked systems design and implementation. pp. 20- 20 ,(2007)
Eric Brewer, Emre Kiciman, Mike Y. Chen, Armando Fox, Anthony Accardi, Jim Lloyd, Dave Patterson, Path-based faliure and evolution management networked systems design and implementation. pp. 23- 23 ,(2004)
Mike Wawrzoniak, Larry Peterson, Timothy Roscoe, Sophia: an Information Plane for networked systems acm special interest group on data communication. ,vol. 34, pp. 15- 20 ,(2004) , 10.1145/972374.972378
Ramana Rao Kompella, Jennifer Yates, Alex C. Snoeren, Albert Greenberg, IP fault localization via risk modeling networked systems design and implementation. pp. 57- 70 ,(2005) , 10.5555/1251203.1251208
Boon Thau Loo, Tyson Condie, Joseph M. Hellerstein, Petros Maniatis, Timothy Roscoe, Ion Stoica, Implementing declarative overlays symposium on operating systems principles. ,vol. 39, pp. 75- 90 ,(2005) , 10.1145/1095809.1095818
Patrick Reynolds, Janet L. Wiener, Jeffrey C. Mogul, Marcos K. Aguilera, Amin Vahdat, WAP5 Proceedings of the 15th international conference on World Wide Web - WWW '06. pp. 347- 356 ,(2006) , 10.1145/1135777.1135830
David D. Clark, Craig Partridge, J. Christopher Ramming, John T. Wroclawski, A knowledge plane for the internet Proceedings of the 2003 conference on Applications, technologies, architectures, and protocols for computer communications - SIGCOMM '03. pp. 3- 10 ,(2003) , 10.1145/863955.863957
Amin Vahdat, Jeffrey C. Mogul, Charles Killian, Mehul A. Shah, Janet L. Wiener, Patrick Reynolds, Pip: detecting the unexpected in distributed systems networked systems design and implementation. pp. 9- 9 ,(2006)
Rob Pike, Sean Dorward, Robert Griesemer, Sean Quinlan, Interpreting the data: Parallel analysis with Sawzall Scientific Programming. ,vol. 13, pp. 277- 298 ,(2005) , 10.1155/2005/962135