The Earth System Grid Federation: An open infrastructure for access to distributed geospatial data

作者: Luca Cinquini , Daniel Crichton , Chris Mattmann , John Harney , Galen Shipman

DOI: 10.1016/J.FUTURE.2013.07.002

关键词: World Wide WebEarth System GridGeospatial analysisData publishingCoupled model intercomparison projectApplication programming interfaceInteroperabilityPetabyteComputer scienceClimate changeUser interface

摘要: Abstract The Earth System Grid Federation (ESGF) is a multi-agency, international collaboration that aims at developing the software infrastructure needed to facilitate and empower study of climate change on global scale. ESGF’s architecture employs system geographically distributed peer nodes, which are independently administered yet united by adoption common federation protocols application programming interfaces (APIs). cornerstones its interoperability peer-to-peer messaging continuously exchanged among all nodes in federation; shared API for search discovery; security based industry standards (OpenID, SSL, GSI SAML). ESGF stack integrates custom components (for data publishing, searching, user interface, messaging), developed collaboratively team, with popular engines (Tomcat, Solr) available from open source community. full has now been adopted multiple science projects allows access petabytes geophysical data, including entire Fifth Coupled Model Intercomparison Project (CMIP5) output used Intergovernmental Panel Climate Change (IPCC) Assessment Report (AR5) suite satellite observations (obs4MIPs) reanalysis sets (ANA4MIPs). This paper presents as successful example integration disparate technologies into cohesive, wide functional system, describes our experience building operating federated serve needs

参考文章(16)
Brian Smith, Thomas Maxwell, Emanuele Santos, Gerald Potter, Dean Williams, David Kindig, Sean Williams, Galen Shipman, Charles Doutriaux, John Patchett, David Koop, Jorge Poco, Alexander Pletzer, Andrew Bauer, Berk Geveci, Tommy Ellqvist, Hank Childs, Mr Prabhat, Peer-Timo Bremer, David Pugmire, Wes Bethel, Aashish Chaudhary, Claudio Silva, Ross Miller, Harinarayan Krishnan, Chad Steed, None, The Ultra-scale Visualization Climate Data Analysis Tools (UV-CDAT): Data Analysis and Visualization for Geoscience Data IEEE Computer. ,(2013)
Rachana Ananthakrishnan, Bryan Lawrence, Philip Kershaw, Dennis Heimbigner, Luca Cinquini, A modular access control architecture for the Earth system grid federation CSREA Press. ,(2011)
D. N. Williams, R. Ananthakrishnan, D. E. Bernholdt, S. Bharathi, D. Brown, M. Chen, A. L. Chervenak, L. Cinquini, R. Drach, I. T. Foster, P. Fox, D. Fraser, J. Garcia, S. Hankin, P. Jones, D. E. Middleton, J. Schwidder, R. Schweitzer, R. Schuler, A. Shoshani, F. Siebenlist, A. Sim, W. G. Strand, M. Su, N. Wilhelmi, The earth system grid: enabling access to multimodel climate simulation data. Bulletin of the American Meteorological Society. ,vol. 90, pp. 195- 205 ,(2009) , 10.1175/2008BAMS2459.1
Bryce Allen, John Bresnahan, Lisa Childers, Ian Foster, Gopi Kandaswamy, Raj Kettimuthu, Jack Kordas, Mike Link, Stuart Martin, Karl Pickett, Steven Tuecke, Software as a service for data scientists Communications of The ACM. ,vol. 55, pp. 81- 88 ,(2012) , 10.1145/2076450.2076468
Sandro Fiore, Alessandro Negro, Giovanni Aloisio, The data access layer in the GRelC system architecture Future Generation Computer Systems. ,vol. 27, pp. 334- 340 ,(2011) , 10.1016/J.FUTURE.2010.07.006
Sandro Fiore, Alessandro Negro, Giovanni Aloisio, The Climate-G Portal: The context, key features and a multi-dimensional analysis Future Generation Computer Systems. ,vol. 28, pp. 1- 8 ,(2012) , 10.1016/J.FUTURE.2011.05.015
Alan Demers, Dan Greene, Carl Hauser, Wes Irish, John Larson, Scott Shenker, Howard Sturgis, Dan Swinehart, Doug Terry, None, Epidemic algorithms for replicated database maintenance Proceedings of the sixth annual ACM Symposium on Principles of distributed computing - PODC '87. pp. 1- 12 ,(1987) , 10.1145/41840.41841
Michael Franklin, Alon Halevy, David Maier, From databases to dataspaces: a new abstraction for information management international conference on management of data. ,vol. 34, pp. 27- 33 ,(2005) , 10.1145/1107499.1107502
S. Verma, Wei Tsang Ooi, Controlling Gossip Protocol Infection Pattern Using Adaptive Fanout international conference on distributed computing systems. ,vol. 1, pp. 665- 674 ,(2005) , 10.1109/ICDCS.2005.20
B. N. Lawrence, V. Balaji, P. Bentley, S. Callaghan, C. DeLuca, S. Denvil, G. Devine, M. Elkington, R. W. Ford, E. Guilyardi, M. Lautenschlager, M. Morgan, M.-P. Moine, S. Murphy, C. Pascoe, H. Ramthun, P. Slavin, L. Steenman-Clark, F. Toussaint, A. Treshansky, S. Valcke, Describing Earth system simulations with the Metafor CIM Geoscientific Model Development. ,vol. 5, pp. 1493- 1500 ,(2012) , 10.5194/GMD-5-1493-2012