Spark implementation of the enhanced Scatter Search metaheuristic: Methodology and assessment

作者: Xoán C. Pardo , Pablo Argüeso-Alejandro , Patricia González , Julio R. Banga , Ramón Doallo

DOI: 10.1016/J.SWEVO.2020.100748

关键词:

摘要: Abstract Optimization problems arise nowadays in all disciplines, not only the scientific area but also field of engineering or economics, and many others. Currently, challenging optimization require solution methods that consume a significant amount computational resources. The application High-Performance Computing techniques is common approach to obtain efficient implementations traditional parallel computing systems. However, more recent approaches are exploring distributed programming frameworks developed years achieve computations on clusters cloud In this paper we present implementation enhanced Scatter Search metaheuristic using Spark. program was obtained as particularization general software framework support different realisations metaheuristic. aim provide helpful guidance readers interested applying, developing their own, metaheuristics solve Cloud. With twofold objective demonstrating potential parallelization with Spark studying factors influence performance solution, proposal has been thoroughly evaluated two platforms, cluster platform, representative set parameter estimation Computational Systems Biology.

参考文章(73)
Gabriel Luque, Enrique Alba, Evaluation of parallel metaheuristics ,(2006)
Atanas Radenski, Distributed Simulated Annealing with MapReduce Applications of Evolutionary Computation. pp. 466- 476 ,(2012) , 10.1007/978-3-642-29178-4_47
Eva Balsa-Canto, J. R. Banga, J. A. Egea, A. Fernandez-Villaverde, G. M. de Hijas-Liste, Global Optimization in Systems Biology: Stochastic Methods and Their Applications Advances in Experimental Medicine and Biology. ,vol. 736, pp. 409- 424 ,(2012) , 10.1007/978-1-4419-7210-1_24
Jorge L. Reyes-Ortiz, Luca Oneto, Davide Anguita, Big Data Analytics in the Cloud: Spark on Hadoop vs MPI/OpenMP on Beowulf Procedia Computer Science. ,vol. 53, pp. 121- 130 ,(2015) , 10.1016/J.PROCS.2015.07.286
Martin Odersky, Lex Spoon, Bill Venners, Programming in Scala ,(2008)
Rafael Marti, Manuel Laguna, Scatter Search: Methodology and Implementations in C ,(2011)
Maria Rodriguez-Fernandez, Jose A Egea, Julio R Banga, Novel metaheuristic for parameter estimation in nonlinear dynamic biological systems BMC Bioinformatics. ,vol. 7, pp. 483- 483 ,(2006) , 10.1186/1471-2105-7-483
Kay Ousterhout, Ryan Rasti, Sylvia Ratnasamy, Scott Shenker, Byung-Gon Chun, VMware ICSI, Making sense of performance in data analytics frameworks networked systems design and implementation. pp. 293- 307 ,(2015)
Attila Gábor, Julio R. Banga, Robust and efficient parameter estimation in dynamic models of biological systems BMC Systems Biology. ,vol. 9, pp. 74- 74 ,(2015) , 10.1186/S12918-015-0219-2