Dropout Probability Estimation in Convolutional Neural Networks by the Enhanced Bat Algorithm

作者: Nebojsa Bacanin , Eva Tuba , Timea Bezdan , Ivana Strumberger , Raka Jovanovic

DOI: 10.1109/IJCNN48605.2020.9206864

关键词:

摘要: In recent years, deep learning has reached exceptional accomplishment in diverse applications, such as visual and speech recognition, natural language processing. The convolutional neural network represents a particular type of commonly used for the task digital image classification. A common issue models is high variance problem, or also called over-fitting. Over-fitting occurs when model fits well with training data fails to generalize on new data. To prevent over-fitting, several regularization methods can be used; one powerful method dropout regularization. find optimal value rate very time-consuming process; hence, we propose by utilizing metaheuristic algorithm instead manual search. this paper, hybridized bat probability compare results similar techniques. experimental show that proposed hybrid overperforms other

参考文章(35)
Matthew Zeiler, Rob Fergus, Li Wan, Yann Le Cun, Sixin Zhang, Regularization of Neural Networks using DropConnect international conference on machine learning. pp. 1058- 1066 ,(2013)
Xin-She Yang, Firefly algorithms for multimodal optimization international conference on stochastic algorithms foundations and applications. pp. 169- 178 ,(2009) , 10.1007/978-3-642-04944-6_14
Jonathan Pérez, Fevrier Valdez, Oscar Castillo, Modification of the Bat Algorithm Using Type-2 Fuzzy Logic for Dynamical Parameter Adaptation Nature-Inspired Design of Hybrid Intelligent Systems. pp. 343- 355 ,(2017) , 10.1007/978-3-319-47054-2_23
Christian Szegedy, Sergey Ioffe, Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift international conference on machine learning. ,vol. 1, pp. 448- 456 ,(2015)
Matthew D. Zeiler, Rob Fergus, Visualizing and Understanding Convolutional Networks european conference on computer vision. pp. 818- 833 ,(2014) , 10.1007/978-3-319-10590-1_53
Andrej Karpathy, Li Fei-Fei, Deep visual-semantic alignments for generating image descriptions computer vision and pattern recognition. pp. 3128- 3137 ,(2015) , 10.1109/CVPR.2015.7298932
Amir Hossein Gandomi, Xin-She Yang, Amir Hossein Alavi, None, Cuckoo search algorithm: a metaheuristic approach to solve structural optimization problems Engineering with Computers. ,vol. 29, pp. 17- 35 ,(2013) , 10.1007/S00366-011-0241-Y
Andrew Y. Ng, Feature selection, L1 vs. L2 regularization, and rotational invariance Twenty-first international conference on Machine learning - ICML '04. pp. 78- ,(2004) , 10.1145/1015330.1015435
Clement Farabet, Camille Couprie, Laurent Najman, Yann LeCun, Learning Hierarchical Features for Scene Labeling IEEE Transactions on Pattern Analysis and Machine Intelligence. ,vol. 35, pp. 1915- 1929 ,(2013) , 10.1109/TPAMI.2012.231
Dervis Karaboga, Bahriye Akay, A modified Artificial Bee Colony (ABC) algorithm for constrained optimization problems soft computing. ,vol. 11, pp. 3021- 3031 ,(2011) , 10.1016/J.ASOC.2010.12.001