Convolutional Neural Network Architecture Design by the Tree Growth Algorithm Framework

作者: Ivana Strumberger , Eva Tuba , Nebojsa Bacanin , Raka Jovanovic , Milan Tuba

DOI: 10.1109/IJCNN.2019.8851755

关键词: PoolingNetwork architectureMNIST databaseSwarm intelligenceMetaheuristicConvolutional neural networkRobustness (computer science)Computer scienceAlgorithmContextual image classification

摘要: This paper presents tree growth algorithm framework for designing convolutional neural network architecture. Convolutional networks are a special class of deep that typically consist several convolution, pooling and fully connected layers. have proved to be robust method tackling various image classification tasks. One the most important challenges from this domain is find architecture has best performance specific application. The depends on set hyper-parameter values such as number dense layers, kernels per layer kernel size. Optimization hyperparameters was performed by novel belongs group swarm intelligence metaheuristics. robustness, solutions quality proposed validated against well-known MNIST dataset. Conducted comparative analysis demonstrated frameworks obtains promising results in domain.

参考文章(43)
Diederik P. Kingma, Jimmy Ba, Adam: A Method for Stochastic Optimization arXiv: Learning. ,(2014)
Mark D. McDonnell, Tony Vladusich, Enhanced image classification with a fast-learning shallow convolutional neural network international joint conference on neural network. pp. 1- 7 ,(2015) , 10.1109/IJCNN.2015.7280796
Ming Liang, Xiaolin Hu, Recurrent convolutional neural network for object recognition computer vision and pattern recognition. pp. 3367- 3375 ,(2015) , 10.1109/CVPR.2015.7298958
Raka Jovanovic, Milan Tuba, Ant colony optimization algorithm with pheromone correction strategy for the minimum connected dominating set problem Computer Science and Information Systems. ,vol. 10, pp. 133- 149 ,(2013) , 10.2298/CSIS110927038J
Abhijit Suresh, K.V. Harish, N. Radhika, Particle Swarm Optimization over Back Propagation Neural Network for Length of Stay Prediction Procedia Computer Science. ,vol. 46, pp. 268- 275 ,(2015) , 10.1016/J.PROCS.2015.02.020
M Sai Praneeth, Xudong Peng, Alice Li, Shahrzad Hosseini Vajargah, Going deeper with convolutions computer vision and pattern recognition. pp. 1- 9 ,(2015) , 10.1109/CVPR.2015.7298594
Yoshua Bengio, James Bergstra, Random search for hyper-parameter optimization Journal of Machine Learning Research. ,vol. 13, pp. 281- 305 ,(2012)
Y. Lecun, L. Bottou, Y. Bengio, P. Haffner, Gradient-based learning applied to document recognition Proceedings of the IEEE. ,vol. 86, pp. 2278- 2324 ,(1998) , 10.1109/5.726791
Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Andrei A Rusu, Joel Veness, Marc G Bellemare, Alex Graves, Martin Riedmiller, Andreas K Fidjeland, Georg Ostrovski, Stig Petersen, Charles Beattie, Amir Sadik, Ioannis Antonoglou, Helen King, Dharshan Kumaran, Daan Wierstra, Shane Legg, Demis Hassabis, None, Human-level control through deep reinforcement learning Nature. ,vol. 518, pp. 529- 533 ,(2015) , 10.1038/NATURE14236