In this abstract we present our initial results with a novel genetic algorithms based method for evolving convolutional neural networks (CNN). Currently, standard backpropagation is the primary training method for neural networks (NN) in general, including CNNs. In the past several methods proposed using genetic algorithms (GA) for training neural networks. These methods involve representing the weights of the NN as a chromosome, creating a randomly initialized population of such chromosomes (each chromosome represents one NN), and then evolving the population by performing the steps (1) measure the fitness of each chromosome (the lower the average loss over the training set, the better), (2) select the fitter chromosomes for breeding, (3) perform crossover between the parents (randomly choose weights from the parents to create the offspring), and (4) mutate the offspring. While in smaller NNs these methods obtained results comparable with backpropagation, their results deteriorate as the size of NN grows, and are impractical for training deep neural nets. Nowadays these methods have largely been abandoned due to this inefficiency.
|Title of host publication||Artificial Neural Networks and Machine Learning – ICANN 2017 - 26th International Conference on Artificial Neural Networks, Proceedings|
|Editors||Alessandra Lintas, Alessandro E. Villa, Stefano Rovetta, Paul F. Verschure|
|Number of pages||2|
|State||Published - 2017|
|Event||26th International Conference on Artificial Neural Networks, ICANN 2017 - Alghero, Italy|
Duration: 11 Sep 2017 → 14 Sep 2017
|Name||Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)|
|Conference||26th International Conference on Artificial Neural Networks, ICANN 2017|
|Period||11/09/17 → 14/09/17|
Bibliographical notePublisher Copyright:
© Springer International Publishing AG 2017.