Neuroevolution under unimodal error landscapes: An exploration of the semantic learning machine algorithm

Research output: Chapter in Book/Report/Conference proceedingConference contribution

4 Citations (Scopus)
32 Downloads (Pure)

Abstract

Neuroevolution is a field in which evolutionary algorithms are applied with the goal of evolving Neural Networks (NNs). This paper studies different variants of the Semantic Learning Machine (SLM) algorithm, a recently proposed supervised learning neuroevolution method. Perhaps the most interesting characteristic of SLM is that it searches over unimodal error landscapes in any supervised learning problem where the error is measured as a distance to the known targets. SLM is compared with the NeuroEvolution of Augmenting Topologies (NEAT) algorithm and with a fixed-topology neuroevolution approach. Experiments are performed on a total of 9 real-world regression and classification datasets. The results show that the best SLM variants generally outperform the other neuroevolution approaches in terms of generalization achieved, while also being more efficient in learning the training data. The best SLM variants also outperform the common NN backpropagation-based approach under different topologies. The most efficient SLM variant used in combination with a recently proposed semantic stopping criterion is capable of evolving competitive neural networks in a few seconds on the vast majority of the datasets considered. A final comparison shows that a NN ensemble built with SLM is able to outperform the Random Forest algorithm in two classification datasets.

Original languageEnglish
Title of host publicationGECCO 2018 Companion - Proceedings of the 2018 Genetic and Evolutionary Computation Conference Companion
PublisherAssociation for Computing Machinery, Inc
Pages159-160
Number of pages2
ISBN (Electronic)9781450357647
DOIs
Publication statusPublished - 6 Jul 2018
Event2018 Genetic and Evolutionary Computation Conference, GECCO 2018 - Kyoto, Japan
Duration: 15 Jul 201819 Jul 2018

Conference

Conference2018 Genetic and Evolutionary Computation Conference, GECCO 2018
CountryJapan
CityKyoto
Period15/07/1819/07/18

Keywords

  • MLP
  • NEAT
  • Neuroevolution
  • Semantic learning machine

Fingerprint Dive into the research topics of 'Neuroevolution under unimodal error landscapes: An exploration of the semantic learning machine algorithm'. Together they form a unique fingerprint.

  • Cite this

    Jagusch, J-B., Gonçalves, I., & Castelli, M. (2018). Neuroevolution under unimodal error landscapes: An exploration of the semantic learning machine algorithm. In GECCO 2018 Companion - Proceedings of the 2018 Genetic and Evolutionary Computation Conference Companion (pp. 159-160). Association for Computing Machinery, Inc. https://doi.org/10.1145/3205651.3205778