Pruning techniques for mixed ensembles of genetic programming models

Mauro Castelli, Ivo Gonçalves, Luca Manzoni, Leonardo Vanneschi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

The objective of this paper is to define an effective strategy for building an ensemble of Genetic Programming (GP) models. Ensemble methods are widely used in machine learning due to their features: they average out biases, they reduce the variance and they usually generalize better than single models. Despite these advantages, building ensemble of GP models is not a well-developed topic in the evolutionary computation community. To fill this gap, we propose a strategy that blends individuals produced by standard syntax-based GP and individuals produced by geometric semantic genetic programming, one of the newest semantics-based method developed in GP. In fact, recent literature showed that combining syntax and semantics could improve the generalization ability of a GP model. Additionally, to improve the diversity of the GP models used to build up the ensemble, we propose different pruning criteria that are based on correlation and entropy, a commonly used measure in information theory. Experimental results, obtained over different complex problems, suggest that the pruning criteria based on correlation and entropy could be effective in improving the generalization ability of the ensemble model and in reducing the computational burden required to build it.

Original languageEnglish
Title of host publicationGenetic Programming
Subtitle of host publication21st European Conference, EuroGP 2018, Proceedings
EditorsMauro Castelli, Lukas Sekanina, Mengjie Zhang, Stefano Cagnoni, Pablo García-Sánchez
PublisherSpringer Verlag
Pages52-67
Number of pages16
ISBN (Print)9783319775524
DOIs
Publication statusPublished - 1 Jan 2018
Event21st European Conference on Genetic Programming, EuroGP 2018 - Parma, Italy
Duration: 4 Apr 20186 Apr 2018

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume10781 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference21st European Conference on Genetic Programming, EuroGP 2018
CountryItaly
CityParma
Period4/04/186/04/18

Fingerprint Dive into the research topics of 'Pruning techniques for mixed ensembles of genetic programming models'. Together they form a unique fingerprint.

  • Cite this

    Castelli, M., Gonçalves, I., Manzoni, L., & Vanneschi, L. (2018). Pruning techniques for mixed ensembles of genetic programming models. In M. Castelli, L. Sekanina, M. Zhang, S. Cagnoni, & P. García-Sánchez (Eds.), Genetic Programming : 21st European Conference, EuroGP 2018, Proceedings (pp. 52-67). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 10781 LNCS). Springer Verlag. https://doi.org/10.1007/978-3-319-77553-1_4