EGSGP: An Ensemble System Based on Geometric Semantic Genetic Programming

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

This work is inspired by the idea of seeding Genetic Programming (GP) populations with trained models from a pool of different Machine Learning (ML) methods, instead of using randomly generated individuals. If one considers standard GP, tackling this problem is very challenging, because each ML method uses its own representation, typically very different from the others. However, the task becomes easier if we use Geometric Semantic GP (GSGP). In fact, GSGP allows us to abstract from the representation, focusing purely on semantics. Following this idea, we introduce EGSGP, a novel method that can be seen either as a new initialization technique for GSGP, or as an ensemble method, that uses GSGP to combine different Base Learners (BLs). To counteract overfitting, we focused on the study of elitism and Soft Target (ST) regularization, studying several variants of EGSGP. In particular, systems that use or do not use elitism, and that use (with different parameters) or do not use ST were investigated. After an intensive study of the new parameters that characterize EGSGP, those variants were compared with the used BLs and with GSGP on three real-life regression problems. The presented results indicate that EGSGP outperforms the BLs and GSGP on all the studied test problems. While the difference between EGSGP and GSGP is statistically significant on two of the three test problems, EGSGP outperforms all the BLs in a statistically significant way only on one of them.
Original languageEnglish
Title of host publicationArtificial Life and Evolutionary Computation
Subtitle of host publication16th Italian Workshop, WIVACE 2022, Gaeta, Italy, September 14–16, 2022, Revised Selected Papers
EditorsClaudio de Stefano, Francesco Fontanella, Leonardo Vanneschi
Place of PublicationGewerbestrasse, Cham, Switzerland
PublisherSpringer, Cham
Chapter23
Pages278-290
Number of pages13
ISBN (Electronic)978-3-031-31183-3
ISBN (Print)978-3-031-31182-6
DOIs
Publication statusPublished - 30 Apr 2023
EventXVI International Workshop on Artificial Life and Evolutionary Computation - Gaeta, Italy
Duration: 14 Sept 202216 Sept 2022
Conference number: 14
http://wivace2022.unicas.it/

Publication series

NameCommunications in Computer and Information Science
Volume1780
ISSN (Print)1865-0929
ISSN (Electronic)1865-0937

Conference

ConferenceXVI International Workshop on Artificial Life and Evolutionary Computation
Abbreviated titleWIVACE 2022
Country/TerritoryItaly
CityGaeta
Period14/09/2216/09/22
Internet address

Keywords

  • Genetic Programming
  • Geometric Semantic Genetic Programming
  • Initialization
  • Ensemble methods
  • Meta-learning

Fingerprint

Dive into the research topics of 'EGSGP: An Ensemble System Based on Geometric Semantic Genetic Programming'. Together they form a unique fingerprint.

Cite this