Mining Recurring Concepts in a Dynamic Feature Space

João Bártolo Gomes, Mohamed Medhat Gaber, Pedro Alexandre da Costa Sousa, Ernestina Menasalvas

Research output: Contribution to journalArticle

39 Citations (Scopus)

Abstract

Most data stream classification techniques assume that the underlying feature space is static. However, in real-world applications the set of features and their relevance to the target concept may change over time. In addition, when the underlying concepts reappear, reusing previously learnt models can enhance the learning process in terms of accuracy and processing time at the expense of manageable memory consumption. In this paper, we propose mining recurring concepts in a dynamic feature space (MReC-DFS), a data stream classification system to address the challenges of learning recurring concepts in a dynamic feature space while simultaneously reducing the memory cost associated with storing past models. MReC-DFS is able to detect and adapt to concept changes using the performance of the learning process and contextual information. To handle recurring concepts, stored models are combined in a dynamically weighted ensemble. Incremental feature selection is performed to reduce the combined feature space. This contribution allows MReC-DFS to store only the features most relevant to the learnt concepts, which in turn increases the memory efficiency of the technique. In addition, an incremental feature selection method is proposed that dynamically determines the threshold between relevant and irrelevant features. Experimental results demonstrating the high accuracy of MReC-DFS compared with state-of-the-art techniques on a variety of real datasets are presented. The results also show the superior memory efficiency of MReC-DFS.
Original languageEnglish
Article number6572821
Pages (from-to)95 - 110
JournalIEEE Transactions on Neural Networks and Learning Systems
Volume25
Issue number1
DOIs
Publication statusPublished - Jan 2014

Keywords

  • Concept drift
  • data stream mining
  • dynamic feature space (DFS)
  • recurring concepts

Fingerprint Dive into the research topics of 'Mining Recurring Concepts in a Dynamic Feature Space'. Together they form a unique fingerprint.

Cite this