Incremental learning of new classes from unbalanced data

Gregory Ditzler, Gail Rosen, Robi Polikar

Research output: Chapter in Book/Report/Conference proceedingConference contribution

5 Scopus citations

Abstract

Multiple classifier systems tend to suffer from outvoting when new concept classes need to be learned incrementally. Out-voting is primarily due to existing classifiers being unable to recognize the new class until there is a sufficient number of new classifiers that can influence the ensemble decision. This problem of learning new classes was explicitly addressed in Learn ++.NC, our previous work, where ensemble members dynamically adjust their own weights by consulting with each other based on their individual and collective confidence in classifying each concept class. Learn++.NC works remarkably well for learning new concept classes while requiring few ensemble members to do so. Learn++.NC cannot cope with the class imbalance problem, however, as it was not designed to do so. Yet, class imbalance is a common and important problem in machine learning, made even more challenging in an incremental learning setting. In this paper, we extend Learn++.NC so that it can incrementally learn new concept classes even if their instances are drawn from severely imbalanced class distributions. We show that the proposed algorithm is quite robust compared to other state-of-the-art algorithms.

Original languageEnglish (US)
Title of host publication2013 International Joint Conference on Neural Networks, IJCNN 2013
DOIs
StatePublished - Dec 1 2013
Externally publishedYes
Event2013 International Joint Conference on Neural Networks, IJCNN 2013 - Dallas, TX, United States
Duration: Aug 4 2013Aug 9 2013

Publication series

NameProceedings of the International Joint Conference on Neural Networks

Other

Other2013 International Joint Conference on Neural Networks, IJCNN 2013
CountryUnited States
CityDallas, TX
Period8/4/138/9/13

Keywords

  • incremental learning
  • multiple classifier systems
  • unbalanced data

ASJC Scopus subject areas

  • Software
  • Artificial Intelligence

Fingerprint Dive into the research topics of 'Incremental learning of new classes from unbalanced data'. Together they form a unique fingerprint.

  • Cite this

    Ditzler, G., Rosen, G., & Polikar, R. (2013). Incremental learning of new classes from unbalanced data. In 2013 International Joint Conference on Neural Networks, IJCNN 2013 [6706770] (Proceedings of the International Joint Conference on Neural Networks). https://doi.org/10.1109/IJCNN.2013.6706770