A study of an incremental spectral meta-learner for nonstationary environments

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Scopus citations

Abstract

Incrementally learning from large volumes of streaming data over time is a problem that is of crucial importance to the computational intelligence community, especially in scenarios where it is impractical or simply unfeasible to store all historical data. Learning becomes a particularly challenging problem when the probabilistic properties of the data are changing with time (i.e., gradual, abrupt, etc.), and there is scarce availability of class labels. Many existing strategies for learning in nonstationary environments use the most recent batch of training data to tune their parameters (e.g., calculate classifier voting weights), and never reassess these parameters when the unlabeled test data arrive. Making a limited drift assumption is generally one way to justify not needing to re-evaluate the parameters of a classifiers; however, labeled data that have already been learned if presented to the classifier for testing could be forgotten because the data was not observed for a long time. This is one form of abrupt concept drift with unlabeled data. In this work, an incremental spectral learning meta-classifier is presented for learning in nonstationary environments such that: (i) new classifiers can be added into an ensemble when labeled data are available, (ii) the ensemble voting weights are determined from the unlabeled test data to boost recollection of previously learned distributions of data, and (iii) the limited drift assumption is removed from the test-then-train evaluation paradigm. We benchmark our proposed approach on several widely used concept drift data sets.

Original languageEnglish (US)
Title of host publication2016 International Joint Conference on Neural Networks, IJCNN 2016
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages38-44
Number of pages7
ISBN (Electronic)9781509006199
DOIs
StatePublished - Oct 31 2016
Event2016 International Joint Conference on Neural Networks, IJCNN 2016 - Vancouver, Canada
Duration: Jul 24 2016Jul 29 2016

Publication series

NameProceedings of the International Joint Conference on Neural Networks
Volume2016-October

Other

Other2016 International Joint Conference on Neural Networks, IJCNN 2016
CountryCanada
CityVancouver
Period7/24/167/29/16

ASJC Scopus subject areas

  • Software
  • Artificial Intelligence

Fingerprint Dive into the research topics of 'A study of an incremental spectral meta-learner for nonstationary environments'. Together they form a unique fingerprint.

  • Cite this

    Ditzler, G. (2016). A study of an incremental spectral meta-learner for nonstationary environments. In 2016 International Joint Conference on Neural Networks, IJCNN 2016 (pp. 38-44). [7727178] (Proceedings of the International Joint Conference on Neural Networks; Vol. 2016-October). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/IJCNN.2016.7727178