Semi-supervised learning in nonstationary environments

Gregory Ditzler, Robi Polikar

Research output: Chapter in Book/Report/Conference proceedingConference contribution

31 Scopus citations

Abstract

Learning in nonstationary environments, also called learning concept drift, has been receiving increasing attention due to increasingly large number of applications that generate data with drifting distributions. These applications are usually associated with streaming data, either online or in batches, and concept drift algorithms are trained to detect and track the drifting concepts. While concept drift itself is a significantly more complex problem than the traditional machine learning paradigm of data coming from a fixed distribution, the problem is further complicated when obtaining labeled data is expensive, and training must rely, in part, on unlabelled data. Independently from concept drift research, semi-supervised approaches have been developed for learning from (limited) labeled and (abundant) unlabeled data; however, such approaches have been largely absent in concept drift literature. In this contribution, we describe an ensemble of classifiers based approach that takes advantage of both labeled and unlabeled data in addressing concept drift: available labeled data are used to generate classifiers, whose voting weights are determined based on the distances between Gaussian mixture model components trained on both labeled and unlabeled data in a drifting environment.

Original languageEnglish (US)
Title of host publication2011 International Joint Conference on Neural Networks, IJCNN 2011 - Final Program
Pages2741-2748
Number of pages8
DOIs
StatePublished - Oct 24 2011
Externally publishedYes
Event2011 International Joint Conference on Neural Network, IJCNN 2011 - San Jose, CA, United States
Duration: Jul 31 2011Aug 5 2011

Publication series

NameProceedings of the International Joint Conference on Neural Networks

Conference

Conference2011 International Joint Conference on Neural Network, IJCNN 2011
CountryUnited States
CitySan Jose, CA
Period7/31/118/5/11

Keywords

  • concept drift
  • ensemble systems
  • incremental learning
  • non-stationary environments
  • unlabeled data

ASJC Scopus subject areas

  • Software
  • Artificial Intelligence

Fingerprint Dive into the research topics of 'Semi-supervised learning in nonstationary environments'. Together they form a unique fingerprint.

  • Cite this

    Ditzler, G., & Polikar, R. (2011). Semi-supervised learning in nonstationary environments. In 2011 International Joint Conference on Neural Networks, IJCNN 2011 - Final Program (pp. 2741-2748). [6033578] (Proceedings of the International Joint Conference on Neural Networks). https://doi.org/10.1109/IJCNN.2011.6033578