Learning concept drift in nonstationary environments using an ensemble of classifiers based approach

Matthew Karnick, Metin Ahiskali, Michael D. Muhlbaier, Robi Polikar

Research output: Chapter in Book/Report/Conference proceedingConference contribution

33 Scopus citations

Abstract

We describe an ensemble of classifiers based approach for incrementally learning from new data drawn from a distribution that changes in time, i.e., data obtained from a nonstationary environment. Specifically, we generate a new classifier using each additional dataset that becomes available from the changing environment. The classifiers are combined by a modified weighted majority voting, where the weights are dynamically updated based on the classifiers' current and past performances, as well as their age. This mechanism allows the algorithm to track the changing environment by weighting the most recent and relevant classifiers higher. However, it also utilizes old classifiers by assigning them appropriate voting weights should a cyclical environment renders them relevant again. The algorithm learns incrementally, i.e., it does not need access to previously used data. The algorithm is also independent of a specific classifier model, and can be used with any classifier that fits the characteristics of the underlying problem. We describe the algorithm, and compare its performance using several classifier models, and on different environments as a function of time for several values of rate-of-change.

Original languageEnglish (US)
Title of host publication2008 International Joint Conference on Neural Networks, IJCNN 2008
Pages3455-3462
Number of pages8
DOIs
StatePublished - Nov 24 2008
Event2008 International Joint Conference on Neural Networks, IJCNN 2008 - Hong Kong, China
Duration: Jun 1 2008Jun 8 2008

Publication series

NameProceedings of the International Joint Conference on Neural Networks

Other

Other2008 International Joint Conference on Neural Networks, IJCNN 2008
CountryChina
CityHong Kong
Period6/1/086/8/08

All Science Journal Classification (ASJC) codes

  • Software
  • Artificial Intelligence

Fingerprint Dive into the research topics of 'Learning concept drift in nonstationary environments using an ensemble of classifiers based approach'. Together they form a unique fingerprint.

  • Cite this

    Karnick, M., Ahiskali, M., Muhlbaier, M. D., & Polikar, R. (2008). Learning concept drift in nonstationary environments using an ensemble of classifiers based approach. In 2008 International Joint Conference on Neural Networks, IJCNN 2008 (pp. 3455-3462). [4634290] (Proceedings of the International Joint Conference on Neural Networks). https://doi.org/10.1109/IJCNN.2008.4634290