Quantifying the limited and gradual concept drift assumption

Joseph Sarnelle, Anthony Sanchez, Robert Capo, Joshua Haas, Robi Polikar

Research output: Chapter in Book/Report/Conference proceedingConference contribution

5 Scopus citations

Abstract

Nonstationary environments, where underlying distributions change over time, are becoming increasingly common in real-world applications. A specific example of such an environment is concept drift, where the joint probability distributions of observed data drift over time. Such environments call for a model that can update its parameters to adapt to the changing environment. An extreme case of this scenario, referred to as extreme verification latency, is where labeled data are only available at initialization, with unlabeled data becoming available in a streaming fashion thereafter. In such a scenario, the classifier must update its hypothesis based on only unlabeled data drawn from the drifting distributions. In our prior work, we described a framework, called COMPOSE, that works well in this type of environment, provided that the data distributions experience limited (or gradual) drift. Limited drift assumption is common in many concept drift algorithms yet - surprisingly - there is little or no formal definition of this assumption. In this contribution, we describe a mechanism to formally quantify limited drift. We define two metrics, one that represents the normalized class separation drift, and the other that uses the ratio of between-class separations and within class drift through time. We test these metrics on both synthetic and real world problems, and argue that the latter can be more suitably used.

Original languageEnglish (US)
Title of host publication2015 International Joint Conference on Neural Networks, IJCNN 2015
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781479919604, 9781479919604, 9781479919604, 9781479919604
DOIs
Publication statusPublished - Sep 28 2015
EventInternational Joint Conference on Neural Networks, IJCNN 2015 - Killarney, Ireland
Duration: Jul 12 2015Jul 17 2015

Publication series

NameProceedings of the International Joint Conference on Neural Networks
Volume2015-September

Other

OtherInternational Joint Conference on Neural Networks, IJCNN 2015
CountryIreland
CityKillarney
Period7/12/157/17/15

    Fingerprint

All Science Journal Classification (ASJC) codes

  • Software
  • Artificial Intelligence

Cite this

Sarnelle, J., Sanchez, A., Capo, R., Haas, J., & Polikar, R. (2015). Quantifying the limited and gradual concept drift assumption. In 2015 International Joint Conference on Neural Networks, IJCNN 2015 [7280850] (Proceedings of the International Joint Conference on Neural Networks; Vol. 2015-September). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/IJCNN.2015.7280850