Learn++.MF: A random subspace approach for the missing feature problem

Robi Polikar, Joseph DePasquale, Hussein Syed Mohammed, Gavin Brown, Ludmilla I. Kuncheva

Research output: Contribution to journalArticlepeer-review

58 Scopus citations

Abstract

We introduce Learn++.MF, an ensemble-of-classifiers based algorithm that employs random subspace selection to address the missing feature problem in supervised classification. Unlike most established approaches, Learn++.MF does not replace missing values with estimated ones, and hence does not need specific assumptions on the underlying data distribution. Instead, it trains an ensemble of classifiers, each on a random subset of the available features. Instances with missing values are classified by the majority voting of those classifiers whose training data did not include the missing features. We show that Learn++.MF can accommodate substantial amount of missing data, and with only gradual decline in performance as the amount of missing data increases. We also analyze the effect of the cardinality of he random feature subsets, and the ensemble size on algorithm performance. Finally, we discuss the conditions under which the proposed approach is most effective.

Original languageEnglish (US)
Pages (from-to)3817-3832
Number of pages16
JournalPattern Recognition
Volume43
Issue number11
DOIs
StatePublished - Nov 2010

All Science Journal Classification (ASJC) codes

  • Software
  • Signal Processing
  • Computer Vision and Pattern Recognition
  • Artificial Intelligence

Fingerprint

Dive into the research topics of 'Learn++.MF: A random subspace approach for the missing feature problem'. Together they form a unique fingerprint.

Cite this