A hybrid wrapper/filter approach for feature subset selection

Authors

  • Ronaldo C. Prati University of São Paulo, Brasil
  • Gustavo E. A. P. A. Batista University of São Paulo, Brasil
  • Maria Carolina Monard University of São Paulo, Brasil

Keywords:

Feature Subset Selection, Wrapper, Filter, Machine Learning, Data Mining

Abstract

This work presents a hybrid wrapper/filter algorithm for feature subset selection that can use a combination of several quality criteria measures to rank the set of features of a dataset. These ranked features are used to prune the search space of subsets of possible features such that the number of times the wrapper executes the learning algorithm for a dataset with M features is reduced to O(M) runs. Experimental results using 14 datasets show that, for most of the datasets, the AUC assessed using the reduced feature set is comparable to the AUC of the model constructed using all the features. Furthermore, the algorithm archieved a good reduction in the number of features.

Downloads

Published

2008-03-10

How to Cite

Prati, R. C., Batista, G. E. A. P. A., & Monard, M. C. (2008). A hybrid wrapper/filter approach for feature subset selection. SADIO Electronic Journal of Informatics and Operations Research, 8, 12-24. https://revistas.unlp.edu.ar/ejs/article/view/17541