Feature selection for monotonic classification

Qinghua Hu, Weiwei Pan, Lei Zhang, Dapeng Zhang, Yanping Song, Maozu Guo, Daren Yu

Research output: Journal article publicationJournal articleAcademic researchpeer-review

74 Citations (Scopus)

Abstract

Monotonic classification is a kind of special task in machine learning and pattern recognition. Monotonicity constraints between features and decision should be taken into account in these tasks. However, most existing techniques are not able to discover and represent the ordinal structures in monotonic datasets. Thus, they are inapplicable to monotonic classification. Feature selection has been proven effective in improving classification performance and avoiding overfitting. To the best of our knowledge, no technique has been specially designed to select features in monotonic classification until now. In this paper, we introduce a function, which is called rank mutual information, to evaluate monotonic consistency between features and decision in monotonic tasks. This function combines the advantages of dominance rough sets in reflecting ordinal structures and mutual information in terms of robustness. Then, rank mutual information is integrated with the search strategy of min-redundancy and max-relevance to compute optimal subsets of features. A collection of numerical experiments are given to show the effectiveness of the proposed technique.
Original languageEnglish
Article number6011677
Pages (from-to)69-81
Number of pages13
JournalIEEE Transactions on Fuzzy Systems
Volume20
Issue number1
DOIs
Publication statusPublished - 1 Feb 2012

Keywords

  • Feature selection
  • fuzzy ordinal set
  • monotonic classification
  • rank mutual information (RMI)

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Computational Theory and Mathematics
  • Artificial Intelligence
  • Applied Mathematics

Cite this