Feature evaluation and selection based on neighborhood soft margin

Qinghua Hu, Xunjian Che, Lei Zhang, Daren Yu

Research output: Journal article publicationJournal articleAcademic researchpeer-review

36 Citations (Scopus)

Abstract

Feature selection is considered to be an important preprocessing step in machine learning and pattern recognition, and feature evaluation is the key issue for constructing a feature selection algorithm. In this work, we propose a new concept of neighborhood margin and neighborhood soft margin to measure the minimal distance between different classes. We use the criterion of neighborhood soft margin to evaluate the quality of candidate features and construct a forward greedy algorithm for feature selection. We conduct this technique on eight classification learning tasks and some cancer recognition tasks. Compared with the raw data and other feature selection algorithms, the proposed technique is effective in most of the cases.
Original languageEnglish
Pages (from-to)2114-2124
Number of pages11
JournalNeurocomputing
Volume73
Issue number10-12
DOIs
Publication statusPublished - 1 Jun 2010

Keywords

  • Feature evaluation
  • Feature selection
  • Margin
  • Neighborhood

ASJC Scopus subject areas

  • Computer Science Applications
  • Cognitive Neuroscience
  • Artificial Intelligence

Cite this