Robust relief-feature weighting, margin maximization, and fuzzy optimization

Zhaohong Deng, Fu Lai Korris Chung, Shitong Wang

Research output: Journal article publicationJournal articleAcademic researchpeer-review

61 Citations (Scopus)


A latest advance in Relief-feature-weighting techniques is that the iterative procedure of Relief can be approximately expressed as a margin maximization problem, and therefore, its distinctive properties can be investigated with the help of optimization theory. Being motivated by this advance, the Relief-feature-weighting algorithm is investigated for the first time within a fuzzy-optimization framework. A new margin-based objective function that incorporates three fuzzy concepts, namely, fuzzy-difference measure, fuzzy-feature weighting, and fuzzy-instance force coefficient, is introduced. By the application of fuzzy optimization to this new margin-based objective function, several useful theoretical results are derived, based upon which, a set of robust Relief-feature-weighting algorithms are proposed for two-class data, multiclass data, and, then, online data. As demonstrated by extensive experiments in synthetic datasets, the University of California at Irvine (UCI)-benchmark datasets, cancer-gene-expression datasets, and face-image datasets, the proposed algorithms were found to be competitive with the state-of-the-art algorithms and robust for datasets with noise and/or outliers.
Original languageEnglish
Article number5446326
Pages (from-to)726-744
Number of pages19
JournalIEEE Transactions on Fuzzy Systems
Issue number4
Publication statusPublished - 1 Aug 2010


  • Classification
  • feature selection
  • feature weighting
  • fuzzy-optimization theory
  • margin-maximization principle
  • Relief algorithm

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Computational Theory and Mathematics
  • Artificial Intelligence
  • Applied Mathematics


Dive into the research topics of 'Robust relief-feature weighting, margin maximization, and fuzzy optimization'. Together they form a unique fingerprint.

Cite this