On kernel difference-weighted k-nearest neighbor classification

Wangmeng Zuo, Dapeng Zhang, Kuanquan Wang

Research output: Journal article publicationJournal articleAcademic researchpeer-review

64 Citations (Scopus)

Abstract

Nearest neighbor (NN) rule is one of the simplest and the most important methods in pattern recognition. In this paper, we propose a kernel difference-weighted k-nearest neighbor (KDF-KNN) method for pattern classification. The proposed method defines the weighted KNN rule as a constrained optimization problem, and we then propose an efficient solution to compute the weights of different nearest neighbors. Unlike traditional distance-weighted KNN which assigns different weights to the nearest neighbors according to the distance to the unclassified sample, difference-weighted KNN weighs the nearest neighbors by using both the correlation of the differences between the unclassified sample and its nearest neighbors. To take into account the effective nonlinear structure information, we further extend difference-weighted KNN to its kernel version KDF-KNN. Our experimental results indicate that KDF-WKNN is much better than the original KNN and the distance-weighted KNN methods, and is comparable to or better than several state-of-the-art methods in terms of classification accuracy.
Original languageEnglish
Pages (from-to)247-257
Number of pages11
JournalPattern Analysis and Applications
Volume11
Issue number3-4
DOIs
Publication statusPublished - 1 Sep 2008

Keywords

  • Classifier
  • Distance-weighted KNN
  • Kernel methods
  • Nearest neighbor
  • Pattern classification

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition
  • Artificial Intelligence

Cite this