Kernel difference-weighted k-nearest neighbors classification

Wangmeng Zuo, Kuanquan Wang, Hongzhi Zhang, Dapeng Zhang

Research output: Chapter in book / Conference proceedingConference article published in proceeding or bookAcademic researchpeer-review

3 Citations (Scopus)

Abstract

Nearest Neighbor (NN) rule is one of the simplest and most important methods in pattern recognition. In this paper, we propose a kernel difference-weighted k-nearest neighbor method (KDF-WKNN) for pattern classification. The proposed method defines the weighted KNN rule as a constrained optimization problem, and then we propose an efficient solution to compute the weights of different nearest neighbors. Unlike distance-weighted KNN which assigns different weights to the nearest neighbors according to the distance to the unclassified sample, KDF-WKNN weights the nearest neighbors by using both the norm and correlation of the differences between the unclassified sample and its nearest neighbors. Our experimental results indicate that KDF-WKNN is better than the original KNN and distanceweighted KNN, and is comparable to some state-of-the-art methods in terms of classification accuracy.
Original languageEnglish
Title of host publicationAdvanced Intelligent Computing Theories and Applications
Subtitle of host publicationWith Aspects of Artificial Intelligence - Third International Conference on Intelligent Computing, ICIC 2007, Proceedings
Pages861-870
Number of pages10
Publication statusPublished - 1 Dec 2007
Event3rd International Conference on Intelligent Computing, ICIC 2007 - Qingdao, China
Duration: 21 Aug 200724 Aug 2007

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume4682 LNAI
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference3rd International Conference on Intelligent Computing, ICIC 2007
CountryChina
CityQingdao
Period21/08/0724/08/07

Keywords

  • K-nearest neighbor
  • Kernel methods
  • Pattern classification

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Cite this