Nearest neighbor classifier based on nearest feature decisions

Alex Pappachen James, Sima Dimitrijev

Research output: Contribution to journalArticle

16 Citations (Scopus)

Abstract

High feature dimensionality of realistic datasets adversely affects the recognition accuracy of nearest neighbor (NN) classifiers. To address this issue, we introduce a nearest feature classifier that shifts the NN concept from the global-decision level to the level of individual features. Performance comparisons with 12 instance-based classifiers on 13 benchmark University of California Irvine classification datasets show average improvements of 6 and 3.5% in recognition accuracy and area under curve performance measures, respectively. The statistical significance of the observed performance improvements is verified by the Friedman test and by the post hoc Bonferroni-Dunn test. In addition, the application of the classifier is demonstrated on face recognition databases, a character recognition database and medical diagnosis problems for binary and multi-class diagnosis on databases including morphological and gene expression features.

Original languageEnglish
Pages (from-to)1072-1087
Number of pages16
JournalComputer Journal
Volume55
Issue number9
DOIs
Publication statusPublished - Sep 2012
Externally publishedYes

Fingerprint

Classifiers
Character recognition
Face recognition
Gene expression

Keywords

  • classification
  • local features
  • local ranking
  • nearest neighbors

ASJC Scopus subject areas

  • Computer Science(all)

Cite this

Nearest neighbor classifier based on nearest feature decisions. / James, Alex Pappachen; Dimitrijev, Sima.

In: Computer Journal, Vol. 55, No. 9, 09.2012, p. 1072-1087.

Research output: Contribution to journalArticle

James, Alex Pappachen ; Dimitrijev, Sima. / Nearest neighbor classifier based on nearest feature decisions. In: Computer Journal. 2012 ; Vol. 55, No. 9. pp. 1072-1087.
@article{c31a7cd9eee545698514320694446837,
title = "Nearest neighbor classifier based on nearest feature decisions",
abstract = "High feature dimensionality of realistic datasets adversely affects the recognition accuracy of nearest neighbor (NN) classifiers. To address this issue, we introduce a nearest feature classifier that shifts the NN concept from the global-decision level to the level of individual features. Performance comparisons with 12 instance-based classifiers on 13 benchmark University of California Irvine classification datasets show average improvements of 6 and 3.5{\%} in recognition accuracy and area under curve performance measures, respectively. The statistical significance of the observed performance improvements is verified by the Friedman test and by the post hoc Bonferroni-Dunn test. In addition, the application of the classifier is demonstrated on face recognition databases, a character recognition database and medical diagnosis problems for binary and multi-class diagnosis on databases including morphological and gene expression features.",
keywords = "classification, local features, local ranking, nearest neighbors",
author = "James, {Alex Pappachen} and Sima Dimitrijev",
year = "2012",
month = "9",
doi = "10.1093/comjnl/bxs001",
language = "English",
volume = "55",
pages = "1072--1087",
journal = "Computer Journal",
issn = "0010-4620",
publisher = "Oxford University Press",
number = "9",

}

TY - JOUR

T1 - Nearest neighbor classifier based on nearest feature decisions

AU - James, Alex Pappachen

AU - Dimitrijev, Sima

PY - 2012/9

Y1 - 2012/9

N2 - High feature dimensionality of realistic datasets adversely affects the recognition accuracy of nearest neighbor (NN) classifiers. To address this issue, we introduce a nearest feature classifier that shifts the NN concept from the global-decision level to the level of individual features. Performance comparisons with 12 instance-based classifiers on 13 benchmark University of California Irvine classification datasets show average improvements of 6 and 3.5% in recognition accuracy and area under curve performance measures, respectively. The statistical significance of the observed performance improvements is verified by the Friedman test and by the post hoc Bonferroni-Dunn test. In addition, the application of the classifier is demonstrated on face recognition databases, a character recognition database and medical diagnosis problems for binary and multi-class diagnosis on databases including morphological and gene expression features.

AB - High feature dimensionality of realistic datasets adversely affects the recognition accuracy of nearest neighbor (NN) classifiers. To address this issue, we introduce a nearest feature classifier that shifts the NN concept from the global-decision level to the level of individual features. Performance comparisons with 12 instance-based classifiers on 13 benchmark University of California Irvine classification datasets show average improvements of 6 and 3.5% in recognition accuracy and area under curve performance measures, respectively. The statistical significance of the observed performance improvements is verified by the Friedman test and by the post hoc Bonferroni-Dunn test. In addition, the application of the classifier is demonstrated on face recognition databases, a character recognition database and medical diagnosis problems for binary and multi-class diagnosis on databases including morphological and gene expression features.

KW - classification

KW - local features

KW - local ranking

KW - nearest neighbors

UR - http://www.scopus.com/inward/record.url?scp=84865779001&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84865779001&partnerID=8YFLogxK

U2 - 10.1093/comjnl/bxs001

DO - 10.1093/comjnl/bxs001

M3 - Article

VL - 55

SP - 1072

EP - 1087

JO - Computer Journal

JF - Computer Journal

SN - 0010-4620

IS - 9

ER -