Joint sampling distribution between actual and estimated classification errors for linear discriminant analysis

Amin Zollanvari, Ulisses M. Braga-Neto, Edward R. Dougherty

Research output: Contribution to journalArticlepeer-review

27 Citations (Scopus)

Abstract

Error estimation must be used to find the accuracy of a designed classifier, an issue that is critical in biomarker discovery for disease diagnosis and prognosis in genomics and proteomics. This paper presents, for what is believed to be the first time, the analytical formulation for the joint sampling distribution of the actual and estimated errors of a classification rule. The analysis presented here concerns the linear discriminant analysis (LDA) classification rule and the resubstitution and leave-one-out error estimators, under a general parametric Gaussian assumption. Exact results are provided in the univariate case, and a simple method is suggested to obtain an accurate approximation in the multivariate case. It is also shown how these results can be applied in the computation of condition bounds and the regression of the actual error, given the observed error estimate. In contrast to asymptotic results, the analysis presented here is applicable to finite training data. In particular, it applies in the small-sample settings commonly found in genomics and proteomics applications. Numerical examples, which include parameters estimated from actual microarray data, illustrate the analysis throughout.

Original languageEnglish
Article number5420275
Pages (from-to)784-804
Number of pages21
JournalIEEE Transactions on Information Theory
Volume56
Issue number2
DOIs
Publication statusPublished - Feb 1 2010

Keywords

  • Classification
  • Cross-validation
  • Error estimation
  • Leave-one-out
  • Linear discriminant analysis
  • Resubstitution
  • Sampling distribution

ASJC Scopus subject areas

  • Information Systems
  • Computer Science Applications
  • Library and Information Sciences

Fingerprint Dive into the research topics of 'Joint sampling distribution between actual and estimated classification errors for linear discriminant analysis'. Together they form a unique fingerprint.

Cite this