Exact representation of the second-order moments for resubstitution and leave-one-out error estimation for linear discriminant analysis in the univariate heteroskedastic Gaussian model

Amin Zollanvari, Ulisses Braga-Neto, Edward R. Dougherty

Research output: Contribution to journalArticle

17 Citations (Scopus)

Abstract

This paper provides exact analytical expressions for the bias, variance, and RMS for the resubstitution and leave-one-out error estimators in the case of linear discriminant analysis (LDA) in the univariate heteroskedastic Gaussian model. Neither the variances nor the sample sizes for the two classes need be the same. The generality of heteroskedasticity (unequal variances) is a fundamental feature of the work presented in this paper, which distinguishes it from past work. The expected resubstitution and leave-one-out errors are represented by probabilities involving bivariate Gaussian distributions. Their second moments and cross-moments with the actual error are represented by 3- and 4-variate Gaussian distributions. From these, the bias, deviation variance, and RMS for resubstitution and leave-one-out as estimators of the actual error can be computed. The RMS expressions are applied to the determination of sample size and illustrated in biomarker classification.

Original languageEnglish
Pages (from-to)908-917
Number of pages10
JournalPattern Recognition
Volume45
Issue number2
DOIs
Publication statusPublished - Feb 2012
Externally publishedYes

    Fingerprint

Keywords

  • Error estimation
  • Genomics
  • Heteroskedasticity
  • Leave-one-out
  • Linear discriminant analysis
  • Resubstitution
  • RMS

ASJC Scopus subject areas

  • Software
  • Artificial Intelligence
  • Computer Vision and Pattern Recognition
  • Signal Processing

Cite this