Kernel machine-based one-parameter regularized fisher discriminant method for face recognition

Wen Sheng Chen*, Pong Chi YUEN, Jian Huang, Dao Qing Dai

*Corresponding author for this work

Research output: Contribution to journalJournal articlepeer-review

114 Citations (Scopus)


This paper addresses two problems in linear discriminant analysis (LDA) of face recognition. The first one is the problem of recognition of human faces under pose and illumination variations. It is well known that the distribution of face images with different pose, illumination, and face expression is complex and nonlinear. The traditional linear methods, such as LDA, will not give a satisfactory performance. The second problem is the small sample size (S3) problem. This problem occurs when the number of training samples is smaller than the dimensionality of feature vector. In turn, the within-class scatter matrix will become singular. To overcome these limitations, this paper proposes a new kernel machine-based one-parameter regularized Fisher discriminant (K1PRFD) technique. K1PRFD is developed based on our previously developed one-parameter regularized discriminant analysis method and the well-known kernel approach. Therefore, K1PRFD consists of two parameters, namely the regularization parameter and kernel parameter. This paper further proposes a new method to determine the optimal kernel parameter in RBF kernel and regularized parameter in within-class scatter matrix simultaneously based on the conjugate gradient method. Three databases, namely FERET, Yale Group B, and CMU PIE, are selected for evaluation. The results are encouraging. Comparing with the existing LDA-based methods, the proposed method gives superior results.

Original languageEnglish
Pages (from-to)659-669
Number of pages11
JournalIEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Issue number4
Publication statusPublished - Aug 2005

Scopus Subject Areas

  • Control and Systems Engineering
  • Software
  • Information Systems
  • Human-Computer Interaction
  • Computer Science Applications
  • Electrical and Electronic Engineering

User-Defined Keywords

  • Face recognition
  • Pose and illumination variations
  • RBF kernel function
  • Regularized discriminant analysis
  • Small sample-size problem


Dive into the research topics of 'Kernel machine-based one-parameter regularized fisher discriminant method for face recognition'. Together they form a unique fingerprint.

Cite this