SNMFCA: Supervised NMF-based image classification and annotation

Liping Jing*, Chao Zhang, Kwok Po Ng

*Corresponding author for this work

Research output: Contribution to journalJournal articlepeer-review

43 Citations (Scopus)


In this paper, we propose a novel supervised nonnegative matrix factorization-based framework for both image classification and annotation. The framework consists of two phases: training and prediction. In the training phase, two supervised nonnegative matrix factorizations for image descriptors and annotation terms are combined to identify the latent image bases, and to represent the training images in the bases space. These latent bases can capture the representation of the images in terms of both descriptors and annotation terms. Based on the new representation of training images, classifiers can be learnt and built. In the prediction phase, a test image is first represented by the latent bases via solving a linear least squares problem, and then its class label and annotation can be predicted via the trained classifiers and the proposed annotation mapping model. In the algorithm, we develop a three-block proximal alternating nonnegative least squares algorithm to determine the latent image bases, and show its convergent property. Extensive experiments on real-world image data sets suggest that the proposed framework is able to predict the label and annotation for testing images successfully. Experimental results have also shown that our algorithm is computationally efficient and effective for image classification and annotation.

Original languageEnglish
Article number6226461
Pages (from-to)4508-4521
Number of pages14
JournalIEEE Transactions on Image Processing
Issue number11
Publication statusPublished - Nov 2012

Scopus Subject Areas

  • Software
  • Computer Graphics and Computer-Aided Design

User-Defined Keywords

  • Image annotation
  • image classification
  • latent image bases
  • nonnegative matrix factorization
  • supervised learning


Dive into the research topics of 'SNMFCA: Supervised NMF-based image classification and annotation'. Together they form a unique fingerprint.

Cite this