Robust and non-negative collective matrix factorization for text-to-image transfer learning

Liu Yang*, Liping Jing, Kwok Po NG

*Corresponding author for this work

Research output: Contribution to journalJournal articlepeer-review

50 Citations (Scopus)


Heterogeneous transfer learning has recently gained much attention as a new machine learning paradigm in which the knowledge can be transferred from source domains to target domains in different feature spaces. Existing works usually assume that source domains can provide accurate and useful knowledge to be transferred to target domains for learning. In practice, there may be noise appearing in given source (text) and target (image) domains data, and thus, the performance of transfer learning can be seriously degraded. In this paper, we propose a robust and non-negative collective matrix factorization model to handle noise in text-to-image transfer learning, and make a reliable bridge to transfer accurate and useful knowledge from the text domain to the image domain. The proposed matrix factorization model can be solved by an efficient iterative method, and the convergence of the iterative method can be shown. Extensive experiments on real data sets suggest that the proposed model is able to effectively perform transfer learning in noisy text and image domains, and it is superior to the popular existing methods for text-to-image transfer learning.

Original languageEnglish
Article number7180374
Pages (from-to)4701-4714
Number of pages14
JournalIEEE Transactions on Image Processing
Issue number12
Publication statusPublished - 1 Dec 2015

Scopus Subject Areas

  • Software
  • Computer Graphics and Computer-Aided Design

User-Defined Keywords

  • heterogeneous transfer learning
  • robust matrix factorization
  • Text-to-image


Dive into the research topics of 'Robust and non-negative collective matrix factorization for text-to-image transfer learning'. Together they form a unique fingerprint.

Cite this