Instance-specific canonical correlation analysis

Deming Zhai*, Yu ZHANG, Dit Yan Yeung, Hong Chang, Xilin Chen, Wen Gao

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

4 Citations (Scopus)

Abstract

Canonical Correlation Analysis (CCA) is one of the most popular statistical methods to capture the correlations between two variables. However, it has limitations as a linear and global algorithm. Although some variants have been proposed to overcome the limitations, neither of them achieves locality and nonlinearity at the same time. In this paper, we propose a novel algorithm called Instance-Specific Canonical Correlation Analysis (ISCCA), which approximates the nonlinear data by computing the instance-specific projections along the smooth curve of the manifold. First, we propose a least squares solution for CCA which will set the stage for the proposed method. Second, based on the framework of least squares regression, CCA is extended to the instance-specific case which obtains a set of locally linear smooth but globally nonlinear transformations. Third, ISCCA can be extended to semi-supervised setting by exploiting the unlabeled data to further improve the performance. The optimization problem is proved to be convex and could be solved efficiently by alternating optimization. And the globally optimal solutions could be achieved with theoretical guarantee. Moreover, for large scale applications, iterative conjugate gradient algorithm can be used to speed up the computation procedure. Experimental results demonstrate the effectiveness of our proposed method.

Original languageEnglish
Pages (from-to)205-218
Number of pages14
JournalNeurocomputing
Volume155
DOIs
Publication statusPublished - 1 May 2015

Scopus Subject Areas

  • Computer Science Applications
  • Cognitive Neuroscience
  • Artificial Intelligence

User-Defined Keywords

  • Canonical correlation analysis
  • Least squares regression
  • Multi-view statistical learning

Fingerprint

Dive into the research topics of 'Instance-specific canonical correlation analysis'. Together they form a unique fingerprint.

Cite this