TY - JOUR
T1 - Instance-specific canonical correlation analysis
AU - Zhai, Deming
AU - ZHANG, Yu
AU - Yeung, Dit Yan
AU - Chang, Hong
AU - Chen, Xilin
AU - Gao, Wen
N1 - Funding Information:
The work is partially supported by Natural Science Foundation of China under Contracts nos. 61305071 and 61300110 .
PY - 2015/5/1
Y1 - 2015/5/1
N2 - Canonical Correlation Analysis (CCA) is one of the most popular statistical methods to capture the correlations between two variables. However, it has limitations as a linear and global algorithm. Although some variants have been proposed to overcome the limitations, neither of them achieves locality and nonlinearity at the same time. In this paper, we propose a novel algorithm called Instance-Specific Canonical Correlation Analysis (ISCCA), which approximates the nonlinear data by computing the instance-specific projections along the smooth curve of the manifold. First, we propose a least squares solution for CCA which will set the stage for the proposed method. Second, based on the framework of least squares regression, CCA is extended to the instance-specific case which obtains a set of locally linear smooth but globally nonlinear transformations. Third, ISCCA can be extended to semi-supervised setting by exploiting the unlabeled data to further improve the performance. The optimization problem is proved to be convex and could be solved efficiently by alternating optimization. And the globally optimal solutions could be achieved with theoretical guarantee. Moreover, for large scale applications, iterative conjugate gradient algorithm can be used to speed up the computation procedure. Experimental results demonstrate the effectiveness of our proposed method.
AB - Canonical Correlation Analysis (CCA) is one of the most popular statistical methods to capture the correlations between two variables. However, it has limitations as a linear and global algorithm. Although some variants have been proposed to overcome the limitations, neither of them achieves locality and nonlinearity at the same time. In this paper, we propose a novel algorithm called Instance-Specific Canonical Correlation Analysis (ISCCA), which approximates the nonlinear data by computing the instance-specific projections along the smooth curve of the manifold. First, we propose a least squares solution for CCA which will set the stage for the proposed method. Second, based on the framework of least squares regression, CCA is extended to the instance-specific case which obtains a set of locally linear smooth but globally nonlinear transformations. Third, ISCCA can be extended to semi-supervised setting by exploiting the unlabeled data to further improve the performance. The optimization problem is proved to be convex and could be solved efficiently by alternating optimization. And the globally optimal solutions could be achieved with theoretical guarantee. Moreover, for large scale applications, iterative conjugate gradient algorithm can be used to speed up the computation procedure. Experimental results demonstrate the effectiveness of our proposed method.
KW - Canonical correlation analysis
KW - Least squares regression
KW - Multi-view statistical learning
UR - http://www.scopus.com/inward/record.url?scp=84946165979&partnerID=8YFLogxK
U2 - 10.1016/j.neucom.2014.12.028
DO - 10.1016/j.neucom.2014.12.028
M3 - Journal article
AN - SCOPUS:84946165979
SN - 0925-2312
VL - 155
SP - 205
EP - 218
JO - Neurocomputing
JF - Neurocomputing
ER -