TY - JOUR
T1 - Towards the global solution of the maximal correlation problem
AU - Zhang, Lei Hong
AU - Liao, Li Zhi
AU - Sun, Li Ming
N1 - Funding Information:
This research was supported in part by grants from Hong Kong Baptist University (FRG) and the Research Grant Council of Hong Kong.
PY - 2011/1
Y1 - 2011/1
N2 - The maximal correlation problem (MCP) aiming at optimizing correlation between sets of variables plays a very important role in many areas of statistical applications. Currently, algorithms for the general MCP stop at solutions of the multivariate eigenvalue problem for a related matrix A, which serves as a necessary condition for the global solutions of the MCP. However, the reliability of the statistical prediction in applications relies greatly on the global maximizer of the MCP, and would be significantly impacted if the solution found is a local maximizer. Towards the global solution of the MCP, we have obtained four results in the present paper. First, the sufficient and necessary condition for global optimality of the MCP when A is a positive matrix is extended to the nonnegative case. Secondly, the uniqueness of the multivariate eigenvalues in the global maxima of the MCP is proved either when there are only two sets of variables involved, or when A is nonnegative. The uniqueness of the global maximizer of the MCP for the nonnegative irreducible case is also proved. These theoretical achievements lead to our third result that if A is a nonnegative irreducible matrix, both the Horst-Jacobi algorithm and the Gauss-Seidel algorithm converge globally to the global maximizer of the MCP. Lastly, some new estimates of the multivariate eigenvalues related to the global maxima are obtained.
AB - The maximal correlation problem (MCP) aiming at optimizing correlation between sets of variables plays a very important role in many areas of statistical applications. Currently, algorithms for the general MCP stop at solutions of the multivariate eigenvalue problem for a related matrix A, which serves as a necessary condition for the global solutions of the MCP. However, the reliability of the statistical prediction in applications relies greatly on the global maximizer of the MCP, and would be significantly impacted if the solution found is a local maximizer. Towards the global solution of the MCP, we have obtained four results in the present paper. First, the sufficient and necessary condition for global optimality of the MCP when A is a positive matrix is extended to the nonnegative case. Secondly, the uniqueness of the multivariate eigenvalues in the global maxima of the MCP is proved either when there are only two sets of variables involved, or when A is nonnegative. The uniqueness of the global maximizer of the MCP for the nonnegative irreducible case is also proved. These theoretical achievements lead to our third result that if A is a nonnegative irreducible matrix, both the Horst-Jacobi algorithm and the Gauss-Seidel algorithm converge globally to the global maximizer of the MCP. Lastly, some new estimates of the multivariate eigenvalues related to the global maxima are obtained.
KW - Canonical correlation
KW - Gauss-Seidel method
KW - Global maximizer
KW - Maximal correlation problem
KW - Multivariate eigenvalue problem
KW - Multivariate statistics
KW - Nonnegative irreducible matrix
KW - Power method
UR - http://www.scopus.com/inward/record.url?scp=78650753105&partnerID=8YFLogxK
U2 - 10.1007/s10898-010-9536-6
DO - 10.1007/s10898-010-9536-6
M3 - Journal article
AN - SCOPUS:78650753105
SN - 0925-5001
VL - 49
SP - 91
EP - 107
JO - Journal of Global Optimization
JF - Journal of Global Optimization
IS - 1
ER -