A Scalable Algorithm for Large-Scale Unsupervised Multi-View Partial Least Squares

Li Wang, Ren-Cang Li

Research output: Contribution to journalArticlepeer-review

Abstract

We present an unsupervised multi-view partial least squares (PLS) by learning a common latent space from given multi-view data. Although PLS is a frequently used technique for analyzing relationships between two datasets, its extension to more than two views in unsupervised setting is seldom studied. In this article, we fill up the gap, and our model bears similarity to the extension of canonical correlation analysis (CCA) to more than two sets of variables and is built on the findings from analyzing PLS, CCA, and its variants. The resulting problem involves a set of orthogonality constraints on view-specific projection matrices, and is numerically challenging to existing methods that may have numerical instabilities and offer no orthogonality guarantee on view-specific projection matrices. To solve this problem, we propose a stable deflation algorithm that relies on proven numerical linear algebra techniques, can guarantee the orthogonality constraints, and simultaneously maximizes the covariance in the common space. We further adapt our algorithm to efficiently handle large-scale high-dimensional data. Extensive experiments have been conducted to evaluate the algorithm through performing two learning tasks, cross-modal retrieval, and multi-view feature extraction. The results demonstrate that the proposed algorithm outperforms the baselines and is scalable for large-scale high-dimensional datasets.

Original languageEnglish
Pages (from-to)1073-1083
Number of pages11
JournalIEEE Transactions on Big Data
Volume8
Issue number4
Early online date7 Aug 2020
DOIs
Publication statusPublished - 1 Aug 2022

Scopus Subject Areas

  • Information Systems and Management
  • Information Systems

User-Defined Keywords

  • Multi-view learning
  • Partial least squares
  • Unsupervised subspace learning

Fingerprint

Dive into the research topics of 'A Scalable Algorithm for Large-Scale Unsupervised Multi-View Partial Least Squares'. Together they form a unique fingerprint.

Cite this