TY - JOUR
T1 - Cyclic tensor singular value decomposition with applications in low-rank high-order tensor recovery
AU - Zhang, Yigong
AU - Tu, Zhihui
AU - Lu, Jian
AU - Xu, Chen
AU - Ng, Michael K.
N1 - This work is supported in part by the National Natural Science Foundation of China under grants U21A20455, 12326619, 61972265 and 62372302, the Shenzhen Basis Research Project (JCYJ20210324094006017), the Natural Science Foundation of Guangdong Province of China under grants 2020B1515310008, 2023A1515011691 and 2024A1515011913, the Educational Commission of Guangdong Province of China under grant 2019KZDZX1007, HKRGC GRF 12300519, 17201020 and 17300021, HKRGC CRF C1013-21GF and C7004-21GF, and Joint NSFC and RGC N-HKU769/21.
Publisher Copyright:
© 2024
PY - 2024/7/24
Y1 - 2024/7/24
N2 - The rapid advancements in emerging technologies have increased the demand for recovery tasks involving high-dimensional data with complex structures. Effectively utilizing tensor decomposition techniques to capture the low-rank structure of such data is crucial. Recently, the high-order t-SVD has demonstrated strong adaptability. However, this decomposition approach can only capture the low-rank correlation of two modes along other modes individually, while disregarding the structural correlation between different modes. In this paper, we propose a novel cyclic tensor singular value decomposition (CTSVD) method that effectively characterizes the low-rank structures of high-order tensors along all modes. Specifically, our method decomposes an order-N tensor into N factor tensors and one core tensor, connecting them using a defined mode-k tensor-tensor product (t-product). Building upon this, we establish the corresponding tensor rank and its convex relaxation. To address the issue of dimensional imbalance between adjacent modes in high-dimensional data, we propose and integrate a square reshaping strategy into the recovery models for tensor completion (TC) and tensor principal component analysis (TRPCA) tasks. Effective alternating direction method of multipliers (ADMM)-based algorithms are designed to these tasks. Extensive experiments on both synthetic and real data demonstrate that our methods outperform state-of-the-art approaches.
AB - The rapid advancements in emerging technologies have increased the demand for recovery tasks involving high-dimensional data with complex structures. Effectively utilizing tensor decomposition techniques to capture the low-rank structure of such data is crucial. Recently, the high-order t-SVD has demonstrated strong adaptability. However, this decomposition approach can only capture the low-rank correlation of two modes along other modes individually, while disregarding the structural correlation between different modes. In this paper, we propose a novel cyclic tensor singular value decomposition (CTSVD) method that effectively characterizes the low-rank structures of high-order tensors along all modes. Specifically, our method decomposes an order-N tensor into N factor tensors and one core tensor, connecting them using a defined mode-k tensor-tensor product (t-product). Building upon this, we establish the corresponding tensor rank and its convex relaxation. To address the issue of dimensional imbalance between adjacent modes in high-dimensional data, we propose and integrate a square reshaping strategy into the recovery models for tensor completion (TC) and tensor principal component analysis (TRPCA) tasks. Effective alternating direction method of multipliers (ADMM)-based algorithms are designed to these tasks. Extensive experiments on both synthetic and real data demonstrate that our methods outperform state-of-the-art approaches.
KW - Cyclic tensor singular value decomposition
KW - Low-rank high-order tensor recovery
KW - Square reshaping strategy
KW - Visual image processing
UR - http://www.scopus.com/inward/record.url?scp=85199753602&partnerID=8YFLogxK
U2 - 10.1016/j.sigpro.2024.109628
DO - 10.1016/j.sigpro.2024.109628
M3 - Journal article
AN - SCOPUS:85199753602
SN - 0165-1684
VL - 225
JO - Signal Processing
JF - Signal Processing
M1 - 109628
ER -