TY - JOUR
T1 - Multi-Dimensional Visual Data Completion via Low-Rank Tensor Representation under Coupled Transform
AU - Wang, Jian Li
AU - Huang, Ting Zhu
AU - Zhao, Xi Le
AU - Jiang, Tai Xiang
AU - Ng, Michael K.
N1 - This work was supported in part by the National Natural Science Foundation of China under Grant 61876203, Grant 61772003, and Grant 12001446; in part by the Applied Basic Research Project of Sichuan Province under Grant 21YYJC3042; in part by the Key Project of Applied Basic Research in Sichuan Province under Grant 2020YJ0216; in part by the National Key Research and Development Program of China under Grant 2020YFA0714001; in part by the Fundamental Research Funds for the Central Universities under Grant JBK2102001; and in part by the HKRGC under Grant GRF 12200317, Grant 12300218, Grant 12300519, and Grant 17201020.
Publisher Copyright:
© 1992-2012 IEEE.
PY - 2021/3/8
Y1 - 2021/3/8
N2 - This paper addresses the tensor completion problem, which aims to recover missing information of multi-dimensional images. How to represent a low-rank structure embedded in the underlying data is the key issue in tensor completion. In this work, we suggest a novel low-rank tensor representation based on coupled transform, which fully exploits the spatial multi-scale nature and redundancy in spatial and spectral/temporal dimensions, leading to a better low tensor multi-rank approximation. More precisely, this representation is achieved by using two-dimensional framelet transform for the two spatial dimensions, one/two-dimensional Fourier transform for the temporal/spectral dimension, and then Karhunen-Loéve transform (via singular value decomposition) for the transformed tensor. Based on this low-rank tensor representation, we formulate a novel low-rank tensor completion model for recovering missing information in multi-dimensional visual data, which leads to a convex optimization problem. To tackle the proposed model, we develop the alternating directional method of multipliers (ADMM) algorithm tailored for the structured optimization problem. Numerical examples on color images, multispectral images, and videos illustrate that the proposed method outperforms many state-of-the-art methods in qualitative and quantitative aspects.
AB - This paper addresses the tensor completion problem, which aims to recover missing information of multi-dimensional images. How to represent a low-rank structure embedded in the underlying data is the key issue in tensor completion. In this work, we suggest a novel low-rank tensor representation based on coupled transform, which fully exploits the spatial multi-scale nature and redundancy in spatial and spectral/temporal dimensions, leading to a better low tensor multi-rank approximation. More precisely, this representation is achieved by using two-dimensional framelet transform for the two spatial dimensions, one/two-dimensional Fourier transform for the temporal/spectral dimension, and then Karhunen-Loéve transform (via singular value decomposition) for the transformed tensor. Based on this low-rank tensor representation, we formulate a novel low-rank tensor completion model for recovering missing information in multi-dimensional visual data, which leads to a convex optimization problem. To tackle the proposed model, we develop the alternating directional method of multipliers (ADMM) algorithm tailored for the structured optimization problem. Numerical examples on color images, multispectral images, and videos illustrate that the proposed method outperforms many state-of-the-art methods in qualitative and quantitative aspects.
KW - 2D framelet transform
KW - multi-scale representation
KW - tensor completion
KW - tensor nuclear norm
UR - http://www.scopus.com/inward/record.url?scp=85102643638&partnerID=8YFLogxK
U2 - 10.1109/TIP.2021.3062995
DO - 10.1109/TIP.2021.3062995
M3 - Journal article
C2 - 33684037
AN - SCOPUS:85102643638
SN - 1057-7149
VL - 30
SP - 3581
EP - 3596
JO - IEEE Transactions on Image Processing
JF - IEEE Transactions on Image Processing
ER -