TY - JOUR
T1 - Multiscale Feature Tensor Train Rank Minimization for Multidimensional Image Recovery
AU - Zhang, Hao
AU - Zhao, Xi Le
AU - Jiang, Tai Xiang
AU - Ng, Michael K.
AU - Huang, Ting Zhu
N1 - This work was supported in part by the National Natural Science Foundation of China under Grant 61876203, Grant 61772003, and Grant 12001446; in part by the Applied Basic Research Project of Sichuan Province under Grant 21YYJC3042; in part by the Key Project of Applied Basic Research in Sichuan Province under Grant 2020YJ0216; in part by the National Key Research and Development Program of China under Grant 2020YFA0714001; in part by the Fundamental Research Funds for the Central Universities under Grant JBK2102001; and in part by HKRGC GRF under Grant 12300218, Grant 12300519, Grant 17201020, and Grant 17300021.
Publisher Copyright:
© 2021 IEEE.
PY - 2021/9/20
Y1 - 2021/9/20
N2 - The general tensor-based methods can recover missing values of multidimensional images by exploiting the low-rankness on the pixel level. However, especially when considerable pixels of an image are missing, the low-rankness is not reliable on the pixel level, resulting in some details losing in their results, which hinders the performance of subsequent image applications (e.g., image recognition and segmentation). In this article, we suggest a novel multiscale feature (MSF) tensorization by exploiting the MSFs of multidimensional images, which not only helps to recover the missing values on a higher level, that is, the feature level but also benefits subsequent image applications. By exploiting the low-rankness of the resulting MSF tensor constructed by the new tensorization, we propose the convex and nonconvex MSF tensor train rank minimization (MSF-TT) to conjointly recover the MSF tensor and the corresponding original tensor in a unified framework. We develop the alternating directional method of multipliers (ADMMs) to solve the convex MSF-TT and the proximal alternating minimization (PAM) to solve the nonconvex MSF-TT. Moreover, we establish the theoretical guarantee of convergence for the PAM algorithm. Numerical examples of real-world multidimensional images show that the proposed MSF-TT outperforms other compared approaches in image recovery and the recovered MSF tensor can benefit the subsequent image recognition.
AB - The general tensor-based methods can recover missing values of multidimensional images by exploiting the low-rankness on the pixel level. However, especially when considerable pixels of an image are missing, the low-rankness is not reliable on the pixel level, resulting in some details losing in their results, which hinders the performance of subsequent image applications (e.g., image recognition and segmentation). In this article, we suggest a novel multiscale feature (MSF) tensorization by exploiting the MSFs of multidimensional images, which not only helps to recover the missing values on a higher level, that is, the feature level but also benefits subsequent image applications. By exploiting the low-rankness of the resulting MSF tensor constructed by the new tensorization, we propose the convex and nonconvex MSF tensor train rank minimization (MSF-TT) to conjointly recover the MSF tensor and the corresponding original tensor in a unified framework. We develop the alternating directional method of multipliers (ADMMs) to solve the convex MSF-TT and the proximal alternating minimization (PAM) to solve the nonconvex MSF-TT. Moreover, we establish the theoretical guarantee of convergence for the PAM algorithm. Numerical examples of real-world multidimensional images show that the proposed MSF-TT outperforms other compared approaches in image recovery and the recovered MSF tensor can benefit the subsequent image recognition.
KW - Feature-level tensor completion
KW - multiscale features (MSFs)
KW - tensor train (TT) rank minimization
KW - tensorization
UR - http://www.scopus.com/inward/record.url?scp=85115680555&partnerID=8YFLogxK
U2 - 10.1109/TCYB.2021.3108847
DO - 10.1109/TCYB.2021.3108847
M3 - Journal article
C2 - 34543216
AN - SCOPUS:85115680555
SN - 2168-2267
VL - 52
SP - 13395
EP - 13410
JO - IEEE Transactions on Cybernetics
JF - IEEE Transactions on Cybernetics
IS - 12
ER -