Multiscale Feature Tensor Train Rank Minimization for Multidimensional Image Recovery

Hao Zhang, Xi Le Zhao*, Tai Xiang Jiang, Michael K. Ng, Ting Zhu Huang

*Corresponding author for this work

Research output: Contribution to journalJournal articlepeer-review

29 Citations (Scopus)

Abstract

The general tensor-based methods can recover missing values of multidimensional images by exploiting the low-rankness on the pixel level. However, especially when considerable pixels of an image are missing, the low-rankness is not reliable on the pixel level, resulting in some details losing in their results, which hinders the performance of subsequent image applications (e.g., image recognition and segmentation). In this article, we suggest a novel multiscale feature (MSF) tensorization by exploiting the MSFs of multidimensional images, which not only helps to recover the missing values on a higher level, that is, the feature level but also benefits subsequent image applications. By exploiting the low-rankness of the resulting MSF tensor constructed by the new tensorization, we propose the convex and nonconvex MSF tensor train rank minimization (MSF-TT) to conjointly recover the MSF tensor and the corresponding original tensor in a unified framework. We develop the alternating directional method of multipliers (ADMMs) to solve the convex MSF-TT and the proximal alternating minimization (PAM) to solve the nonconvex MSF-TT. Moreover, we establish the theoretical guarantee of convergence for the PAM algorithm. Numerical examples of real-world multidimensional images show that the proposed MSF-TT outperforms other compared approaches in image recovery and the recovered MSF tensor can benefit the subsequent image recognition.

Original languageEnglish
Pages (from-to)13395-13410
Number of pages16
JournalIEEE Transactions on Cybernetics
Volume52
Issue number12
DOIs
Publication statusPublished - 20 Sept 2021

Scopus Subject Areas

  • Software
  • Control and Systems Engineering
  • Information Systems
  • Human-Computer Interaction
  • Computer Science Applications
  • Electrical and Electronic Engineering

User-Defined Keywords

  • Feature-level tensor completion
  • multiscale features (MSFs)
  • tensor train (TT) rank minimization
  • tensorization

Cite this