Reference-based Iterative Interaction with P2-Matching for Stereo Image Super-Resolution

Runmin Cong, Rongxin Liao, Feng Li*, Ronghui Sheng, Huihui Bai, Renjie Wan, Sam Kwong, Wei Zhang

*Corresponding author for this work

Research output: Contribution to journalJournal articlepeer-review

Abstract

Stereo Image Super-Resolution (SSR) holds great promise in improving the quality of stereo images by exploiting the complementary information between left and right views. Most SSR methods primarily focus on the inter-view correspondences in low-resolution (LR) space. The potential of referencing a high-quality SR image of one view benefits the SR for the other is often overlooked, while those with abundant textures contribute to accurate correspondences. Therefore, we propose Reference-based Iterative Interaction (RIISSR), which utilizes reference-based iterative pixel-wise and patch-wise matching, dubbed P 2-Matching, to establish cross-view and cross-resolution correspondences for SSR. Specifically, we first design the information perception block (IPB) cascaded in parallel to extract hierarchical contextualized features for different views. Pixel- wise matching is embedded between two parallel IPBs to exploit cross-view interaction in LR space. Iterative patch-wise matching is then executed by utilizing the SR stereo pair as another mutual reference, capitalizing on the cross-scale patch recurrence property to learn high-resolution (HR) correspondences for SSR performance. Moreover, we introduce the supervised side-out modulator (SSOM) to re-weight local intraview features and produce intermediate SR images, which seamlessly bridge two matching mechanisms. Experimental results demonstrate the superiority of RIISSR against existing state-of-the-art methods.
Original languageEnglish
Pages (from-to)3779-3789
Number of pages11
JournalIEEE Transactions on Image Processing
Volume34
DOIs
Publication statusPublished - 12 Jun 2025

User-Defined Keywords

  • P2-matching
  • Stereo Image Super-Resolution
  • information perception block
  • supervised side-out modulator

Fingerprint

Dive into the research topics of 'Reference-based Iterative Interaction with P2-Matching for Stereo Image Super-Resolution'. Together they form a unique fingerprint.

Cite this