TY - JOUR
T1 - Reference-based Iterative Interaction with P2-Matching for Stereo Image Super-Resolution
AU - Cong, Runmin
AU - Liao, Rongxin
AU - Li, Feng
AU - Sheng, Ronghui
AU - Bai, Huihui
AU - Wan, Renjie
AU - Kwong, Sam
AU - Zhang, Wei
N1 - This work was supported in part by the Key Laboratory of Knowledge Engineering with Big Data (the Ministry of Education of China) under grant number NO. BigKEOpen2025-07, National Natural Science Foundation of China (62331003, 62302141, 62471278), the Fundamental Research Funds for the Central Universities (JZ2024HGTB0255), the Taishan Scholar Project of Shandong Province under Grant tsqn202306079, the Research Grants Council of the Hong Kong Special Administrative Region, China under Grant STG5/E- 103/24-R, the financial support of Lingnan University, Hong Kong Special Administrative Region, China, the Major Research Program of Shandong Province under Grant 2024CXGC010212, and Beijing Natural Science Foundation (L223022).
Publisher Copyright:
© 2025 IEEE
PY - 2025/6/12
Y1 - 2025/6/12
N2 - Stereo Image Super-Resolution (SSR) holds great promise in improving the quality of stereo images by exploiting the complementary information between left and right views. Most SSR methods primarily focus on the inter-view correspondences in low-resolution (LR) space. The potential of referencing a high-quality SR image of one view benefits the SR for the other is often overlooked, while those with abundant textures contribute to accurate correspondences. Therefore, we propose Reference-based Iterative Interaction (RIISSR), which utilizes reference-based iterative pixel-wise and patch-wise matching, dubbed P 2-Matching, to establish cross-view and cross-resolution correspondences for SSR. Specifically, we first design the information perception block (IPB) cascaded in parallel to extract hierarchical contextualized features for different views. Pixel- wise matching is embedded between two parallel IPBs to exploit cross-view interaction in LR space. Iterative patch-wise matching is then executed by utilizing the SR stereo pair as another mutual reference, capitalizing on the cross-scale patch recurrence property to learn high-resolution (HR) correspondences for SSR performance. Moreover, we introduce the supervised side-out modulator (SSOM) to re-weight local intraview features and produce intermediate SR images, which seamlessly bridge two matching mechanisms. Experimental results demonstrate the superiority of RIISSR against existing state-of-the-art methods.
AB - Stereo Image Super-Resolution (SSR) holds great promise in improving the quality of stereo images by exploiting the complementary information between left and right views. Most SSR methods primarily focus on the inter-view correspondences in low-resolution (LR) space. The potential of referencing a high-quality SR image of one view benefits the SR for the other is often overlooked, while those with abundant textures contribute to accurate correspondences. Therefore, we propose Reference-based Iterative Interaction (RIISSR), which utilizes reference-based iterative pixel-wise and patch-wise matching, dubbed P 2-Matching, to establish cross-view and cross-resolution correspondences for SSR. Specifically, we first design the information perception block (IPB) cascaded in parallel to extract hierarchical contextualized features for different views. Pixel- wise matching is embedded between two parallel IPBs to exploit cross-view interaction in LR space. Iterative patch-wise matching is then executed by utilizing the SR stereo pair as another mutual reference, capitalizing on the cross-scale patch recurrence property to learn high-resolution (HR) correspondences for SSR performance. Moreover, we introduce the supervised side-out modulator (SSOM) to re-weight local intraview features and produce intermediate SR images, which seamlessly bridge two matching mechanisms. Experimental results demonstrate the superiority of RIISSR against existing state-of-the-art methods.
KW - P2-matching
KW - Stereo Image Super-Resolution
KW - information perception block
KW - supervised side-out modulator
UR - http://www.scopus.com/inward/record.url?scp=105008044783&partnerID=8YFLogxK
U2 - 10.1109/TIP.2025.3577538
DO - 10.1109/TIP.2025.3577538
M3 - Journal article
SN - 1057-7149
VL - 34
SP - 3779
EP - 3789
JO - IEEE Transactions on Image Processing
JF - IEEE Transactions on Image Processing
ER -