TY - JOUR
T1 - Coarse-to-fine Disentangling Demoiréing Framework for Recaptured Screen Images
AU - Wang, Ce
AU - He, Bin
AU - Wu, Shengsen
AU - Wan, Renjie
AU - Shi, Boxin
AU - Duan, Ling Yu
N1 - Publisher Copyright:
© 2023 IEEE.
Funding Information:
This work was supported in part by the National Natural Science Foundation of China under Grants 62088102 and 62136001 and in part by the PKU-NTU Joint Research Institute (JRI) sponsored by a donation from the Ng Teng Fong Charitable Foundation. The work of Renjie Wan was supported in part by the Blue Sky Research Fund of HKBU under Grant BSRF/21-22/16 and in part by Guangdong Basic and Applied Basic Research Foundation under Grant 2022A1515110692
PY - 2023/8
Y1 - 2023/8
N2 - Removing the undesired moiré patterns from images capturing the contents displayed on screens is of increasing research interest, as the need for recording and sharing the instant information conveyed by the screens is growing. Previous demoiréing methods provide limited investigations into the formation process of moiré patterns to exploit moiré-specific priors for guiding the learning of demoiréing models. In this paper, we investigate the moiré pattern formation process from the perspective of signal aliasing, and correspondingly propose a coarse-to-fine disentangling demoiréeing framework. In this framework, we first disentangle the moiré pattern layer and the clean image with alleviated ill-posedness based on the derivation of our moiré image formation model. Then we refine the demoiréing results exploiting both the frequency domain features and edge attention, considering moiré patterns' property on spectrum distribution and edge intensity revealed in our aliasing based analysis. Experiments on several datasets show that the proposed method performs favorably against state-of-the-art methods. Besides, the proposed method is validated to adapt well to different data sources and scales, especially on the high-resolution moiré images.
AB - Removing the undesired moiré patterns from images capturing the contents displayed on screens is of increasing research interest, as the need for recording and sharing the instant information conveyed by the screens is growing. Previous demoiréing methods provide limited investigations into the formation process of moiré patterns to exploit moiré-specific priors for guiding the learning of demoiréing models. In this paper, we investigate the moiré pattern formation process from the perspective of signal aliasing, and correspondingly propose a coarse-to-fine disentangling demoiréeing framework. In this framework, we first disentangle the moiré pattern layer and the clean image with alleviated ill-posedness based on the derivation of our moiré image formation model. Then we refine the demoiréing results exploiting both the frequency domain features and edge attention, considering moiré patterns' property on spectrum distribution and edge intensity revealed in our aliasing based analysis. Experiments on several datasets show that the proposed method performs favorably against state-of-the-art methods. Besides, the proposed method is validated to adapt well to different data sources and scales, especially on the high-resolution moiré images.
KW - Moiré pattern
KW - layer separation
KW - signal aliasing
UR - http://www.scopus.com/inward/record.url?scp=85148451653&partnerID=8YFLogxK
U2 - 10.1109/TPAMI.2023.3243310
DO - 10.1109/TPAMI.2023.3243310
M3 - Journal article
SN - 0162-8828
VL - 45
SP - 9439
EP - 9453
JO - IEEE Transactions on Pattern Analysis and Machine Intelligence
JF - IEEE Transactions on Pattern Analysis and Machine Intelligence
IS - 8
ER -