TY - JOUR
T1 - Region-Aware Reflection Removal With Unified Content and Gradient Priors
AU - Wan, Renjie
AU - Shi, Boxin
AU - Duan, Ling-Yu
AU - Tan, Ah-Hwee
AU - Gao, Wen
AU - Kot, Alex C.
N1 - This work was supported in part by the National Natural Science
Foundation of China under Grant 61661146005, Grant U1611461, and
Grant 61390515, in part by the National Key Research and Development Pro-
gram of China under Grant 2016YFB1001501, and in part by the NTU-PKU
Joint Research Institute through the Ng Teng Fong Charitable Foundation. The
work of B. Shi was supported by the Recruitment Program of Global Experts
(Youth Program) in China (a.k.a. 1000 Youth Talents).
PY - 2018/6
Y1 - 2018/6
N2 - Removing the undesired reflections in images taken through the glass is of broad application to various image processing and computer vision tasks. Existing single image-based solutions heavily rely on scene priors such as separable sparse gradients caused by different levels of blur, and they are fragile when such priors are not observed. In this paper, we notice that strong reflections usually dominant a limited region in the whole image, and propose a region-aware reflection removal approach by automatically detecting and heterogeneously processing regions with and without reflections. We integrate content and gradient priors to jointly achieve missing contents restoration, as well as background and reflection separation, in a unified optimization framework. Extensive validation using 50 sets of real data shows that the proposed method outperforms state-of-the-art on both quantitative metrics and visual qualities.
AB - Removing the undesired reflections in images taken through the glass is of broad application to various image processing and computer vision tasks. Existing single image-based solutions heavily rely on scene priors such as separable sparse gradients caused by different levels of blur, and they are fragile when such priors are not observed. In this paper, we notice that strong reflections usually dominant a limited region in the whole image, and propose a region-aware reflection removal approach by automatically detecting and heterogeneously processing regions with and without reflections. We integrate content and gradient priors to jointly achieve missing contents restoration, as well as background and reflection separation, in a unified optimization framework. Extensive validation using 50 sets of real data shows that the proposed method outperforms state-of-the-art on both quantitative metrics and visual qualities.
KW - Reflection removal
KW - internal patch recurrence
KW - content prior
KW - sparse representation
UR - https://www.scopus.com/record/display.uri?eid=2-s2.0-85042354101&origin=inward
U2 - 10.1109/TIP.2018.2808768
DO - 10.1109/TIP.2018.2808768
M3 - Journal article
SN - 1057-7149
VL - 27
SP - 2927
EP - 2941
JO - IEEE Transactions on Image Processing
JF - IEEE Transactions on Image Processing
IS - 6
ER -