TY - JOUR
T1 - Cross-Image Disentanglement for Low-Light Enhancement in Real World
AU - Guo, Lanqing
AU - Wan, Renjie
AU - Yang, Wenhan
AU - Kot, Alex
AU - Wen, Bihan
N1 - Funding information:
This work was supported in part by the Ministry of Education, Republic of Singapore, through its Start-Up Grant and Academic Research Fund Tier 1 (RG61/22). Renjie Wan’s research is supported by Guangdong Basic and Applied Basic Research Foundation under Grant No. 2022A1515110692. Wenhan Yang’s research is supported by the Basic and Frontier Research Project of PCL, and the Major Key Project of PCL. This work was carried out at the Rapid-Rich Object Search (ROSE) Laboratory, Nanyang Technological University, Singapore.
Publisher Copyright:
IEEE
PY - 2024/4
Y1 - 2024/4
N2 - Images captured in the low-light condition suffer from low visibility and various imaging artifacts, e.g., real noise. Existing supervised algorithms for low-light image enhancement require a large set of pixel-aligned training image pairs, which are hard to prepare in practice. Though some recent unsupervised methods can alleviate such data challenges, many real world artifacts inevitably get falsely amplified in the enhanced results due to the lack of corresponding supervision. In this paper, instead of using perfectly aligned images for training, we creatively employ the misaligned real world images as the guidance, which are considerably easier to collect. Specifically, we propose a Cross-Image Disentanglement Network (CIDN) with weakly supervised learning, to separately extract cross-image brightness and image-specific content features from low/normal-light images. Based on that, CIDN can simultaneously correct the brightness and suppress image artifacts in the feature domain, which largely increases the robustness of the pixel shifts between training pairs. By considering real world corruptions, we propose a new training dataset with misaligned and noisy image pairs and its corresponding evaluation dataset. Experimental results show that our model achieves state-of-the-art performances on both the newly proposed dataset and other popular low-light datasets. The code implementation is publicly available at: https://github.com/GuoLanqing/CIDN.
AB - Images captured in the low-light condition suffer from low visibility and various imaging artifacts, e.g., real noise. Existing supervised algorithms for low-light image enhancement require a large set of pixel-aligned training image pairs, which are hard to prepare in practice. Though some recent unsupervised methods can alleviate such data challenges, many real world artifacts inevitably get falsely amplified in the enhanced results due to the lack of corresponding supervision. In this paper, instead of using perfectly aligned images for training, we creatively employ the misaligned real world images as the guidance, which are considerably easier to collect. Specifically, we propose a Cross-Image Disentanglement Network (CIDN) with weakly supervised learning, to separately extract cross-image brightness and image-specific content features from low/normal-light images. Based on that, CIDN can simultaneously correct the brightness and suppress image artifacts in the feature domain, which largely increases the robustness of the pixel shifts between training pairs. By considering real world corruptions, we propose a new training dataset with misaligned and noisy image pairs and its corresponding evaluation dataset. Experimental results show that our model achieves state-of-the-art performances on both the newly proposed dataset and other popular low-light datasets. The code implementation is publicly available at: https://github.com/GuoLanqing/CIDN.
KW - Disentanglement
KW - Image restoration
KW - Low-light enhancement
UR - http://www.scopus.com/inward/record.url?scp=85167807262&partnerID=8YFLogxK
U2 - 10.1109/tcsvt.2023.3303574
DO - 10.1109/tcsvt.2023.3303574
M3 - Journal article
SN - 1051-8215
VL - 34
SP - 2550
EP - 2563
JO - IEEE Transactions on Circuits and Systems for Video Technology
JF - IEEE Transactions on Circuits and Systems for Video Technology
IS - 4
ER -