Our everyday lives are filled with occlusions that we strive to see through. By aggregating desired background information from different viewpoints, we can easily eliminate such occlusions without any external occlusion-free supervision. Though several occlusion removal methods have been proposed to empower machine vision systems with such ability, their performances are still unsatisfactory due to reliance on external supervision. We propose a novel method, OCC-NeRF, for occlusion removal by adequately considering the benefits of multiple viewing angles, which directly builds a mapping between viewing angles and their corresponding scene details leveraging Neural Radiance Fields (NeRF). We also develop an effective scheme to jointly optimize camera parameters and scene reconstruction when occlusions are present. An additional depth constraint is applied to supervise the entire optimization without labeled external data for training. Our experimental results on existing and newly collected datasets validate the effectiveness of our method.
|Title of host publication||Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2023|
|Publication status||Published - Jun 2023|
|Event||IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2023 - Vancouver, Canada|
Duration: 18 Jun 2023 → 22 Jun 2023
|Conference||IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2023|
|Period||18/06/23 → 22/06/23|