TY - JOUR
T1 - Elastica Models for Color Image Regularization
AU - Liu, Hao
AU - Tai, Xue-Cheng
AU - Kimmel, Ron
AU - Glowinski, Roland
N1 - Funding Information:
The work of the first author is partially supported by HKBU 179356 and 162784, and NSFC 12201530. The work of the second author is partially supported by NSFC/RGC grant N-HKBU214-19 and RC-FNRA-IG/19-20/SCI/01. The work of the third author is partially supported by the Intelligent Robotics and Autonomous Systems Mega project of the D. Dan and Betty Kahn Michigan-Israel Partnership for Research and Education, run by the Technion Autonomous Systems and Robotics Program.
Publisher Copyright:
© 2023 Society for Industrial and Applied Mathematics
PY - 2023/3
Y1 - 2023/3
N2 - The choice of a proper regularization measure plays an important role in the field of image processing. One classical approach treats color images as two- dimensional surfaces embedded in a five-dimensional spatial-chromatic space. In this case, a natural regularization term arises as the image surface area. Choosing the chromatic coordinates as dominating over the spatial ones, we can think of the image spatial coordinates could as a parameterization of the image surface manifold in a three-dimensional color space. Minimizing the area of the image manifold leads to the Beltrami flow or mean curvature flow of the image surface in the three-dimensional color space, while minimizing the elastica of the image surface yields an additional interesting regularization. Recently, we proposed a color elastica model, which minimizes both the surface area and the elastica of the image manifold. In this paper, we propose to modify the color elastica and introduce two new models for color image regularization. The revised measures are motivated by the relations between the color elastica model, Euler’s elastica model, and the total variation model for gray level images. Compared to our previous color elastica model, the new models are direct extensions of Euler’s elastica model to color images. The proposed models are nonlinear and challenging to minimize. To overcome this difficulty, two operator-splitting methods are suggested. Specifically, nonlinearities are decoupled by the introduction of new vector- and matrix-valued variables. Then, the minimization problems are converted to initial value problems which are time-discretized by operator splitting. Each subproblem, after splitting, either has a closed-form solution or can be solved efficiently. The effectiveness and advantages of the proposed models are demonstrated by comprehensive experiments. The benefits of incorporating the elastica of the image surface as regularization terms compared to common alternatives are empirically validated.
AB - The choice of a proper regularization measure plays an important role in the field of image processing. One classical approach treats color images as two- dimensional surfaces embedded in a five-dimensional spatial-chromatic space. In this case, a natural regularization term arises as the image surface area. Choosing the chromatic coordinates as dominating over the spatial ones, we can think of the image spatial coordinates could as a parameterization of the image surface manifold in a three-dimensional color space. Minimizing the area of the image manifold leads to the Beltrami flow or mean curvature flow of the image surface in the three-dimensional color space, while minimizing the elastica of the image surface yields an additional interesting regularization. Recently, we proposed a color elastica model, which minimizes both the surface area and the elastica of the image manifold. In this paper, we propose to modify the color elastica and introduce two new models for color image regularization. The revised measures are motivated by the relations between the color elastica model, Euler’s elastica model, and the total variation model for gray level images. Compared to our previous color elastica model, the new models are direct extensions of Euler’s elastica model to color images. The proposed models are nonlinear and challenging to minimize. To overcome this difficulty, two operator-splitting methods are suggested. Specifically, nonlinearities are decoupled by the introduction of new vector- and matrix-valued variables. Then, the minimization problems are converted to initial value problems which are time-discretized by operator splitting. Each subproblem, after splitting, either has a closed-form solution or can be solved efficiently. The effectiveness and advantages of the proposed models are demonstrated by comprehensive experiments. The benefits of incorporating the elastica of the image surface as regularization terms compared to common alternatives are empirically validated.
KW - Euler's elastica
KW - Laplace-Beltrami
KW - Polyakov action
KW - color image regularization
KW - operator splitting
UR - http://www.scopus.com/inward/record.url?scp=85166372718&partnerID=8YFLogxK
U2 - 10.1137/22M147935X
DO - 10.1137/22M147935X
M3 - Journal article
SN - 1936-4954
VL - 16
SP - 461
EP - 500
JO - SIAM Journal on Imaging Sciences
JF - SIAM Journal on Imaging Sciences
IS - 1
ER -