Complex Manga Coloring Method Based on Improved Pix2Pix Model

Renjie Gao*, Leiping Jie, U. Kin Tak

*Corresponding author for this work

Research output: Chapter in book/report/conference proceedingConference proceedingpeer-review

1 Citation (Scopus)

Abstract

In recent years, in the field of machine learning and computer vision, convolutional neural network (CNN) and conditional generative adversarial network (cGAN) have been widely used to generate realistic images, which can be used for coloring black and white comics, illustrations and line drafts. In this paper, we try to improve the pix2pix model based on the conditional GAN by using the multi-channel feature extraction to preserve the edge and grayscale information of complex images as much as possible. The proposed model uses multi-channel downsampling and fusion overlay technology to train and process complex illustrations, focusing on learning the color and contour lines of the picture respectively, to color complex black and white illustrations. For experimental needs, we prepared a training set with very different styles and complex pictures that we manually screened to broadens the range of applicable works. It can be seen from the results that this method retains the details of the original illustration, and performs color-changing processing on this basis, which has a good subjective evaluation and visual effect.

Original languageEnglish
Title of host publicationProceedings of 2023 International Conference on Machine Learning and Cybernetics, ICMLC 2023
Place of PublicationAdelaide
PublisherIEEE
Pages582-587
Number of pages6
ISBN (Electronic)9798350303780
ISBN (Print)9798350303797
DOIs
Publication statusPublished - 9 Jul 2023
Event2023 International Conference on Machine Learning and Cybernetics, ICMLC 2023 - Adelaide, Australia
Duration: 9 Jul 202311 Jul 2023
https://ieeexplore.ieee.org/xpl/conhome/10327787/proceeding (Conference proceedings)
https://www.icmlc.org/2023.html (Conference website)

Publication series

NameProceedings - International Conference on Machine Learning and Cybernetics
PublisherIEEE
ISSN (Print)2160-133X
ISSN (Electronic)2160-1348

Conference

Conference2023 International Conference on Machine Learning and Cybernetics, ICMLC 2023
Country/TerritoryAustralia
CityAdelaide
Period9/07/2311/07/23
Internet address

Scopus Subject Areas

  • Artificial Intelligence
  • Computational Theory and Mathematics
  • Computer Networks and Communications
  • Human-Computer Interaction

User-Defined Keywords

  • Anime Illustration
  • Automatic Colorization
  • CGAN
  • CNN
  • Pix2pix

Fingerprint

Dive into the research topics of 'Complex Manga Coloring Method Based on Improved Pix2Pix Model'. Together they form a unique fingerprint.

Cite this