A generalized image quality improvement strategy of cone-beam CT using multiple spectral CT labels in Pix2pix GAN

Yangkang Jiang, Yibao Zhang, Chen Luo, Pengfei Yang, Jing Wang, Xiaokun Liang, Wei Zhao, Rencang Li, Tianye Niu*

*Corresponding author for this work

Research output: Contribution to journalJournal articlepeer-review

5 Citations (Scopus)


Objective: The quantitative and routine imaging capabilities of cone-beam CT (CBCT) are hindered from clinical applications due to the severe shading artifacts of scatter contamination. The scatter correction methods proposed in the literature only consider the anatomy of the scanned objects while disregarding the impact of incident X-ray energy spectra. The multiple-spectral model is in urgent need for CBCT scatter estimation. 

Approach: In this work, we incorporate the multiple spectral diagnostic multidetector CT labels into the pixel-to-pixel (Pix2pix) GAN to estimate accurate scatter distributions from CBCT projections acquired at various imaging volume sizes and X-ray energy spectra. The Pix2pix GAN combines the residual network as the generator and the PatchGAN as the discriminator to construct the correspondence between the scatter-contaminated projection and scatter distribution. The network architectures and loss function of Pix2pix GAN are optimized to achieve the best performance on projection-to-scatter transition. 

Results: The CBCT data of a head phantom and abdominal patients are applied to test the performance of the proposed method. The error of the corrected CBCT image using the proposed method is reduced from over 200 HU to be around 20 HU in both phantom and patient studies. The mean structural similarity index of the CT image is improved from 0.2 to around 0.9 after scatter correction using the proposed method compared with the MC-simulation method, which indicates a high similarity of the anatomy in the images before and after the proposed correction. The proposed method achieves higher accuracy of scatter estimation than using the Pix2pix GAN with the U-net generator. 

Significance: The proposed scheme is an effective solution to the multiple spectral CBCT scatter correction. The scatter-correction software using the proposed model will be available at: Https://github.com/YangkangJiang/Cone-beam-CT-scatter-correction-tool.

Original languageEnglish
Article number115003
JournalPhysics in Medicine and Biology
Issue number11
Publication statusPublished - 7 Jun 2022

Scopus Subject Areas

  • Radiological and Ultrasound Technology
  • Radiology Nuclear Medicine and imaging

User-Defined Keywords

  • deep learning
  • multiple spectral cone-beam CT
  • Pix2pix GAN
  • scatter correction


Dive into the research topics of 'A generalized image quality improvement strategy of cone-beam CT using multiple spectral CT labels in Pix2pix GAN'. Together they form a unique fingerprint.

Cite this