TY - JOUR
T1 - Fine Perceptive GANs for Brain MR Image Super-Resolution in Wavelet Domain
AU - You, Senrong
AU - Lei, Baiying
AU - Wang, Shuqiang
AU - Chui, Charles K.
AU - Cheung, Albert C.
AU - Liu, Yong
AU - Gan, Min
AU - Wu, Guocheng
AU - Shen, Yanyan
N1 - Funding Information:
This work was supported in part by the Strategic Priority Research Program of Chinese Academy of Sciences under Grant XDB38040200, in part by the National Natural Science Foundations of China under Grant 62172403 and Grant 61872351, in part by the International Science and Technology Cooperation Projects of Guangdong under Grant 2019A050510030, in part by the Distinguished Young Scholars Fund of Guangdong under Grant 2021B1515020019, in part by the Excel- lent Young Scholars of Shenzhen under Grant RCYX20200714114641211, and in part by the Shenzhen Key Basic Research Projects under Grant JCYJ20200109115641762.
Publisher Copyright:
© 2012 IEEE.
PY - 2023/11/1
Y1 - 2023/11/1
N2 - Magnetic resonance (MR) imaging plays an important role in clinical and brain exploration. However, limited by factors such as imaging hardware, scanning time, and cost, it is challenging to acquire high-resolution MR images clinically. In this article, fine perceptive generative adversarial networks (FP-GANs) are proposed to produce super-resolution (SR) MR images from the low-resolution counterparts. By adopting the divide-and-conquer scheme, FP-GANs are designed to deal with the low-frequency (LF) and high-frequency (HF) components of MR images separately and parallelly. Specifically, FP-GANs first decompose an MR image into LF global approximation and HF anatomical texture subbands in the wavelet domain. Then, each subband generative adversarial network (GAN) simultaneously concentrates on super-resolving the corresponding subband image. In generator, multiple residual-in-residual dense blocks are introduced for better feature extraction. In addition, the texture-enhancing module is designed to trade off the weight between global topology and detailed textures. Finally, the reconstruction of the whole image is considered by integrating inverse discrete wavelet transformation in FP-GANs. Comprehensive experiments on the MultiRes_7T and ADNI datasets demonstrate that the proposed model achieves finer structure recovery and outperforms the competing methods quantitatively and qualitatively. Moreover, FP-GANs further show the value by applying the SR results in classification tasks.
AB - Magnetic resonance (MR) imaging plays an important role in clinical and brain exploration. However, limited by factors such as imaging hardware, scanning time, and cost, it is challenging to acquire high-resolution MR images clinically. In this article, fine perceptive generative adversarial networks (FP-GANs) are proposed to produce super-resolution (SR) MR images from the low-resolution counterparts. By adopting the divide-and-conquer scheme, FP-GANs are designed to deal with the low-frequency (LF) and high-frequency (HF) components of MR images separately and parallelly. Specifically, FP-GANs first decompose an MR image into LF global approximation and HF anatomical texture subbands in the wavelet domain. Then, each subband generative adversarial network (GAN) simultaneously concentrates on super-resolving the corresponding subband image. In generator, multiple residual-in-residual dense blocks are introduced for better feature extraction. In addition, the texture-enhancing module is designed to trade off the weight between global topology and detailed textures. Finally, the reconstruction of the whole image is considered by integrating inverse discrete wavelet transformation in FP-GANs. Comprehensive experiments on the MultiRes_7T and ADNI datasets demonstrate that the proposed model achieves finer structure recovery and outperforms the competing methods quantitatively and qualitatively. Moreover, FP-GANs further show the value by applying the SR results in classification tasks.
KW - Discrete wavelet transformation
KW - generative adversarial network (GAN)
KW - magnetic resonance (MR) imaging
KW - super-resolution (SR)
KW - textures enhance
UR - http://www.scopus.com/inward/record.url?scp=85126291613&partnerID=8YFLogxK
U2 - 10.48550/arXiv.2011.04145
DO - 10.48550/arXiv.2011.04145
M3 - Journal article
C2 - 35254996
AN - SCOPUS:85126291613
SN - 2162-237X
VL - 34
SP - 8802
EP - 8814
JO - IEEE Transactions on Neural Networks and Learning Systems
JF - IEEE Transactions on Neural Networks and Learning Systems
IS - 11
ER -