Super-Resolution Enhanced Medical Image Diagnosis with Sample Affinity Interaction

Zhen Chen, Xiaoqing Guo, Peter Y.M. Woo, Yixuan Yuan*

*Corresponding author for this work

Research output: Contribution to journalJournal articlepeer-review

64 Citations (Scopus)

Abstract

The degradation in image resolution harms the performance of medical image diagnosis. By inferring high-frequency details from low-resolution (LR) images, super-resolution (SR) techniques can introduce additional knowledge and assist high-level tasks. In this paper, we propose a SR enhanced diagnosis framework, consisting of an efficient SR network and a diagnosis network. Specifically, a Multi-scale Refined Context Network (MRC-Net) with Refined Context Fusion (RCF) is devised to leverage global and local features for SR tasks. Instead of learning from scratch, we first develop a recursive MRC-Net with temporal context, and then propose a recursion distillation scheme to enhance the performance of MRC-Net from the knowledge of the recursive one and reduce the computational cost. The diagnosis network jointly utilizes the reliable original images and more informative SR images by two branches, with the proposed Sample Affinity Interaction (SAI) blocks at different stages to effectively extract and integrate discriminative features towards diagnosis. Moreover, two novel constraints, sample affinity consistency and sample affinity regularization, are devised to refine the features and achieve the mutual promotion of these two branches. Extensive experiments of synthetic and real LR cases are conducted on wireless capsule endoscopy and histopathology images, verifying that our proposed method is significantly effective for medical image diagnosis.

Original languageEnglish
Article number9339901
Pages (from-to)1377-1389
Number of pages13
JournalIEEE Transactions on Medical Imaging
Volume40
Issue number5
Early online date28 Jan 2021
DOIs
Publication statusPublished - May 2021

Scopus Subject Areas

  • Software
  • Radiological and Ultrasound Technology
  • Computer Science Applications
  • Electrical and Electronic Engineering

User-Defined Keywords

  • Medical image diagnosis
  • semantic consistency
  • super resolution

Fingerprint

Dive into the research topics of 'Super-Resolution Enhanced Medical Image Diagnosis with Sample Affinity Interaction'. Together they form a unique fingerprint.

Cite this