Skip to main navigation Skip to search Skip to main content

Enhancing Lesion Segmentation via Medical Image-Mask Pair Synthesis using Phenotype-Conditioned Diffusion Models

  • Fei Lyu
  • , Jingwen Xu
  • , Ye Zhu
  • , Grace Lai Hung Wong
  • , Pong C. Yuen*
  • *Corresponding author for this work

Research output: Contribution to journalJournal articlepeer-review

Abstract

Accurate lesion segmentation in medical images is critical for early diagnosis and treatment planning, yet it remains challenging because training robust lesion segmentation models suffers from the data scarcity and sample imbalance issues. Synthetic data augmentation is a promising approach to address these challenges, but existing methods may struggle to produce high-quality lesion-containing samples. In this paper, we present Le sionLab, a novel framework for medical image-mask pair synthesis which augments the existing training dataset to a more balanced and diverse one. Specifically, we first design a phenotype-guided text prompt that captures complex lesion characteristics by clustering radiomic features into distinct phenotypes, improving the controllability of synthetic data generation to achieve more precise trans formation from lesion-free to lesion-containing samples. Additionally, we introduce a dual-check quality control mechanism that integrates priors of foundation models to compute quality and hardness scores, effectively filtering low-quality samples while prioritizing challenging cases for model training. Extensive experiments on three public datasets demonstrate that our proposed Lesion Lab is superior to existing synthetic data augmentation methods for lesion segmentation.

Original languageEnglish
Pages (from-to)1-13
Number of pages13
JournalIEEE Journal of Biomedical and Health Informatics
DOIs
Publication statusE-pub ahead of print - 19 May 2026

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

  1. SDG 3 - Good Health and Well-being
    SDG 3 Good Health and Well-being

User-Defined Keywords

  • Lesion segmentation
  • prompt engineering
  • quality control
  • synthetic data augmentation

Fingerprint

Dive into the research topics of 'Enhancing Lesion Segmentation via Medical Image-Mask Pair Synthesis using Phenotype-Conditioned Diffusion Models'. Together they form a unique fingerprint.

Cite this