Breast Cancer Classification from Digital Pathology Images via Connectivity-aware Graph Transformer

Kang Wang, Feiyang Zheng, Lan Cheng, Hong-Ning Dai, Qi Dou, Jing Qin

Research output: Contribution to journalJournal articlepeer-review

Abstract

Automated classification of breast cancer subtypes from digital pathology images has been an extremely challenging task due to the complicated spatial patterns of cells in the tissue micro-environment. While newly proposed graph transformers are able to capture more long-range dependencies to enhance accuracy, they largely ignore the topological connectivity between graph nodes, which is nevertheless critical to extract more representative features to address this difficult task. In this paper, we propose a novel connectivity-aware graph transformer (CGT) for phenotyping the topology connectivity of the tissue graph constructed from digital pathology images for breast cancer classification. Our CGT seamlessly integrates connectivity embedding to node feature at every graph transformer layer by using local connectivity aggregation, in order to yield more comprehensive graph representations to distinguish different breast cancer subtypes. In light of the realistic intercellular communication mode, we then encode the spatial distance between two arbitrary nodes as connectivity bias in self-attention calculation, thereby allowing the CGT to distinctively harness the connectivity embedding based on the distance of two nodes. We extensively evaluate the proposed CGT on a large cohort of breast carcinoma digital pathology images stained by Haematoxylin & Eosin. Experimental results demonstrate the effectiveness of our CGT, which outperforms state-of-the-art methods by a large margin. Codes are released on https://github.com/wang-kang-6/CGT.
Original languageEnglish
Number of pages13
JournalIEEE Transactions on Medical Imaging
DOIs
Publication statusE-pub ahead of print - 25 Mar 2024

Scopus Subject Areas

  • Software
  • Radiological and Ultrasound Technology
  • Electrical and Electronic Engineering
  • Computer Science Applications

User-Defined Keywords

  • Tissue connectivity
  • Tissue topology phenotyping
  • Graph Transformer
  • Cancer classification
  • Entity graph

Fingerprint

Dive into the research topics of 'Breast Cancer Classification from Digital Pathology Images via Connectivity-aware Graph Transformer'. Together they form a unique fingerprint.

Cite this