A decision support system in precision medicine: Contrastive multimodal learning for patient stratification

Qing Yin, Linda Zhong, Yunya Song, Liang Bai, Zhihua Wang, Li Chen, Yida Xu, Xian Yang*

*Corresponding author for this work

Research output: Contribution to journalJournal articlepeer-review


Precision medicine aims to provide personalized healthcare for patients by stratifying them into subgroups based on their health conditions, enabling the development of tailored medical management. Various decision support systems (DSSs) are increasingly developed in this field, where the performance is limited to their capability of handling big amounts of heterogeneous and high-dimensional electronic health records (EHRs). In this paper, we focus on developing a deep learning model for patient stratification that can identify and explain patient subgroups from multimodal EHRs. The primary challenge is to effectively align and unify heterogeneous information from various modalities, which includes both unstructured and structured data. Here, we develop a Contrastive Multimodal learning model for EHR (ConMEHR) based on topic modelling. In ConMEHR, modality-level and topic-level contrastive learning (CL) mechanisms are adopted to obtain a unified representation space and diversify patient subgroups, respectively. The performance of ConMEHR will be evaluated on two real-world EHR datasets and the results show that our model outperforms other baseline methods.
Original languageEnglish
Number of pages29
JournalAnnals of Operations Research
Publication statusE-pub ahead of print - 29 Aug 2023

Scopus Subject Areas

  • Decision Sciences(all)
  • Management Science and Operations Research

User-Defined Keywords

  • Application of EHRs in precision medicine
  • Deep learning model for patient stratification
  • Modelling unstructured and structured patient data
  • Multimodal contrastive learning


Dive into the research topics of 'A decision support system in precision medicine: Contrastive multimodal learning for patient stratification'. Together they form a unique fingerprint.

Cite this