Deep inverse reinforcement learning for sepsis treatment

Chao Yu, Guoqi Ren, Jiming LIU

Research output: Chapter in book/report/conference proceedingConference contributionpeer-review

3 Citations (Scopus)

Abstract

Sepsis is a leading cause of mortality in hospitals, but its optimal treatment strategy still remains unclear. Recent years have witnessed several successful applications of Reinforcement Learning (RL) approaches in sepsis treatment, achieving far more efficient strategies than those by clinicians. To ensure such applications, an explicit reward function encoding medical domain knowledge should be specified beforehand to indicate the goal of learning. However, due to the paucity of clear understanding of sepsis itself, there is still considerable inconsistency in the formulation of reward functions for sepsis treatment. In this poster, we address the reward learning problem in RL for treatment of sepsis, which has been largely neglected by previous studies. A deep inverse RL with Mini-Tree (DIRL-MT) model is proposed to infer the best reward functions from a set of presumably optimal treatment trajectories using retrospective real medical data. In the model, the MT component learns the factors that are most important in influencing the mortality during sepsis treatment, while the DIRL component infers the complete reward function in terms of weights of those factors. Our work shows that PaO2 and PT can play a vital role and should be paid more attention in the design of more efficient treatment strategies for sepsis in the future.

Original languageEnglish
Title of host publication2019 IEEE International Conference on Healthcare Informatics, ICHI 2019
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781538691380
DOIs
Publication statusPublished - Jun 2019
Event7th IEEE International Conference on Healthcare Informatics, ICHI 2019 - Xi'an, China
Duration: 10 Jun 201913 Jun 2019

Publication series

Name2019 IEEE International Conference on Healthcare Informatics, ICHI 2019

Conference

Conference7th IEEE International Conference on Healthcare Informatics, ICHI 2019
Country/TerritoryChina
CityXi'an
Period10/06/1913/06/19

Scopus Subject Areas

  • Artificial Intelligence
  • Computer Science Applications
  • Health Informatics
  • Biomedical Engineering

User-Defined Keywords

  • Deep Learning
  • Intravenous
  • Inverse Learning
  • Reinforcement Learning
  • Sepsis
  • Vasopressor

Fingerprint

Dive into the research topics of 'Deep inverse reinforcement learning for sepsis treatment'. Together they form a unique fingerprint.

Cite this