TY - GEN
T1 - Memory-aligned Knowledge Graph for Clinically Accurate Radiology Image Report Generation
AU - Yan, Sixing
N1 - Publisher Copyright:
© 2022 Association for Computational Linguistics.
PY - 2022/5
Y1 - 2022/5
N2 - Automatic generating the clinically accurate radiology report from X-ray images is important but challenging. The identification of multi-grained abnormal regions in image and corresponding abnormalities is difficult for data-driven neural models. In this work, we introduce a Memory-aligned Knowledge Graph (MaKG) of clinical abnormalities to better learn the visual patterns of abnormalities and their relationships by integrating it into a deep model architecture for the report generation. We carry out extensive experiments and show that the proposed MaKG deep model can improve the clinical accuracy of the generated reports.
AB - Automatic generating the clinically accurate radiology report from X-ray images is important but challenging. The identification of multi-grained abnormal regions in image and corresponding abnormalities is difficult for data-driven neural models. In this work, we introduce a Memory-aligned Knowledge Graph (MaKG) of clinical abnormalities to better learn the visual patterns of abnormalities and their relationships by integrating it into a deep model architecture for the report generation. We carry out extensive experiments and show that the proposed MaKG deep model can improve the clinical accuracy of the generated reports.
UR - http://www.scopus.com/inward/record.url?scp=85143263380&partnerID=8YFLogxK
U2 - 10.18653/v1/2022.bionlp-1.11
DO - 10.18653/v1/2022.bionlp-1.11
M3 - Conference proceeding
AN - SCOPUS:85143263380
T3 - Proceedings of the Workshop on Biomedical Language Processing
SP - 116
EP - 122
BT - BioNLP 2022 @ ACL 2022 - Proceedings of the 21st Workshop on Biomedical Language Processing
A2 - Demner-Fushman, Dina
A2 - Cohen, Kevin Bretonnel
A2 - Ananiadou, Sophia
A2 - Tsujii, Junichi
PB - Association for Computational Linguistics (ACL)
T2 - 21st Workshop on Biomedical Language Processing, BioNLP 2022 at the Association for Computational Linguistics Conference, ACL 2022
Y2 - 26 May 2022
ER -
