DecBERT: Enhancing the Language Understanding of BERT with Causal Attention Masks

Ziyang Luo*, Yadong Xi, Jing Ma, Zhiwei Yang, Xiaoxi Mao, Changjie Fan, Rongsheng Zhang

*Corresponding author for this work

Research output: Chapter in book/report/conference proceedingConference proceeding

Fingerprint

Dive into the research topics of 'DecBERT: Enhancing the Language Understanding of BERT with Causal Attention Masks'. Together they form a unique fingerprint.

Engineering & Materials Science