TY - JOUR
T1 - A Physics-guided Attention-based Neural Network for Sea Surface Temperature Prediction
AU - Shi, Benyun
AU - Feng, Liu
AU - He, Hailun
AU - Hao, Yingjian
AU - Peng, Yue
AU - Liu, Miao
AU - Liu, Yang
AU - Liu, Jiming
N1 - This work was supported in part by the National Natural Science Foundation of China and the Research Grants Council (RGC) of Hong Kong Joint Research Scheme (No. 62261160387, N HKBU222/22), in part by the Postgraduate Research & Practice Innovation Program of Jiangsu Province (Grant no. SJCX23 0435).
PY - 2024/9/10
Y1 - 2024/9/10
N2 - Accurate prediction of sea surface temperature (SST) is crucial in the
field of oceanography, as it has a significant impact on various
physical, chemical, and biological processes in the marine environment.
In this study, we propose a physics-guided attention-based neural
network (PANN) to address the spatiotemporal SST prediction problem. The
PANN model incorporates data-driven spatiotemporal convolution
operations and the underlying physical dynamics of SSTs using a
cross-attention mechanism. First, we construct a spatiotemporal
convolution module (SCM) using convolutional long short-term memory
(ConvLSTM) to capture the spatial and temporal correlations present in
the time series of the SST data. We then introduce a physical constraint
module (PCM) to mimic the transport dynamics in fluids based on data
assimilation techniques used to solve partial differential equations
(PDEs). Consequently, we employ an attention fusion module (AFM) to
effectively combine the data-driven and PDE-constrained predictions
obtained from the SCM and PCM, aiming at enhancing the accuracy of the
predictions. To evaluate the performance of the proposed model, we
conduct short-term SST forecasts in the East China Sea (ECS) with
forecast lead times ranging from one to ten days, by comparing it with
several state-of-the-art models, including ConvLSTM, PredRNN, temporal
convolutional transformer network (TCTN), convolutional gated recurrent
unit (ConvGRU), and SwinLSTM. The experimental results demonstrate that
our proposed model outperforms these models in terms of multiple
evaluation metrics for short-term predictions.
AB - Accurate prediction of sea surface temperature (SST) is crucial in the
field of oceanography, as it has a significant impact on various
physical, chemical, and biological processes in the marine environment.
In this study, we propose a physics-guided attention-based neural
network (PANN) to address the spatiotemporal SST prediction problem. The
PANN model incorporates data-driven spatiotemporal convolution
operations and the underlying physical dynamics of SSTs using a
cross-attention mechanism. First, we construct a spatiotemporal
convolution module (SCM) using convolutional long short-term memory
(ConvLSTM) to capture the spatial and temporal correlations present in
the time series of the SST data. We then introduce a physical constraint
module (PCM) to mimic the transport dynamics in fluids based on data
assimilation techniques used to solve partial differential equations
(PDEs). Consequently, we employ an attention fusion module (AFM) to
effectively combine the data-driven and PDE-constrained predictions
obtained from the SCM and PCM, aiming at enhancing the accuracy of the
predictions. To evaluate the performance of the proposed model, we
conduct short-term SST forecasts in the East China Sea (ECS) with
forecast lead times ranging from one to ten days, by comparing it with
several state-of-the-art models, including ConvLSTM, PredRNN, temporal
convolutional transformer network (TCTN), convolutional gated recurrent
unit (ConvGRU), and SwinLSTM. The experimental results demonstrate that
our proposed model outperforms these models in terms of multiple
evaluation metrics for short-term predictions.
KW - Cross-attention mechanism
KW - Physics-guided neural networks
KW - Sea surface temperature
KW - Spatiotemporal predictive learning
KW - Convolutional long short-term memory (ConvLSTM)
UR - http://www.scopus.com/inward/record.url?scp=85204006517&partnerID=8YFLogxK
U2 - 10.1109/TGRS.2024.3457039
DO - 10.1109/TGRS.2024.3457039
M3 - Journal article
AN - SCOPUS:85204006517
SN - 0196-2892
VL - 62
JO - IEEE Transactions on Geoscience and Remote Sensing
JF - IEEE Transactions on Geoscience and Remote Sensing
M1 - 4210413
ER -