TY - JOUR
T1 - Bayesian Meta-Learning
T2 - Toward Fast Adaptation in Neural Network Positioning Techniques
AU - Pu, Qiaolin
AU - Chen, Youkun
AU - Zhou, Mu
AU - Ng, Joseph Kee Yin
AU - Cai, Rui
N1 - This work was supported in part by the National Natural Science Foundation of China Youth Fund under Grant 62201110; in part by the Natural Science Foundation of Chongqing under Grant CSTB2023NSCQ-LZX0014, Grant CSTB2022NSCQ-MSX1385, and Grant CSTB2022NSCQ-MSX0895; in part by the Open Fund of Guangxi Key Laboratory of Precision Navigation Technology and Application under Grant DH202228; in part by the Youth Project of Science and Technology Research of Chongqing Municipal Education Commission under Grant KJQN202200648; in part by the Special Project of Chongqing Technology Innovation and Application Development under Grant 2112000599; and in part by the Chongqing Postgraduate Research Innovation Project under Grant CYS22468.
Publisher Copyright:
© 2014 IEEE.
PY - 2024/4/15
Y1 - 2024/4/15
N2 - Neural network positioning technology, as one of the mainstream in indoor Wi-Fi positioning systems, is playing an increasingly important role in location-based services. The main challenge is that the samples are prone to be outdated as the indoor environment changes or the wireless signal varies over time, i.e., the samples' Age of Information (AoI) is large, which leads to the trained model not being available. However, recollecting data to retrain the model is both time-consuming and labor-intensive. To address the above problem, this article proposes a fast adaptation approach based on Bayesian meta-learning that makes the pretrained model acquire a learned learning capability so that it can quickly learn new tasks based on the acquisition of existing knowledge. Specifically, first, a model-agnostic learning scheme is introduced to guide the learning process, which could automatically learn the optimal model parameters and hyperparameter settings. Second, to mitigate the effects of model uncertainty, especially to prevent the overfitting situation based on a limited number of samples, we combine the Stein variational gradient descent (SVGD) with the model-agnostic learning scheme, i.e., Bayesian meta-learning. Compared with traditional meta-learning algorithms, the proposed method makes the training more robust by inferring the Bayesian posterior from a probabilistic perspective. Extensive experimental results show that the proposed approach effectively overcomes the impact of large AoI on localization performance while decreasing labor consumption significantly.
AB - Neural network positioning technology, as one of the mainstream in indoor Wi-Fi positioning systems, is playing an increasingly important role in location-based services. The main challenge is that the samples are prone to be outdated as the indoor environment changes or the wireless signal varies over time, i.e., the samples' Age of Information (AoI) is large, which leads to the trained model not being available. However, recollecting data to retrain the model is both time-consuming and labor-intensive. To address the above problem, this article proposes a fast adaptation approach based on Bayesian meta-learning that makes the pretrained model acquire a learned learning capability so that it can quickly learn new tasks based on the acquisition of existing knowledge. Specifically, first, a model-agnostic learning scheme is introduced to guide the learning process, which could automatically learn the optimal model parameters and hyperparameter settings. Second, to mitigate the effects of model uncertainty, especially to prevent the overfitting situation based on a limited number of samples, we combine the Stein variational gradient descent (SVGD) with the model-agnostic learning scheme, i.e., Bayesian meta-learning. Compared with traditional meta-learning algorithms, the proposed method makes the training more robust by inferring the Bayesian posterior from a probabilistic perspective. Extensive experimental results show that the proposed approach effectively overcomes the impact of large AoI on localization performance while decreasing labor consumption significantly.
KW - Age of Information (AoI)
KW - environmental adaptation
KW - indoor localization
KW - model-agnostic learning scheme
KW - Stein variational gradient descent (SVGD)
UR - http://www.scopus.com/inward/record.url?scp=85181555151&partnerID=8YFLogxK
U2 - 10.1109/JIOT.2023.3345856
DO - 10.1109/JIOT.2023.3345856
M3 - Journal article
AN - SCOPUS:85181555151
SN - 2327-4662
VL - 11
SP - 14924
EP - 14937
JO - IEEE Internet of Things Journal
JF - IEEE Internet of Things Journal
IS - 8
ER -