TY - JOUR
T1 - Few-Shot Learning With Dynamic Graph Structure Preserving
AU - Fu, Sichao
AU - Cao, Qiong
AU - Lei, Yunwen
AU - Zhong, Yujie
AU - Zhan, Yibing
AU - You, Xinge
N1 - This work was supported in part by the National Key Research and Development Program of China under Grant 2022YFF0712300, in part by the National Natural Science Foundation of China under Grant 62172177, in part by the Fundamental Research Funds for the Central Universities (HUST) under Grant 2022JY-CXJJ034, and in part by the Open Research Fund from Shandong Provincial Key Laboratory of Computer Network under Grant SKLCN-2021-02. Paper no. TII-22-2407.
Publisher Copyright:
© 2005-2012 IEEE.
PY - 2024/3
Y1 - 2024/3
N2 - In recent years, few-shot learning has received increasing attention in the Internet of Things areas. Few-shot learning aims to distinguish unseen classes with a few labeled samples from each class. Most recently transductive few-shot studies highly rely on the static geometry distributions generated on the feature space during the label propagation process between unseen class instances. However, these recent methods fail to guarantee that the generated graph structure preserves the true distributions between data properly. In this article, we propose a novel dynamic graph structure preserving (DGSP) model for few-shot learning. Specifically, we formulate the objective function of DGSP by simultaneously considering the data correlations from the feature space and the label space to update the generated graph structure, which can reasonably revise the inappropriate or mistaken local geometry relationships. Then, we design an efficient alternating optimization algorithm to jointly learn the label prediction matrix and the optimal graph structure, the latter of which can be formulated as a linear programming problem. Moreover, our proposed DGSP can be easily combined with any backbone networks during the learning process. We conduct extensive experimental results across different benchmarks, backbones, and task settings, and our method achieves state-of-the-art performance compared with methods based on transductive few-shot learning.
AB - In recent years, few-shot learning has received increasing attention in the Internet of Things areas. Few-shot learning aims to distinguish unseen classes with a few labeled samples from each class. Most recently transductive few-shot studies highly rely on the static geometry distributions generated on the feature space during the label propagation process between unseen class instances. However, these recent methods fail to guarantee that the generated graph structure preserves the true distributions between data properly. In this article, we propose a novel dynamic graph structure preserving (DGSP) model for few-shot learning. Specifically, we formulate the objective function of DGSP by simultaneously considering the data correlations from the feature space and the label space to update the generated graph structure, which can reasonably revise the inappropriate or mistaken local geometry relationships. Then, we design an efficient alternating optimization algorithm to jointly learn the label prediction matrix and the optimal graph structure, the latter of which can be formulated as a linear programming problem. Moreover, our proposed DGSP can be easily combined with any backbone networks during the learning process. We conduct extensive experimental results across different benchmarks, backbones, and task settings, and our method achieves state-of-the-art performance compared with methods based on transductive few-shot learning.
KW - Feature space
KW - few-shot learning
KW - graph structure
KW - label space
KW - transductive learning
UR - http://www.scopus.com/inward/record.url?scp=85169676394&partnerID=8YFLogxK
U2 - 10.1109/TII.2023.3306929
DO - 10.1109/TII.2023.3306929
M3 - Journal article
AN - SCOPUS:85169676394
SN - 1551-3203
VL - 20
SP - 3306
EP - 3315
JO - IEEE Transactions on Industrial Informatics
JF - IEEE Transactions on Industrial Informatics
IS - 3
ER -