TY - JOUR
T1 - Mutually Adaptable Learning
AU - Tan, Qi
AU - Liu, Yang
AU - Liu, Jiming
N1 - Funding Information:
This work was supported in part by the Ministry of Science and Technology of China under Grants 2021ZD0112501 and 2021ZD0112502, and in part by the General Research Fund from the Research Grant Council of Hong Kong SAR under Grants RGC/HKBU12201619, RGC/HKBU12202220, and RGC/HKBU12203122.
PY - 2024/2
Y1 - 2024/2
N2 - In real-world applications that involve complex data dependencies, it would be essential to proceed with machine learning tasks in an adaptable manner. This article presents a novel Mutually Adaptable Learning (MAL) approach that allows for, on the one hand, extracting the most crucial information from data, and on the other hand, maximally utilizing it through model learning, in a mutually adaptable manner. We elaborate our MAL approach by explaining how it determines the necessity for the adaptation of both features and the learning model, integratively adapts between feature selection and model learning, and optimally achieves the learning objective. To systematically validate the effectiveness of MAL, we conduct comprehensive experiments on challenging learning tasks from two representative domains: spatiotemporal prediction and chaotic behavioral prediction, where the complex data dependencies are general encountered. Results demonstrate that MAL outperforms existing learning methods. Moreover, we show that the formulated objective can be attained under an information-theoretic guarantee. With both empirical and theoretical supports, MAL offers an effective solution to the problem of feature and model adaptation to achieve desired learning objective for given complex tasks.
AB - In real-world applications that involve complex data dependencies, it would be essential to proceed with machine learning tasks in an adaptable manner. This article presents a novel Mutually Adaptable Learning (MAL) approach that allows for, on the one hand, extracting the most crucial information from data, and on the other hand, maximally utilizing it through model learning, in a mutually adaptable manner. We elaborate our MAL approach by explaining how it determines the necessity for the adaptation of both features and the learning model, integratively adapts between feature selection and model learning, and optimally achieves the learning objective. To systematically validate the effectiveness of MAL, we conduct comprehensive experiments on challenging learning tasks from two representative domains: spatiotemporal prediction and chaotic behavioral prediction, where the complex data dependencies are general encountered. Results demonstrate that MAL outperforms existing learning methods. Moreover, we show that the formulated objective can be attained under an information-theoretic guarantee. With both empirical and theoretical supports, MAL offers an effective solution to the problem of feature and model adaptation to achieve desired learning objective for given complex tasks.
KW - Complex data dependency
KW - Mutually Adaptable Learning (MAL)
KW - feature and model adaptation
KW - information-theoretic analysis
UR - http://www.scopus.com/inward/record.url?scp=85167830211&partnerID=8YFLogxK
U2 - 10.1109/TETCI.2023.3300183
DO - 10.1109/TETCI.2023.3300183
M3 - Journal article
SN - 2471-285X
VL - 8
SP - 240
EP - 254
JO - IEEE Transactions on Emerging Topics in Computational Intelligence
JF - IEEE Transactions on Emerging Topics in Computational Intelligence
IS - 1
ER -