TY - JOUR
T1 - A fast Markov chain based algorithm for MIML learning
AU - Ng, Michael K.
AU - Wu, Qingyao
AU - Shen, Chenyang
N1 - Funding Information:
Michael Ng's research is supported in part by Hong Kong Research Grant Council GRF Grant No. 12306616 and No. 12302715 Qingyao Wu's research is supported in part by the Guangzhou Key Laboratory of Robotics and Intelligent Software under Grant No. 15180007, the National Natural Science Foundation of China (NSFC) under Grant No. 61502177 and the Fundamental Research Funds for the Central Universities under Grant No. D215048w.
PY - 2016/12/5
Y1 - 2016/12/5
N2 - Multi-instance multi-label (MIML) learning is one of challenging research problems in machine learning. In the literature, there are several methods for solving MIML problems. However, they may take a long computational time and have a huge storage cost for large MIML data sets. The main aim of this paper is to propose and develop an efficient Markov Chain learning algorithm for MIML problems, especially for data represented by non-negative features. Our idea is to perform labels classification iteratively through two Markov chains constructed by using objects and features respectively. The classification of objects can be obtained by using labels propagation via training data in the iterative method. Moreover, we demonstrate that the proposed method can be formulated by considering normalized linear kernel. Because linear kernel function is explicit and separable, it is not necessary to compute and store a huge affinity matrix among objects/instances compared with the use of other kernel functions. Therefore, both the storage and computational time of the proposed algorithm are very efficient. Experimental results are presented to show that the classification performance of the proposed method using normalized linear kernel function is about the same as those using the other kernel functions, while the required computational time is much less, which together suggest that the linear kernel can be good enough for MIML problem. Also experimental results on some benchmark data sets are reported to illustrate the effectiveness of the proposed method in one-error, ranking loss, coverage and average precision, and show that it is competitive with the other MIML methods.
AB - Multi-instance multi-label (MIML) learning is one of challenging research problems in machine learning. In the literature, there are several methods for solving MIML problems. However, they may take a long computational time and have a huge storage cost for large MIML data sets. The main aim of this paper is to propose and develop an efficient Markov Chain learning algorithm for MIML problems, especially for data represented by non-negative features. Our idea is to perform labels classification iteratively through two Markov chains constructed by using objects and features respectively. The classification of objects can be obtained by using labels propagation via training data in the iterative method. Moreover, we demonstrate that the proposed method can be formulated by considering normalized linear kernel. Because linear kernel function is explicit and separable, it is not necessary to compute and store a huge affinity matrix among objects/instances compared with the use of other kernel functions. Therefore, both the storage and computational time of the proposed algorithm are very efficient. Experimental results are presented to show that the classification performance of the proposed method using normalized linear kernel function is about the same as those using the other kernel functions, while the required computational time is much less, which together suggest that the linear kernel can be good enough for MIML problem. Also experimental results on some benchmark data sets are reported to illustrate the effectiveness of the proposed method in one-error, ranking loss, coverage and average precision, and show that it is competitive with the other MIML methods.
KW - Iterative Method
KW - Labels Propagation
KW - Markov Chains
KW - Multi-Instance Multi-Label Learning
UR - http://www.scopus.com/inward/record.url?scp=84994138747&partnerID=8YFLogxK
U2 - 10.1016/j.neucom.2016.08.033
DO - 10.1016/j.neucom.2016.08.033
M3 - Journal article
AN - SCOPUS:84994138747
SN - 0925-2312
VL - 216
SP - 763
EP - 777
JO - Neurocomputing
JF - Neurocomputing
ER -