Learning Transferred Weights from Co-Occurrence Data for Heterogeneous Transfer Learning

Liu Yang, Liping Jing*, Jian Yu, Kwok Po NG

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

35 Citations (Scopus)

Abstract

One of the main research problems in heterogeneous transfer learning is to determine whether a given source domain is effective in transferring knowledge to a target domain, and then to determine how much of the knowledge should be transferred from a source domain to a target domain. The main objective of this paper is to solve this problem by evaluating the relatedness among given domains through transferred weights. We propose a novel method to learn such transferred weights with the aid of co-occurrence data, which contain the same set of instances but in different feature spaces. Because instances with the same category should have similar features, our method is to compute their principal components in each feature space such that co-occurrence data can be rerepresented by these principal components. The principal component coefficients from different feature spaces for the same instance in the co-occurrence data have the same order of significance for describing the category information. By using these principal component coefficients, the Markov Chain Monte Carlo method is employed to construct a directed cyclic network where each node is a domain and each edge weight is the conditional dependence from one domain to another domain. Here, the edge weight of the network can be employed as the transferred weight from a source domain to a target domain. The weight values can be taken as a prior for setting parameters in the existing heterogeneous transfer learning methods to control the amount of knowledge transferred from a source domain to a target domain. The experimental results on synthetic and real-world data sets are reported to illustrate the effectiveness of the proposed method that can capture strong or weak relations among feature spaces, and enhance the learning performance of heterogeneous transfer learning.

Original languageEnglish
Pages (from-to)2187-2200
Number of pages14
JournalIEEE Transactions on Neural Networks and Learning Systems
Volume27
Issue number11
DOIs
Publication statusPublished - Nov 2016

Scopus Subject Areas

  • Software
  • Computer Science Applications
  • Computer Networks and Communications
  • Artificial Intelligence

User-Defined Keywords

  • Co-occurrence data
  • directed cyclic network (DCN)
  • heterogeneous transfer learning
  • multidomain
  • transferred weight

Fingerprint

Dive into the research topics of 'Learning Transferred Weights from Co-Occurrence Data for Heterogeneous Transfer Learning'. Together they form a unique fingerprint.

Cite this