Heterogeneous-neighborhood-based multi-task local learning algorithms

Yu Zhang*

*Corresponding author for this work

Research output: Chapter in book/report/conference proceedingConference proceedingpeer-review

14 Citations (Scopus)


All the existing multi-task local learning methods are defined on homogeneous neighborhood which consists of all data points from only one task. In this paper, different from existing methods, we propose local learning methods for multitask classification and regression problems based on heterogeneous neighborhood which is defined on data points from all tasks. Specifically, we extend the κ- nearest-neighbor classifier by formulating the decision function for each data point as a weighted voting among the neighbors from all tasks where the weights are task-specific. By defining a regularizer to enforce the task-specific weight matrix to approach a symmetric one, a regularized objective function is proposed and an efficient coordinate descent method is developed to solve it. For regression problems, we extend the kernel regression to multi-task setting in a similar way to the classification case. Experiments on some toy data and real-world datasets demonstrate the effectiveness of our proposed methods.

Original languageEnglish
Title of host publication27th Annual Conference on Neural Information Processing Systems, NIPS 2013
EditorsC. J. Burges, L. Bottou, M. Welling, Z. Ghahramani, K.Q. Weinberger
PublisherNeural Information Processing Systems Foundation
Number of pages9
ISBN (Print)9781632660244
Publication statusPublished - Dec 2013
Event27th Annual Conference on Neural Information Processing Systems, NIPS 2013 - Lake Tahoe, NV, United States
Duration: 5 Dec 201310 Dec 2013

Publication series

NameAdvances in Neural Information Processing Systems
ISSN (Print)1049-5258
NameNeurIPS Proceedings


Conference27th Annual Conference on Neural Information Processing Systems, NIPS 2013
Country/TerritoryUnited States
CityLake Tahoe, NV
Internet address

Scopus Subject Areas

  • Computer Networks and Communications
  • Information Systems
  • Signal Processing


Dive into the research topics of 'Heterogeneous-neighborhood-based multi-task local learning algorithms'. Together they form a unique fingerprint.

Cite this