Skip to main navigation Skip to search Skip to main content

Are anchor points really indispensable in label-noise learning?

  • Xiaobo Xia
  • , Tongliang Liu
  • , Nannan Wang
  • , Bo Han
  • , Chen Gong
  • , Gang Niu
  • , Masashi Sugiyama

Research output: Chapter in book/report/conference proceedingConference proceedingpeer-review

364 Citations (Scopus)

Abstract

In label-noise learning, the noise transition matrix, denoting the probabilities that clean labels flip into noisy labels, plays a central role in building statistically consistent classifiers. Existing theories have shown that the transition matrix can be learned by exploiting anchor points (i.e., data points that belong to a specific class almost surely). However, when there are no anchor points, the transition matrix will be poorly learned, and those previously consistent classifiers will significantly degenerate. In this paper, without employing anchor points, we propose a transition-revision (T-Revision) method to effectively learn transition matrices, leading to better classifiers. Specifically, to learn a transition matrix, we first initialize it by exploiting data points that are similar to anchor points, having high noisy class posterior probabilities. Then, we modify the initialized matrix by adding a slack variable, which can be learned and validated together with the classifier by using noisy data. Empirical results on benchmark-simulated and real-world label-noise datasets demonstrate that without using exact anchor points, the proposed method is superior to state-of-the-art label-noise learning methods.

Original languageEnglish
Title of host publication33rd Conference on Neural Information Processing Systems, NeurIPS 2019
EditorsH. Wallach, H. Larochelle, A. Beygelzimer, F. d'Alché-Buc, E. Fox, R. Garnett
PublisherNeural Information Processing Systems Foundation
Pages1-12
Number of pages12
ISBN (Print)9781713807933
Publication statusPublished - 8 Dec 2019
Event33rd Conference on Neural Information Processing Systems, NeurIPS 2019 - Vancouver, Canada
Duration: 8 Dec 201914 Dec 2019
https://neurips.cc/Conferences/2019
https://proceedings.neurips.cc/paper/2019

Publication series

NameAdvances in Neural Information Processing Systems
PublisherNeural Information Processing Systems Foundation
Volume32
ISSN (Print)1049-5258

Conference

Conference33rd Conference on Neural Information Processing Systems, NeurIPS 2019
Country/TerritoryCanada
CityVancouver
Period8/12/1914/12/19
Internet address

Fingerprint

Dive into the research topics of 'Are anchor points really indispensable in label-noise learning?'. Together they form a unique fingerprint.

Cite this