Exploiting Class Activation Vector for Partial-Label Learning

Fei Zhang, Lei Feng*, Bo Han*, Tongliang Liu, Gang Niu, Tao Qin, Masashi Sugiyama

*Corresponding author for this work

Research output: Contribution to conferencePaperpeer-review

Abstract

Partial-label learning (PLL) solves the multi-class classification problem, where each training instance is assigned a set of candidate labels that include the true label. Recent advances showed that PLL can be compatible with deep neural networks, which achieved state-of-the-art performance. However, most of the existing deep PLL methods focus on designing proper training objectives under various assumptions on the collected data, which may limit their performance when the collected data cannot satisfy the adopted assumptions. In this paper, we propose to exploit the learned intrinsic representation of the model to identify the true label in the training process, which does not rely on any assumptions on the collected data. We make two key contributions. As the first contribution, we empirically show that the class activation map (CAM), a simple technique for discriminating the learning patterns of each class in images, could surprisingly be utilized to make accurate predictions on selecting the true label from candidate labels. Unfortunately, as CAM is confined to image inputs with convolutional neural networks, we are yet unable to directly leverage CAM to address the PLL problem with general inputs and models. Thus, as the second contribution, we propose the class activation value (CAV), which owns similar properties of CAM, while CAV is versatile in various types of inputs and models. Building upon CAV, we propose a novel method named CAV Learning (CAVL) that selects the true label by the class with the maximum CAV for model training. Extensive experiments on various datasets demonstrate that our proposed CAVL method achieves state-of-the-art performance.
Original languageEnglish
Number of pages17
Publication statusPublished - 25 Apr 2022
EventICLR 2022 - Tenth International Conference on Learning Representations - Virtual
Duration: 25 Apr 202229 Apr 2022
https://iclr.cc/Conferences/2022

Conference

ConferenceICLR 2022 - Tenth International Conference on Learning Representations
Period25/04/2229/04/22
Internet address

User-Defined Keywords

  • Partial-label Learning
  • Class Activation Map

Fingerprint

Dive into the research topics of 'Exploiting Class Activation Vector for Partial-Label Learning'. Together they form a unique fingerprint.

Cite this