TY - JOUR
T1 - PurifyNet
T2 - A Robust Person Re-Identification Model with Noisy Labels
AU - Ye, Mang
AU - YUEN, Pong Chi
N1 - Funding Information:
Manuscript received September 6, 2019; revised December 23, 2019; accepted January 14, 2020. Date of publication January 30, 2020; date of current version March 4, 2020. This work was supported in part by the Hong Kong Research Grant Council General Research Fund (RGC/HKBU 12200518). The associate editor coordinating the review of this manuscript and approving it for publication was Dr. Karthik Nandakumar. (Corresponding author: Pong C. Yuen.) The authors are with the Department of Computer Science, Hong Kong Baptist University, Hong Kong (e-mail: [email protected]; [email protected]). Digital Object Identifier 10.1109/TIFS.2020.2970590 Fig. 1. Examples of label noise on four widely-used person Re-ID datasets. They are caused by either annotation error or bounding box generation error (person detection or tracking).
PY - 2020/1/30
Y1 - 2020/1/30
N2 - Person re-identification (Re-ID) has been widely studied by learning a discriminative feature representation with a set of well-annotated training data. Existing models usually assume that all the training samples are correctly annotated. However, label noise is unavoidable due to false annotations in large-scale industrial applications. Different from the label noise problem in image classification with abundant samples, the person Re-ID task with label noise usually has very limited annotated samples for each identity. In this paper, we propose a robust deep model, namely PurifyNet, to address this issue. PurifyNet is featured in two aspects: 1) it jointly refines the annotated labels and optimizes the neural networks by progressively adjusting the predicted logits, which reuses the wrong labels rather than simply filtering them; 2) it can simultaneously reduce the negative impact of noisy labels and pay more attention to hard samples with correct labels by developing a hard-aware instance re-weighting strategy. With limited annotated samples for each identity, we demonstrate that hard sample mining is crucial for label corrupted Re-ID task, while it is usually ignored in existing robust deep learning methods. Extensive experiments on three datasets demonstrate the robustness of PurifyNet over the competing methods under various settings. Meanwhile, we show that it consistently improves the unsupervised/video-based Re-ID methods. Code is available at: https://github.com/mangye16/ReID-Label-Noise.
AB - Person re-identification (Re-ID) has been widely studied by learning a discriminative feature representation with a set of well-annotated training data. Existing models usually assume that all the training samples are correctly annotated. However, label noise is unavoidable due to false annotations in large-scale industrial applications. Different from the label noise problem in image classification with abundant samples, the person Re-ID task with label noise usually has very limited annotated samples for each identity. In this paper, we propose a robust deep model, namely PurifyNet, to address this issue. PurifyNet is featured in two aspects: 1) it jointly refines the annotated labels and optimizes the neural networks by progressively adjusting the predicted logits, which reuses the wrong labels rather than simply filtering them; 2) it can simultaneously reduce the negative impact of noisy labels and pay more attention to hard samples with correct labels by developing a hard-aware instance re-weighting strategy. With limited annotated samples for each identity, we demonstrate that hard sample mining is crucial for label corrupted Re-ID task, while it is usually ignored in existing robust deep learning methods. Extensive experiments on three datasets demonstrate the robustness of PurifyNet over the competing methods under various settings. Meanwhile, we show that it consistently improves the unsupervised/video-based Re-ID methods. Code is available at: https://github.com/mangye16/ReID-Label-Noise.
KW - instance re-weighting
KW - label noise
KW - Person re-identification (Re-ID)
KW - robust deep learning
UR - http://www.scopus.com/inward/record.url?scp=85081624032&partnerID=8YFLogxK
U2 - 10.1109/TIFS.2020.2970590
DO - 10.1109/TIFS.2020.2970590
M3 - Journal article
AN - SCOPUS:85081624032
SN - 1556-6013
VL - 15
SP - 2655
EP - 2666
JO - IEEE Transactions on Information Forensics and Security
JF - IEEE Transactions on Information Forensics and Security
M1 - 8976262
ER -