Enhancing Contrastive Learning for Ordinal Regression via Ordinal Content Preserved Data Augmentation

Contrastive learning, while highly effective for a lot of tasks, shows limited im- provement in ordinal regression. We find that the limitation comes from the prede- fined strong data augmentations employed in contrastive learning. Intuitively, for ordinal regression datasets, the discriminative information (ordinal content infor- mation) contained in instances is subtle. Existing strong augmentations can easily overshadow this ordinal content information. As a result, when contrastive learn- ing is used to extract common features between weakly and strongly augmented images, the derived features often lack this essential ordinal content, rendering them less useful in training models for ordinal regression. To improve contrastive learning’s utility for ordinal regression, we propose a novel augmentation method to replace the predefined strong argumentation based on the principle of minimal change. Our method is designed in a generative manner that can effectively gener- ate images with different styles but contains desired ordinal content information. Extensive experiments validate the effectiveness of our proposed method, which serves as a plug-and-play solution and consistently improves the performance of existing state-of-the-art methods for ordinal regression.