Skip to main navigation Skip to search Skip to main content

MLCA: Multi-level Correlative Attacks against Deep Cross-Modal Hashing

  • Xiaohang Fang
  • , Xin Liu*
  • , Zhikai Hu
  • , Yiu-ming Cheung
  • , Shu-Juan Peng
  • , Xing Xu
  • *Corresponding author for this work

Research output: Contribution to journalJournal articlepeer-review

Abstract

Deep Cross-Modal Hashing (DCMH) has gained significant popularity for its effectiveness in cross-modal retrieval. However, its intrinsic vulnerability to adversarial attacks poses a serious threat to retrieval reliability, highlighting the need for more comprehensive investigations of such attacks to improve model robustness. Despite recent progress, existing attack methods face two key limitations: (1) insufficiently exploit cross-modal adversarial correlations; (2) rely on indirect perturbation generation, which limits their ability to balance attack effectiveness and imperceptibility. To address these challenges, we propose an efficient Multi-level Correlative Attack (MLCA) against DCMH. Specifically, MLCA leverages the semantic extraction network and hash auxiliary network to extract multi-level information, from both clean and adversarial data. Guided by such cross-modal information, an efficient iterative attacking mechanism is innovatively designed to circularly manipulate cross-modal correlations of adversarial data, which seamlessly decouples the potential correlations within clean data while implanting deceptive cross-modal correlations into adversarial samples in Hamming space. Through the iterative refinement of the above process, adversarial examples with imperceptible perturbations can be effectively generated to attack various DCMH models. We evaluate MLCA on commonly used cross-modal retrieval benchmarks and representative DCMH models under the white-box setting. Experimental results show that MLCA generally achieves stronger targeted attack performance compared with baselines while maintaining low perceptual distortion. Furthermore, our robustness analysis reveals intrinsic vulnerabilities in existing models and provides valuable insights for developing robust cross-modal hashing systems. The code is available at: https://github.com/FunXH/MLCA.
Original languageEnglish
Article number114124
Number of pages13
JournalPattern Recognition
Volume180, Part B
Early online date1 Jun 2026
DOIs
Publication statusE-pub ahead of print - 1 Jun 2026

User-Defined Keywords

  • Hash auxiliary network
  • Imperceptible perturbation
  • Iterative attacking mechanism
  • Multi-level correlative attack

Fingerprint

Dive into the research topics of 'MLCA: Multi-level Correlative Attacks against Deep Cross-Modal Hashing'. Together they form a unique fingerprint.

Cite this