Label-Semantic-Enhanced Online Hashing for Efficient Cross-modal Retrieval

Xueting Jiang, Xin Liu*, Yiu Ming Cheung*, Xing Xu, Shukai Zheng, Taihao Li

*Corresponding author for this work

Research output: Chapter in book/report/conference proceedingConference proceedingpeer-review

Abstract

Existing online cross-modal hashing methods often treat the semantic label categories independently to correlate the semantically similar data instances, which intrinsically ignore the potential dependency between the label categories and thus fail to capture the discriminative information in the hash code learning process. To alleviate this concern, we explore the inter-dependency between the label categories through their co-occurrence correlation from the label set, and present an efficient Label-Semantic-Enhanced Online Hashing (LSE-OH) method for various cross-modal retrieval task. To be specific, the proposed framework integrates the instance-wise similarity and label-category affinity to incrementally learn the discriminative hash codes for the current arriving data, while updating the hash functions at a streaming manner. Further, an iterative discrete optimization algorithm is derived to mine the inter-dependency between the label categories and discriminatively learn the hash codes without relaxation. Accordingly, the hash codes are adaptively learned online with the high discriminative capability and inter-dependency, while avoiding high computation complexity to process the streaming data. Experimental results show its outstanding performance in comparison with the-state-of-arts.

Original languageEnglish
Title of host publicationProceedings - 2023 IEEE International Conference on Multimedia and Expo, ICME 2023
PublisherIEEE
Pages984-989
Number of pages6
ISBN (Electronic)9781665468916
ISBN (Print)9781665468923
DOIs
Publication statusPublished - 10 Jul 2023
Event2023 IEEE International Conference on Multimedia and Expo, ICME 2023 - Brisbane Convention & Exhibition Centre, Brisbane, Australia
Duration: 10 Jul 202314 Jul 2023
https://www.2023.ieeeicme.org/index.php
https://www.2023.ieeeicme.org/program.php
https://ieeexplore.ieee.org/xpl/conhome/10219544/proceeding

Publication series

NameProceedings - IEEE International Conference on Multimedia and Expo
Volume2023-July
ISSN (Print)1945-7871
ISSN (Electronic)1945-788X

Conference

Conference2023 IEEE International Conference on Multimedia and Expo, ICME 2023
Country/TerritoryAustralia
CityBrisbane
Period10/07/2314/07/23
Internet address

Scopus Subject Areas

  • Computer Networks and Communications
  • Computer Science Applications

User-Defined Keywords

  • category latent correlation
  • cross-modal retrieval
  • Online supervised hashing
  • similarity search

Fingerprint

Dive into the research topics of 'Label-Semantic-Enhanced Online Hashing for Efficient Cross-modal Retrieval'. Together they form a unique fingerprint.

Cite this