Efficient Online Label Consistent Hashing for Large-scale Cross-modal Retrieval

Jinhan Yi, Xin Liu*, Yiu-ming Cheung, Xing Xu, Wentao Fan, Yi He

*Corresponding author for this work

Research output: Chapter in book/report/conference proceedingConference contributionpeer-review

Abstract

Existing cross-modal hashing still faces three challenges: (1) Most batch-based methods are unsuitable for processing large-scale and streaming data. (2) Current online methods often suffer from insufficient semantic association, while lacking flexibility to learn the hash functions for varying streaming data. (3) Existing supervised methods always require much computation time or accumulate large quantization loss to learn hash codes. To address above challenges, we present an efficient Online Label Consistent Hashing (OLCH) for cross-modal retrieval, which aims to incrementally learn hash codes for the current arriving data, while updating the hash functions at a streaming manner. To be specific, an on-line semantic representation learning framework is designed to adaptively preserve the semantic similarity across different modalities, and a mini-batch online gradient descent approach associated with forward-backward splitting is developed to optimize the hash functions. Accordingly, the hash codes are adaptively learned online with the high discriminative capability, while avoiding high computation complexity to process the streaming data. Experimental results show its outstanding performance in comparison with the-state-of-arts.
Original languageEnglish
Title of host publication2021 IEEE International Conference on Multimedia and Expo (ICME)
PublisherIEEE
Pages1-6
Number of pages6
ISBN (Electronic)9781665438643
ISBN (Print)9781665411523
DOIs
Publication statusPublished - 5 Jul 2021
Event2021 IEEE International Conference on Multimedia and Expo, ICME 2021 - Shenzhen, China
Duration: 5 Jul 20219 Jul 2021

Publication series

NameIEEE International Conference on Multimedia and Expo (ICME)
ISSN (Print)1945-7871
ISSN (Electronic)1945-788X

Conference

Conference2021 IEEE International Conference on Multimedia and Expo, ICME 2021
Country/TerritoryChina
CityShenzhen
Period5/07/219/07/21

User-Defined Keywords

  • Online label consistent hashing
  • online semantic representation
  • mini-batch online gradient descent
  • forward-backward splitting

Fingerprint

Dive into the research topics of 'Efficient Online Label Consistent Hashing for Large-scale Cross-modal Retrieval'. Together they form a unique fingerprint.

Cite this