Skip to main navigation Skip to search Skip to main content

Disk-Resident Vector Similarity Search: A Survey

  • Yitong Song
  • , Huiling Li
  • , Zheng Wu
  • , Lanjing Yi
  • , Bojian Zhu
  • , Xuanhe Zhou
  • , Xin Huang
  • , Jianliang Xu*
  • *Corresponding author for this work

Research output: Contribution to journal › Journal article › peer-review

Abstract

Vector similarity search (VSS) has become ubiquitous in modern multimodal data retrieval systems, supporting a wide range of applications such as document retrieval, music recognition, image search, and code assistants. With the rapid growth of vector datasets and the prohibitive cost of main memory, VSS techniques are increasingly shifting from memory-resident to disk-resident settings. Unlike memory-resident designs, which keep both raw vectors and index structures entirely in memory, disk-resident VSS places raw vectors and fine-grained index structures on secondary storage while retaining only lightweight components in memory. Therefore, disk-resident VSS must explicitly account for data access costs (i.e., I/O) and block-level layouts, leading to index organizations and query execution strategies that are fundamentally different from those used in memory-resident systems.

This survey provides the first systematic review of disk-resident VSS, a critical yet challenging task for modern large-scale data systems. We introduce a unified framework that categorizes existing techniques into IVF-based, graph-based, and tree-based paradigms, based on the primary index structure used for filtering. For each category, we further decompose the overall design into key technical components, including index construction, block-aware layouts, query execution strategies, and update mechanisms. Moreover, we summarize commonly used datasets to facilitate reproducible benchmarking, and identify open challenges and promising directions for future research.
Original languageEnglish
Pages (from-to)1-20
Number of pages20
JournalIEEE Transactions on Knowledge and Data Engineering
DOIs
Publication statusE-pub ahead of print - 7 Sept 2026

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

  1. SDG 9 - Industry, Innovation, and Infrastructure
    SDG 9 Industry, Innovation, and Infrastructure

User-Defined Keywords

  • Approximate nearest neighbor search
  • High-dimensional vector
  • Disk-resident search

Fingerprint

Dive into the research topics of 'Disk-Resident Vector Similarity Search: A Survey'. Together they form a unique fingerprint.

Cite this