Skip to main navigation Skip to search Skip to main content

HARMONI: Heterogeneity-Aware I/O Scheduling for Mixed Workloads in SSD-Based HPC Systems

  • Zexi Cai
  • , Tong Zhao*
  • , Shadi Ibrahim
  • , Chenlin Ma
  • , Yi Wang
  • , Kezhong Lu
  • , Amelie Chi Zhou*
  • *Corresponding author for this work

Research output: Contribution to journalJournal articlepeer-review

Abstract

Modern HPC systems increasingly rely on tiered storage architectures with SSDs serving as a critical performance tier. However, the inherent asynchronous I/O characteristics of SSDs, including read/write bandwidth asymmetry and interference, pose significant challenges for traditional I/O schedulers. These challenges are exacerbated by the convergence of bursty HPC write workloads (e.g., checkpointing) and sustained AI read workloads (e.g., data streaming) on shared SSD infrastructure. Existing schedulers fail to adequately address these combined workloads, leading to suboptimal resource utilization. This paper introduces HARMONI, a heterogeneity-aware reinforcement learning scheduler for mixed I/O in HPC storage systems. HARMONI leverages a graph neural network (GNN) to encode task-SSD dependencies and a hybrid interference predictor to adapt to hardware and I/O variations. Experimental results across diverse HPC and AI workloads demonstrate that HARMONI significantly reduces average makespan by up to 90% compared to state-of-the-art schedulers, effectively bridging the gap between evolving storage hardware and the dynamic I/O demands of modern HPC systems.
Original languageEnglish
Pages (from-to)1-24
Number of pages24
JournalACM Transactions on Architecture and Code Optimization
DOIs
Publication statusE-pub ahead of print - 21 Aug 2026

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

  1. SDG 9 - Industry, Innovation, and Infrastructure
    SDG 9 Industry, Innovation, and Infrastructure

User-Defined Keywords

  • I/O Scheduling
  • High-Performance Computing
  • Solid-State Drive (SSD)

Fingerprint

Dive into the research topics of 'HARMONI: Heterogeneity-Aware I/O Scheduling for Mixed Workloads in SSD-Based HPC Systems'. Together they form a unique fingerprint.

Cite this