Real-time in-memory checkpointing for future hybrid memory systems

Shen Gao, Bingsheng He, Jianliang XU

Research output: Chapter in book/report/conference proceedingConference proceedingpeer-review

21 Citations (Scopus)


In this paper, we study real-time in-memory checkpointing as an effective means to improve the reliability of future large-scale parallel processing systems. Under this context, the checkpoint overhead can become a significant performance bottleneck. Novel memory system designs with upcoming non-volatile random access memory (NVRAM) technologies are emerging to address this performance issue. However, we find that those designs can still have prohibitively high checkpoint overhead and system downtime, especially when checkpoints are taken frequently to implement a reliable system. In this paper, we propose a novel in-memory checkpointing system, named Mona, for reducing the checkpoint overhead of hybrid memory systems with NVRAM and DRAM. To minimize the inmemory checkpoint overhead, Mona dynamically writes partial checkpoints from DRAM to NVRAM during application execution. To reduce the interference of partial checkpointing, Mona utilizes runtime idle periods and leverages a cost model to guide partial checkpointing decisions for individual DRAM ranks. We further develop load-balancing mechanisms to balance checkpoint overheads across different DRAM ranks. Simulation results demonstrate the eficiency and effectiveness of Mona in reducing the checkpoint overhead, downtime and restarting time.

Original languageEnglish
Title of host publicationICS 2015 - Proceedings of the 29th ACM International Conference on Supercomputing
PublisherAssociation for Computing Machinery (ACM)
Number of pages10
ISBN (Electronic)9781450335591
Publication statusPublished - 8 Jun 2015
Event29th ACM International Conference on Supercomputing, ICS 2015 - Newport Beach, United States
Duration: 8 Jun 201511 Jun 2015

Publication series

NameProceedings of the International Conference on Supercomputing


Conference29th ACM International Conference on Supercomputing, ICS 2015
Country/TerritoryUnited States
CityNewport Beach

Scopus Subject Areas

  • Computer Science(all)

User-Defined Keywords

  • Checkpointing
  • Parallel computing
  • Phase change memory


Dive into the research topics of 'Real-time in-memory checkpointing for future hybrid memory systems'. Together they form a unique fingerprint.

Cite this