PErasure: A parallel Cauchy Reed-Solomon coding library for GPUs

Xiaowen CHU, Chengjian Liu, Kai Ouyang, Ling Sing Yung, Hai Liu, Yiu Wing LEUNG

Research output: Chapter in book/report/conference proceedingConference contributionpeer-review

16 Citations (Scopus)

Abstract

In recent years, erasure coding has been adopted by large-scale cloud storage systems to replace data replication. With the increase of disk I/O throughput and network bandwidth, the speed of erasure coding becomes one of the key system bottlenecks. In this paper, we propose to offload the task of erasure coding to Graphics Processing Units (GPUs). Specifically, we have designed and implemented PErasure, a parallel Cauchy Reed-Solomon (CRS) coding library. We compare the performance of PErasure with that of two state-of-the-art libraries: Jerasure (for CPUs) and Gibraltar (for GPUs). Our experiments show that the raw coding speed of PErasure on a $500 Nvidia GTX780 card is about 10 times faster than that of multithreaded Jerasure on a quad-core modern CPU, and 2-4 times faster than Gibraltar on the same GPU. PErasure can achieve up to 10GB/s of overall encoding speed using just a single GPU for a large storage system that can withstand up to 8 disk failures.

Original languageEnglish
Title of host publication2015 IEEE International Conference on Communications, ICC 2015
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages436-441
Number of pages6
ISBN (Electronic)9781467364324
DOIs
Publication statusPublished - 9 Sep 2015
EventIEEE International Conference on Communications, ICC 2015 - London, United Kingdom
Duration: 8 Jun 201512 Jun 2015

Publication series

NameIEEE International Conference on Communications
Volume2015-September
ISSN (Print)1550-3607

Conference

ConferenceIEEE International Conference on Communications, ICC 2015
Country/TerritoryUnited Kingdom
CityLondon
Period8/06/1512/06/15

Scopus Subject Areas

  • Computer Networks and Communications
  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'PErasure: A parallel Cauchy Reed-Solomon coding library for GPUs'. Together they form a unique fingerprint.

Cite this