TY - GEN
T1 - PErasure
T2 - 2015 IEEE International Conference on Communications, ICC 2015
AU - CHU, Xiaowen
AU - Liu, Chengjian
AU - Ouyang, Kai
AU - Yung, Ling Sing
AU - Liu, Hai
AU - LEUNG, Yiu Wing
N1 - Publisher Copyright:
© 2015 IEEE.
Copyright:
Copyright 2016 Elsevier B.V., All rights reserved.
PY - 2015/9/9
Y1 - 2015/9/9
N2 - In recent years, erasure coding has been adopted by large-scale cloud storage systems to replace data replication. With the increase of disk I/O throughput and network bandwidth, the speed of erasure coding becomes one of the key system bottlenecks. In this paper, we propose to offload the task of erasure coding to Graphics Processing Units (GPUs). Specifically, we have designed and implemented PErasure, a parallel Cauchy Reed-Solomon (CRS) coding library. We compare the performance of PErasure with that of two state-of-the-art libraries: Jerasure (for CPUs) and Gibraltar (for GPUs). Our experiments show that the raw coding speed of PErasure on a $500 Nvidia GTX780 card is about 10 times faster than that of multithreaded Jerasure on a quad-core modern CPU, and 2-4 times faster than Gibraltar on the same GPU. PErasure can achieve up to 10GB/s of overall encoding speed using just a single GPU for a large storage system that can withstand up to 8 disk failures.
AB - In recent years, erasure coding has been adopted by large-scale cloud storage systems to replace data replication. With the increase of disk I/O throughput and network bandwidth, the speed of erasure coding becomes one of the key system bottlenecks. In this paper, we propose to offload the task of erasure coding to Graphics Processing Units (GPUs). Specifically, we have designed and implemented PErasure, a parallel Cauchy Reed-Solomon (CRS) coding library. We compare the performance of PErasure with that of two state-of-the-art libraries: Jerasure (for CPUs) and Gibraltar (for GPUs). Our experiments show that the raw coding speed of PErasure on a $500 Nvidia GTX780 card is about 10 times faster than that of multithreaded Jerasure on a quad-core modern CPU, and 2-4 times faster than Gibraltar on the same GPU. PErasure can achieve up to 10GB/s of overall encoding speed using just a single GPU for a large storage system that can withstand up to 8 disk failures.
UR - http://www.scopus.com/inward/record.url?scp=84953716298&partnerID=8YFLogxK
U2 - 10.1109/ICC.2015.7248360
DO - 10.1109/ICC.2015.7248360
M3 - Conference contribution
AN - SCOPUS:84953716298
T3 - IEEE International Conference on Communications
SP - 436
EP - 441
BT - 2015 IEEE International Conference on Communications, ICC 2015
PB - IEEE
Y2 - 8 June 2015 through 12 June 2015
ER -