An Efficient and Composable Parallel Task Programming Library

Chun-Xun Lin, Tsung-Wei Huang, Guannan Guo, Martin D. F. Wong

Research output: Chapter in book/report/conference proceedingConference proceedingpeer-review

8 Citations (Scopus)

Abstract

Composability is a key component to improve programmers' productivity in writing fast market-expanding applications such as parallel machine learning algorithms and big data analytics. These applications exhibit both regular and irregular compute patterns, and are often combined with other functions or libraries to compose a larger program. However, composable parallel processing has taken a back seat in many existing parallel programming libraries, making it difficult to achieve modularity in large-scale parallel programs. In this paper, we introduce a new parallel task programming library using composable tasking graphs. Our library efficiently supports task parallelism together with an intuitive task graph construction and flexible execution API set to enable reusable and composable task dependency graphs. Developers can quickly compose a large parallel program from small and modular parallel building blocks, and easily deploy the program on a multicore machine. We have evaluated our library on real-world applications. Experimental results showed our library can achieve comparable performance to Intel Threading Building Blocks with less coding effort.
Original languageEnglish
Title of host publication2019 IEEE High Performance Extreme Computing Conference (HPEC)
PublisherIEEE
Pages1-7
Number of pages7
ISBN (Electronic)9781728150208
ISBN (Print)9781728150215 (Print on Demand)
DOIs
Publication statusPublished - Sept 2019
Event2019 IEEE High Performance Extreme Computing Conference (HPEC) - Waltham, United States
Duration: 24 Sept 201926 Sept 2019
https://ieeexplore.ieee.org/xpl/conhome/8910148/proceeding (Link to conference proceedings)

Publication series

NameProceedings of IEEE High Performance Extreme Computing Conference (HPEC)

Conference

Conference2019 IEEE High Performance Extreme Computing Conference (HPEC)
Country/TerritoryUnited States
CityWaltham
Period24/09/1926/09/19
Internet address

User-Defined Keywords

  • Parallel programming
  • multithreading

Fingerprint

Dive into the research topics of 'An Efficient and Composable Parallel Task Programming Library'. Together they form a unique fingerprint.

Cite this