PSM-Flow: Probabilistic Subgraph Mining for Discovering Reusable Fragments in Workflows

Chin Wang Cheong, Daniel Garijo, Kwok Wai CHEUNG, Yolanda Gil

Research output: Chapter in book/report/conference proceedingConference contributionpeer-review

Abstract

Scientific workflows define computational processes needed for carrying out scientific experiments. Existing workflow repositories contain hundreds of scientific workflows, where scientists can find materials and knowledge to facilitate workflow design for running related experiments. Identifying reusable fragments in growing workflow repositories has become increasingly important. In this paper, we present PSM-Flow, a probabilistic subgraph mining algorithm designed to discover commonly occurring fragments in a workflow corpus using a modified version of the Latent Dirichlet Allocation algorithm. The proposed model encodes the geodesic distance between workflow steps into the model for implicitly modeling fragments. PSM-Flow captures variations of frequent fragments while maintaining its space complexity bounded polynomially, as it requires no candidate generation. We applied PSM-Flow to three real-world scientific workflow datasets containing more than 750 workflows for neuroimaging analysis. Our results show that PSM-Flow outperforms three state of the art frequent subgraph mining techniques. We also discuss other potential future improvements of the proposed method.

Original languageEnglish
Title of host publicationProceedings - 2018 IEEE/WIC/ACM International Conference on Web Intelligence, WI 2018
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages166-173
Number of pages8
ISBN (Electronic)9781538673256
DOIs
Publication statusPublished - 10 Jan 2019
Event18th IEEE/WIC/ACM International Conference on Web Intelligence, WI 2018 - Santiago, Chile
Duration: 3 Dec 20186 Dec 2018

Publication series

NameProceedings - 2018 IEEE/WIC/ACM International Conference on Web Intelligence, WI 2018

Conference

Conference18th IEEE/WIC/ACM International Conference on Web Intelligence, WI 2018
Country/TerritoryChile
CitySantiago
Period3/12/186/12/18

Scopus Subject Areas

  • Artificial Intelligence
  • Computer Networks and Communications

User-Defined Keywords

  • Frequent Subgraph Mining
  • Probabilistic Model
  • Scientific Workflow
  • Topic Model

Fingerprint

Dive into the research topics of 'PSM-Flow: Probabilistic Subgraph Mining for Discovering Reusable Fragments in Workflows'. Together they form a unique fingerprint.

Cite this