NDLI: Enabling ScientificWorkflow Reuse through Structured Composition of Dataflow and Control-Flow

Content Provider	IEEE Xplore Digital Library
Author	Bowers, S. Ludascher, B. Ngu, A.H.H. Critchlow, T.
Copyright Year	2006
Description	Author affiliation: University of California, Davis (Bowers, S.)
Abstract	Data-centric scientific workflows are often modeled as dataflow process networks. The simplicity of the dataflow framework facilitates workflow design, analysis, and optimization. However, modeling "control-flow intensive" tasks using dataflow constructs often leads to overly complicated workflows that are hard to comprehend, reuse, and maintain. We describe a generic framework, based on scientific workflow templates and frames, for embedding control-flow intensive subtasks within dataflow process networks. This approach can seamlessly handle complex control-flow without sacrificing the benefits of dataflow. We illustrate our approach with a real-world scientific workflow from the astrophysics domain, requiring remote execution and file transfer in a semi-reliable environment. For such workflows, we also describe a 3-layered architecture based on frames and templates where the top-layer consists of an overall dataflow process network, the second layer consists of a tranducer template for modeling the desired control-flow behavior, and the bottom layer consists of frames inside the template that are specialized by embedding the desired component implementation. Our approach can enable scientific workflows that are more robust (faulttolerance strategies can be defined by control-flow driven transducer templates) and at the same time more reusable, since the embedding of frames and templates yields more structured and modular workflow designs.
Starting Page	70
Ending Page	70
File Size	490096
Page Count	1
File Format	PDF
ISBN	0769525717
DOI	10.1109/ICDEW.2006.55
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2006-04-03
Publisher Place	USA
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Computer science Robust control Processor scheduling Scientific computing Laboratories Genomics Data structures Data engineering Mathematical model Bioinformatics
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Enabling scientific workflow reuse through structured composition of dataflow and control-flow (2006)

An efficient pipelined dataflow processor architecture

Scheduling of Scientific Workflows on Data Grids

Monsoon: a dataflow computing architecture suitable for intelligent control

Conditional and iterative structures using a homogeneous static dataflow graph model

Enabling Scientific Workkflow Reuse through . . .

Decoupling computation and data scheduling in distributed data-intensive applications

Dataflow software pipelining: a case study

Scheduling multithreaded computations by work stealing

Enabling ScientificWorkflow Reuse through Structured Composition of Dataflow and Control-Flow

Similar Documents

Enabling scientific workflow reuse through structured composition of dataflow and control-flow (2006)

An efficient pipelined dataflow processor architecture

Scheduling of Scientific Workflows on Data Grids

Monsoon: a dataflow computing architecture suitable for intelligent control

Conditional and iterative structures using a homogeneous static dataflow graph model

Enabling Scientific Workkflow Reuse through . . .

Decoupling computation and data scheduling in distributed data-intensive applications

Dataflow software pipelining: a case study

Scheduling multithreaded computations by work stealing

Enabling ScientificWorkflow Reuse through Structured Composition of Dataflow and Control-Flow