SDCI NMI Improvement: Pegasus: From Concept to Execution- - -Mapping Scientific Workflows onto the National Cyberinfrastructure

Project Details

Project Lead
Mats Rynge 
Project Manager
Mats Rynge 
Project Members
Parag Mhashilkar, Mats Rynge, Bartosz Balis, Maciej Malawski, Michal Niec, Robert Schuler, Idafen Santana Perez  
Supporting Experts
Hyungro Lee  
Institution
USC, ISI  
Discipline
Computer Science (401) 

Abstract

This project addresses improvements to Pegasus, a workflow system overlaying a workflow engine called DAGMan. These improvements will make Pegasus easy to deploy and use across a broad range of science users and environments. New debug capabilities will be added, usability will be improved, new communities of users will be directly engaged, richer workflow representations will be supported, dynamic workflows will be supported, priority-based task submission capabilities will be added, monitoring will be enhanced, and integration with emerging workflow technologies will be pursued. Intellectual merit lies in the demonstrated value to physics, astronomy, and other users. Broad impact of this proposal includes extension of the user base across new communities, including those using TeraGrid and OSG.

Intellectual Merit

(provided later)

Broader Impacts

(provided later)

Scale of Use

Testing, specifically growing/shrinking the resource pool based on demand.