Abstract
In global scientific experiments with collaborative scenarios involving multinational teams there are big challenges related to data access, namely data movements are precluded to other regions or Clouds due to the constraints on latency costs, data privacy and data ownership. Furthermore, each site is processing local data sets using specialized algorithms and producing intermediate results that are helpful as inputs to applications running on remote sites. This paper shows how to model such collaborative scenarios as a scientific workflow implemented with \{AWARD\} (Autonomic Workflow Activities Reconfigurable and Dynamic), a decentralized framework offering a feasible solution to run the workflow activities on distributed data centers in different regions without the need of large data movements. The \{AWARD\} workflow activities are independently monitored and dynamically reconfigured and steering by different users, namely by hot-swapping the algorithms to enhance the computation results or by changing the workflow structure to support feedback dependencies where an activity receives feedback output from a successor activity. A real implementation of one practical scenario and its execution on multiple data centers of the Amazon Cloud is presented including experimental results with steering by multiple users.
Original language | English |
---|---|
Title of host publication | 2014 INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE |
Publisher | Elsevier |
Pages | 2137-2144 |
DOIs | |
Publication status | Published - 2014 |
Event | 14th Annual International Conference on Computational Science (ICCS 2014) - Caims, Australia Duration: 10 Jun 2014 → 12 Jun 2014 Conference number: 14th |
Publication series
Name | Procedia Computer Science |
---|---|
Publisher | Elsevier |
Volume | 29 |
ISSN (Print) | 1877-0509 |
Conference
Conference | 14th Annual International Conference on Computational Science (ICCS 2014) |
---|---|
Abbreviated title | ICCS 2014 |
Country/Territory | Australia |
City | Caims |
Period | 10/06/14 → 12/06/14 |
Keywords
- Scientific Workflows
- Interactive Reconfigurations and Steering
- Global Experiments on Cloud