Loading...
Please wait, while we are loading the content...
Umbrella: A Portable Environment Creator for Reproducible Computing on Clusters, Clouds, and Grids
| Content Provider | ACM Digital Library |
|---|---|
| Author | Meng, Haiyan Thain, Douglas |
| Abstract | Environment configuration is a significant challenge in large scale computing. An application that runs correctly on one carefully-prepared machine may fail completely on another machine, creating wasted effort and serious concerns about long-term reproducibility. Virtual machines and system containers provide a partial solution to this problem, in that they allow for the accurate reconstruction of an entire computing environment. However, when used directly, they have the dual problems of significant overhead and a lack of portability. To avoid this problem, we present Umbrella, a tool for specifying and materializing comprehensive execution environments from the hardware all the way up to software and data. A user simply invokes Umbrella with the desired task, and Umbrella determines the minimum mechanism necessary to run the task - direct execution, a system container, a local virtual machine, or submission to a cloud or grid environment. We present the overall design of Umbrella and demonstrate its use to precisely execute a high energy physics application across many platforms using combinations of chroot, Docker, Parrot, Condor, and Amazon EC2. |
| Starting Page | 23 |
| Ending Page | 30 |
| Page Count | 8 |
| File Format | |
| ISBN | 9781450335737 |
| DOI | 10.1145/2755979.2755982 |
| Language | English |
| Publisher | Association for Computing Machinery (ACM) |
| Publisher Date | 2015-06-15 |
| Publisher Place | New York |
| Access Restriction | Subscribed |
| Subject Keyword | Reproducible computing Containers Execution environment Virtualization |
| Content Type | Text |
| Resource Type | Article |