Loading...
Please wait, while we are loading the content...
Similar Documents
Flexible storage for HPC clouds with Archipelago and Ceph (abstract only)
| Content Provider | ACM Digital Library |
|---|---|
| Author | Koukis, Vangelis |
| Abstract | This talk introduces Archipelago, a software-defined storage layer providing unified File, Image and Volume resources over an object-storage backend. We will focus on how it can enable efficient workflows for High-Performance Computing in a cloud environment. Archipelago is commonly deployed over Ceph's RADOS object store. With Archipelago, one can: (a) Maintain commonly-used data sets as snapshots and attach them as read-only disks or writeable clones in VMs running the application, (b) begin with a base OS image, bundle all application and supporting library code inside it, and upload it to the Archipelago backend in a syncing, Dropbox-like manner, (c) start a parallel HPC application in hundreds of VMs, thinly provisioned from this Image, (d) modify the I/O processing pipeline to enable aggressive client-side caching for improved number of IOPS, (e) create point-in-time snapshots of running VM disks, and sync them back to their PC for further processing. We conclude with the discussion of upcoming Archipelago features, including direct communication with the storage layer from a guest's userspace, and running Archipelago's shared-memory control and data path over Infiniband RDMA. |
| Starting Page | 1 |
| Ending Page | 1 |
| Page Count | 1 |
| ISBN | 9781450325097 |
| DOI | 10.1145/2535800.2535924 |
| Language | English |
| Publisher | Association for Computing Machinery (ACM) |
| Publisher Date | 2013-11-17 |
| Publisher Place | New York |
| Access Restriction | Subscribed |
| Content Type | Text |
| Resource Type | Article |
