NDLI: Combining batch execution and leasing using virtual machines

Please wait, while we are loading the content...

FaTLease: scalable fault-tolerant lease negotiation with paxos

Evaluating the usefulness of content addressable storage for high-performance data intensive applications

Scheduling mixed-parallel applications with advance reservations

XenLoop: a transparent high performance inter-vm network loopback

Toward automatic parallelization of spatial computation for computing clusters

Harmony: an execution model and runtime for heterogeneous many core systems

Managing SLAs of heterogeneous workloads using dynamic application placement

Securing stateful grid servers through virtual server rotation

File grouping for scientific data management: lessons from experimenting with real traces

VARQ: virtual advance reservations for queues

Vpm tokens: virtual machine-aware power budgeting in datacenters

StoreGPU: exploiting graphics processing units to accelerate distributed storage systems

Facilitating the deployment of ad-hoc virtual organizations with integrated social and overlay networks

DART: a substrate for high speed asynchronous data IO

Performability modeling for scheduling and fault tolerance strategies for scientific workflows

Eliminating the middleman: peer-to-peer dataflow

Combining batch execution and leasing using virtual machines

Improving peer connectivity in wide-area overlays of virtual workstations

Semantic-based distributed i/o with the paramedic framework

Ontological framework for a free-form query based grid search engine

Resource tracking in parallel and distributed applications

The performance of bags-of-tasks in large-scale distributed systems

The impact of paravirtualized memory hierarchy on linear algebra computational kernels and software

FARMER: a novel approach to file access correlation mining and evaluation reference model for optimizing peta-scale file system performance

An unstructured peer-to-peer approach to aggregate node selection

Code coverage, performance approximation and automatic recognition of idioms in scientific applications

enabling cross-layer optimizations in storage systems with custom metadata

Multi-hop path splitting and multi-pathing optimizations for data transfers over shared wide-area networks using gridFTP

Collaborative ranking of grid-enabled workflow service providers

Distributed mpi cross-site run performance using mpig

A two-level scheduler to dynamically schedule a stream of batch jobs in large-scale grids

DataLab: transactional data-parallel computing on an active storage cloud

Key-based consistency and availability in structured overlay networks

Dynasa: adapting grid applications to safety using fault-tolerant methods

Issues in applying data mining to grid job failure detection and diagnosis

Combining batch execution and leasing using virtual machines

Content Provider	ACM Digital Library
Author	Foster, Ian Sotomayor, Borja Keahey, Kate
Abstract	As cluster computers are used for a wider range of applications, we encounter the need to deliver resources at particular times, to meet particular deadlines, and/or at the same time as other resources are provided elsewhere. To address such requirements, we describe a scheduling approach in which users request resource leases, where leases can request either as-soon-as-possible ("best-effort") or reservation start times. We present the design of a lease management architecture, Haizea, that implements leases as virtual machines (VMs), leveraging their ability to suspend, migrate, and resume computations and to provide leased resources with customized application environments. We discuss methods to minimize the overhead introduced by having to deploy VM images before the start of a lease. We also present the results of simulation studies that compare alternative approaches. Using workloads with various mixes of best-effort and advance reservation requests, we compare the performance of our VM-based approach with that of non-VM-based schedulers. We find that a VM-based approach can provide better performance (measured in terms of both total execution time and average delay incurred by best-effort requests) than a scheduler that does not support task pre-emption, and only slightly worse performance than a scheduler that does support task pre-emption. We also compare the impact of different VM image popularity distributions and VM image caching strategies on performance. These results emphasize the importance of VM image caching for the workloads studied and quantify the sensitivity of scheduling performance to VM image popularity distribution.
Starting Page	87
Ending Page	96
Page Count	10
File Format	PDF
ISBN	9781595939975
DOI	10.1145/1383422.1383434
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2008-06-23
Publisher Place	New York
Access Restriction	Subscribed
Subject Keyword	Backfilling Resource leasing Virtual machine overhead Advance reservations Virtual machines Checkpoint/restart Batch processing Resource management Virtual workspaces
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Combining batch execution and leasing using virtual machines (2008)

Checkpoint/restart of virtual machines based on Xen (2006)

Combining batch execution and leasing using virtual machines (2008)

Resource leasing and the art of suspending virtual machines,” To appear (2009)

Scalable transparent checkpoint-restart of global address space applications on virtual machines over infiniband

BlobCR: Efficient checkpoint-restart for hpc applications on iaas clouds using virtual disk image snapshots (2011)

Probabilistic advanced reservations for batch-scheduled parallel machines

VARQ: virtual advance reservations for queues

Checkpoint/Restart of Virtual Machines Based on Xen

Combining batch execution and leasing using virtual machines

Similar Documents

Combining batch execution and leasing using virtual machines (2008)

Checkpoint/restart of virtual machines based on Xen (2006)

Combining batch execution and leasing using virtual machines (2008)

Resource leasing and the art of suspending virtual machines,” To appear (2009)

Scalable transparent checkpoint-restart of global address space applications on virtual machines over infiniband

BlobCR: Efficient checkpoint-restart for hpc applications on iaas clouds using virtual disk image snapshots (2011)

Probabilistic advanced reservations for batch-scheduled parallel machines

VARQ: virtual advance reservations for queues

Checkpoint/Restart of Virtual Machines Based on Xen

Combining batch execution and leasing using virtual machines