NDLI: Scheduling speculative tasks in a compute farm

Content Provider	IEEE Xplore Digital Library
Author	Petrou, D. Gibson, G.A. Ganger, G.R.
Copyright Year	2005
Description	Author affiliation: Carnegie Mellon University (Petrou, D.)
Abstract	Users often behave speculatively, submitting work that initially they do not know is needed. Farm computing often consists of single node speculative tasks issued by, e.g., bioinformaticists comparing dna sequences and computer graphics artists rendering scenes who wish to reduce their time waiting for needed tasks and the amount they will be charged for unneeded speculation. Existing schedulers are not effective for such behavior. Our batchactive scheduling exploits speculation: users submit explicitlylabeled batches of speculative tasks, interactively request outputs when ready to process them, and cancel tasks found not to be needed. Users are encouraged to participate by a new pricing mechanism charging for only requested tasks no matter what ran. Over a range of simulated user and task characteristics, we show that: batchactive scheduling improves visible response time - a new metric for speculative domains - by at least 2X for 20% of the simulations; batchactive scheduling supports higher billable load at lower visible response time, encouraging adoption by resource providers; and a batchactive policy favoring users who use more of their speculative tasks provides additional performance and resists a denialof- service.
Starting Page	37
Ending Page	37
File Size	670337
Page Count	1
File Format	PDF
ISBN	1595930612
DOI	10.1109/SC.2005.62
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2005-11-12
Publisher Place	USA
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Processor scheduling Delay DNA computing Bioinformatics Sequences Computer graphics Rendering (computer graphics) Layout Pricing Radio access networks
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Scheduling Speculative Tasks in a Compute Farm (2005)

Scheduling speculative tasks in a compute farm

Hybrid scheduling for parallel rendering using coherent ray tasks

Task scheduling in distributed system for photorealistic rendering

A Grid Based Graphics Rendering Design

The design and implementation of Render Farm Manager based on OpenPBS

Demand Pricing & Resource Allocation in Market-Based Compute Grids: A Model and Initial Results

A framework for sample-based rendering with O-buffers

Co-scheduling compute-intensive tasks on a network of workstations: model and algorithms

Scheduling speculative tasks in a compute farm

Similar Documents

Scheduling Speculative Tasks in a Compute Farm (2005)

Scheduling speculative tasks in a compute farm

Hybrid scheduling for parallel rendering using coherent ray tasks

Task scheduling in distributed system for photorealistic rendering

A Grid Based Graphics Rendering Design

The design and implementation of Render Farm Manager based on OpenPBS

Demand Pricing & Resource Allocation in Market-Based Compute Grids: A Model and Initial Results

A framework for sample-based rendering with O-buffers

Co-scheduling compute-intensive tasks on a network of workstations: model and algorithms

Scheduling speculative tasks in a compute farm