NDLI: Production job scheduling for parallel shared memory systems

Content Provider	IEEE Xplore Digital Library
Author	Chiang, S.-H. Vernon, M.K.
Copyright Year	2001
Description	Author affiliation: Dept. of Comput. Sci., Wisconsin Univ., Madison, WI, USA (Chiang, S.-H.)
Abstract	This paper addresses open job scheduling questions for the challenge workloads that run on the large scale parallel systems at supercomputer centers. Simulation results for six recent one-month job traces from the NCSA Origin 2000 (O2K) system are used to evaluate (I) the experimentally tuned NCSA LSF* policy, (2) the FCFS-backfill policy, (3) the Priority-backfill policy with alternative priority functions and with limited pre-emption to provide immediate service to each arriving job, and (4) the spatial equipartitioning (EQspatial) policy with an optional modification to reduce the maximum waiting time for the largest jobs in the challenge workloads. Measurements on the O2K validate the simulation results for two of the policies. The priority-backfill policy with immediate service and a starvation-free priority measure that favors short jobs is shown to be the most promising if jobs cannot adapt to changing processor allocations at runtime, but EQspatial provides significantly better 95th percentile waiting time.
Sponsorship	IEEE Comput. Soc. Tech. Committee on Parallel Process.
File Size	223671
File Format	PDF
ISBN	0769509908
ISSN	15302075
DOI	10.1109/IPDPS.2001.924987
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2000-04-23
Publisher Place	USA
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Job production systems Processor scheduling Large-scale systems Supercomputers Runtime Concurrent computing Computational modeling Time measurement High performance computing Laboratories
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Selective preemption strategies for parallel job scheduling

Selective buddy allocation for scheduling parallel jobs on clusters

Characterization of backfilling strategies for parallel job scheduling

Scheduling large-scale parallel computations on networks of workstations

Fault-aware job scheduling for BlueGene/L systems

Job fairness in non-preemptive job scheduling

Impact of the execution context on Grid job performances

Runtime incremental parallel scheduling (RIPS) for large-scale parallel computers

Improving Job Scheduling on Production Supercomputers

Production job scheduling for parallel shared memory systems

Similar Documents

Selective preemption strategies for parallel job scheduling

Selective buddy allocation for scheduling parallel jobs on clusters

Characterization of backfilling strategies for parallel job scheduling

Scheduling large-scale parallel computations on networks of workstations

Fault-aware job scheduling for BlueGene/L systems

Job fairness in non-preemptive job scheduling

Impact of the execution context on Grid job performances

Runtime incremental parallel scheduling (RIPS) for large-scale parallel computers

Improving Job Scheduling on Production Supercomputers

Production job scheduling for parallel shared memory systems