NDLI: CDES: An Approach to HPC Workload Modelling

Content Provider	IEEE Xplore Digital Library
Author	Brennan, J. Holmes, V. Kureshi, I.
Copyright Year	2014
Description	Author affiliation: Inst. of Adv. Res. Comput., Durham Univ., Durham, UK (Kureshi, I.) \|\| HPC Res. Group, Univ. of Huddersfield, Huddersfield, UK (Brennan, J.; Holmes, V.)
Abstract	Computational science and complex system administration relies on being able to model user interactions. When it comes to managing HPC, HTC and grid systems user workloads - their job submission behaviour, is an important metric when designing systems or scheduling algorithms. Most simulators are either inflexible or tied in to proprietary scheduling systems. For system administrators being able to model how a scheduling algorithm behaves or how modifying system configurations can affect the job completion rates is critical. Within computer science research many algorithms are presented with no real description or verification of behaviour. In this paper we are presenting the Cluster Discrete Event Simulator (CDES) as an strong candidate for HPC workload simulation. Built around an open framework, CDES can take system definitions, multi-platform real usage logs and can be interfaced with any scheduling algorithm through the use of an API. CDES has been tested against 3 years of usage logs from a production level HPC system and verified to a greater than 95% accuracy.
Starting Page	47
Ending Page	54
File Size	281984
Page Count	8
File Format	PDF
ISBN	9781479961436
ISSN	15506525
e-ISBN	9781479961443
DOI	10.1109/DS-RT.2014.15
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2014-10-01
Publisher Place	France
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Educational institutions Scheduling algorithms Torque Arrays Computational modeling Clustering algorithms Testing HPC simulator HPC WMS workload modelling scheduler
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

CDES: An Approach to HPC Workload Modelling

Preemptive Hadoop Jobs Scheduling under a Deadline

An ACO-based Approach to Improve C-means Clustering Algorithm

DGSchedSim: a trace-driven simulator to evaluate scheduling algorithms for desktop grid environments

A CPU-GPGPU Scheduler Based on Data Transmission Bandwidth of Workload

Dynamic task scheduling in computing cluster environments

Single-Snapshot File System Analysis

An Efficient Approach to Higher Dimensional Data Clustering

Simulation and performance comparison of four disk scheduling algorithms

CDES: An Approach to HPC Workload Modelling

Similar Documents

CDES: An Approach to HPC Workload Modelling

Preemptive Hadoop Jobs Scheduling under a Deadline

An ACO-based Approach to Improve C-means Clustering Algorithm

DGSchedSim: a trace-driven simulator to evaluate scheduling algorithms for desktop grid environments

A CPU-GPGPU Scheduler Based on Data Transmission Bandwidth of Workload

Dynamic task scheduling in computing cluster environments

Single-Snapshot File System Analysis

An Efficient Approach to Higher Dimensional Data Clustering

Simulation and performance comparison of four disk scheduling algorithms

CDES: An Approach to HPC Workload Modelling