NDLI: TDWS: A Job Scheduling Algorithm Based on MapReduce

Please wait, while we are loading the content...

2015 IEEE International Conference on Networking, Architecture and Storage (NAS)

2014 9th IEEE International Conference on Networking, Architecture, and Storage

2013 IEEE Eighth International Conference on Networking, Architecture and Storage

2012 IEEE Seventh International Conference on Networking, Architecture, and Storage

Table of contents

Program Committee

Integrated System and Process Crash Recovery in the Loris Storage Stack

A Reliability Optimization Method Using Disk Reliability Degree and Data Heat Degree

Two Efficient Partial-Updating Schemes for Erasure-Coded Storage Clusters

An Anomaly Detection Algorithm Based on Lossless Compression

Designing Click-Draw Based Graphical Password Scheme for Better Authentication

A General Framework of Trojan Communication Detection Based on Network Traces

Parallel Sparse Matrix Multiplication for Preconditioning and SSTA on a Many-Core Architecture

Implementing the Jacobi Algorithm for Solving Eigenvalues of Symmetric Matrices with CUDA

C-IRR: An Adaptive Engine for Cloud Storage Provisioning Determined by Economic Models with Workload Burstiness Consideration

Investigating an Open Source Cloud Storage Infrastructure for CERN-specific Data Analysis

Magicube: High Reliability and Low Redundancy Storage Architecture for Cloud Computing

CHAC: An Effective Attribute Clustering Algorithm for Large-Scale Data Processing

INBI: An Improved Network-Based Inference Recommendation Algorithm

Optimizing Bandwidth by Employing MPLS AToM with QoS Support

Bitline Leakage Current Compensation Circuit for High-Performance SRAM Design

Making Garbage Collection Wear Conscious for Flash SSD

An Empirical Study on the Interplay between Filesystems and SSD

GC-ARM: Garbage Collection-Aware RAM Management for Flash Based Solid State Drives

IVI-based Locator/ID Separation Architecture for IPv4/IPv6 Transition

A Hardware-Based TCP Stream State Tracking and Reassembly Solution for 10G Backbone Traffic

An In-Depth Analysis of TCP and RDMA Performance on Modern Server Platform

Novel O-GEHL Based Hyperblock Predictor for EDGE Architectures

PSA-NUCA: A Pressure Self-Adapting Dynamic Non-uniform Cache Architecture

A Transparent Control-Flow Based Approach to Record-Replay Non-deterministic Bugs

Co-located Compute and Binary File Storage in Data-Intensive Computing

Efficient and Accurate Anomaly Identification Using Reduced Metric Space in Utility Clouds

A Quantitative Evaluation Model for Choosing Efficient Redundancy Strategies over Clouds

Performance Evaluation of Traditional Caching Policies on a Large System with Petabytes of Data

Towards Energy Optimization Using Joint Data Rate Adaptation for BSN and WiFi Networks

MOLTS: Mobile Object Localization and Tracking System Based on Wireless Sensor Networks

A Queue-Length-Based Detection Scheme for Urban Traffic Congestion by VANETs

The Lustre File System and 100 Gigabit Wide Area Networking: An Example Case from SC11

Wear-Resistant Hybrid Cache Architecture with Phase Change Memory

A Novel HW/SW Partitioning with SIMD Instructions for AVS Video Decoder

Self-Aligning Return Address Stack

Improving the Performance of On-Board Cache for Flash-Based Solid-State Drives

Dataset Management-Aware Software Architecture for Storage Systems Based on SSDs

A Parity Scheme to Enhance Reliability for SSDs

Measurements Study on the I/O Performance of Virtualized Cloud System

AESOP: Expressing Concurrency in High-Performance System Software

TDWS: A Job Scheduling Algorithm Based on MapReduce

A Multi-VC Dynamically Shared Buffer with Prefetch for Network on Chip

SAR: SSD Assisted Restore Optimization for Deduplication-Based Storage Systems in the Cloud

P-Dedupe: Exploiting Parallelism in Data Deduplication System

On Accuracy of Early Traffic Classification

2011 IEEE Sixth International Conference on Networking, Architecture, and Storage

2010 IEEE Fifth International Conference on Networking, Architecture, and Storage

2009 IEEE International Conference on Networking, Architecture, and Storage

2008 International Conference on Networking, Architecture, and Storage

2007 International Conference on Networking, Architecture, and Storage (NAS 2007)

TDWS: A Job Scheduling Algorithm Based on MapReduce

Content Provider	IEEE Xplore Digital Library
Author	Yanrong Zhao Weiping Wang Dan Meng YongChun Lv Shubin Zhang Jun Li
Copyright Year	2012
Abstract	As organizations start to use data intensive cluster computing systems like Hadoop MapReduce to handle large-scale data, scheduling of jobs become very important in order to achieve efficiency. In the default implementations of Hadoop MapReduce, jobs are scheduled in FIFO order. It easily causes the starvation of small jobs in the event of resources being utilized by large jobs, while Fair Scheduler is inefficient when handling large jobs and it leads to sticky slots problem. In this paper, we proposed a new job scheduling algorithm TDWS. The scheduling algorithm takes account characters of different applications to meet their different needs. In addition, it is also highly robust to heterogeneity and easy to achieve optimal data locality. The experiments demonstrate the feasibility and efficiency of our solution.
Starting Page	313
Ending Page	319
File Size	534476
Page Count	7
File Format	PDF
ISBN	9781467318891
e-ISBN	9780769547220
DOI	10.1109/NAS.2012.50
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2012-06-28
Publisher Place	China
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Scheduling algorithms Heart beat mapreduce Memory management Scheduling TDWS hadoop Delay
Content Type	Text
Resource Type	Article

Central Library (ISO-9001:2015 Certified)
Indian Institute of Technology Kharagpur
Kharagpur, West Bengal, India | PIN - 721302

See location in the Map
03222 282435
Mail: support@ndl.gov.in

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in