NDLI: An efficient framework for distributed computing in heterogeneous Beowulf clusters and cluster-management

Content Provider	IEEE Xplore Digital Library
Author	Malysiak, Darius Handmann, Uwe
Copyright Year	2014
Description	Author affiliation: Hochschule Ruhr West Computer Science Institute Bottrop, Germany (Malysiak, Darius; Handmann, Uwe)
Abstract	In the context of existing approaches to cluster computing we present a newly developed modular framework ‘SimpleHydra’ for rapid deployment and management of Beowulf clusters. Instead of focusing only the pure computation tasks on homogeneous clusters (i.e. clusters with identically set up nodes), this framework aims to ease the configuration of heterogeneous clusters and to provide a low-level / high-level object-oriented API for low-latency distributed computing. Our framework does not make any restrictions regarding the hardware and minimizes the use of external libraries to the case of special modules. In addition to that our framework enables the user to develop highly dynamic cluster topologies. We describe the framework's general structure as well as time critical elements, give application examples in the ‘Big-Data’ context during a research project and briefly discuss additional features. Furthermore we give a thorough theoretical time/space complexity analysis of our implemented methods and general approaches.
Starting Page	169
Ending Page	178
File Size	358792
Page Count	10
File Format	PDF
ISBN	9781479953387
DOI	10.1109/CINTI.2014.7028670
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2014-11-19
Publisher Place	Hungary
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Sockets Instruction sets Cluster management Be-owulf cluster Hardware Libraries Complexity theory Topology Load balancing Distributed computing Efficient distribution Payloads
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

A framework for distributed computation over a heterogeneous beowulf cluster.

A Framework for Distributed Computation Over a Heterogeneous Beowulf Cluster. Abstract

Load Redistribution in Heterogeneous Systems

Adaptive Load-Balancing for Consistent Hashing in Heterogeneous Clusters

Managing the topology of heterogeneous cluster nodes with hardware locality (hwloc)

Decentralized Load Balancing for Heterogeneous Grids

Data allocation and load balancing for heterogeneous cluster storage systems

© 2007 science publications a framework for distributed dynamic load balancing in heterogeneous cluster.

Static Load-Balancing Techniques For Iterative Computations On Heterogeneous Clusters (2003)

An efficient framework for distributed computing in heterogeneous Beowulf clusters and cluster-management

Similar Documents

A framework for distributed computation over a heterogeneous beowulf cluster.

A Framework for Distributed Computation Over a Heterogeneous Beowulf Cluster. Abstract

Load Redistribution in Heterogeneous Systems

Adaptive Load-Balancing for Consistent Hashing in Heterogeneous Clusters

Managing the topology of heterogeneous cluster nodes with hardware locality (hwloc)

Decentralized Load Balancing for Heterogeneous Grids

Data allocation and load balancing for heterogeneous cluster storage systems

© 2007 science publications a framework for distributed dynamic load balancing in heterogeneous cluster.

Static Load-Balancing Techniques For Iterative Computations On Heterogeneous Clusters (2003)

An efficient framework for distributed computing in heterogeneous Beowulf clusters and cluster-management