NDLI: HiPERS Batch.NET - a high performance, extensible, reliable and scalable batch framework using Microsoft.NET

Please wait, while we are loading the content...

A robust neural network classifier to model the compressive strength of high performance concrete using feature subset selection

Scalable lock-free FIFO queues using efficient elimination techniques

A review of path planning and mapping technologies for autonomous mobile robot systems

Multimodal biometric system based on hand geometry, palmprint and signature

A generic topology discovery approach for huge social networks

Mining research abstracts for exploration of research communities

GPU implementation of a novel hybrid lattice Boltzmann method for non-isothermal flows

Upper body pose recognition and classifier

RobExT: a tool to customize microarray data for CellDesigner and Cytoscape

Insertion and querying mechanism for a distributed XML database system

Texture edge statistics for efficient retrieval of biomedical images

Enabling high performance computing using Microsoft HPC server

A knowledge-based formalization of UBL processes using hybrid programs

FIRA - a novel method for benchmarking the cache hierarchy

Automatic gazette creation for named entity recognition and application to resume processing

Reconstructing the software environment of an experiment with kameleon

Email marketing and scalability using Hadoop

A formal model for multi-tenant software-as-a-service in cloud computing

HiPERS Batch.NET - a high performance, extensible, reliable and scalable batch framework using Microsoft.NET

Efficient web data classification techniques using semi-supervise learning algorithm

HiPERS Batch.NET - a high performance, extensible, reliable and scalable batch framework using Microsoft.NET

Content Provider	ACM Digital Library
Author	Lakshmanan, Gayatri
Abstract	Batch jobs are the back bone of IT functionality in all industries. Typically these jobs are executed overnight, after "End of Day/Week/Month/Year" and perform business critical processing of huge amounts of data, to bring software systems up-to-date for the next day's business. Due to the huge processing requirements, batch systems have been traditionally implemented in legacy Mainframe environments. These systems are costly to develop and maintain, and require manpower skilled in what is fast becoming an obsolete platform. In this paper, I propose HiPERS Batch- a simple multi-server batch framework which: (i) is High in Performance -- can match the processing power of legacy batch systems, (ii) is Extensible - accommodates new batch business functionalities without code change, (iii) is Reliable -- recovers from failures and resumes processing from the correct point, and (iv) is Scalable -- easily handles growing volumes of business data by accommodating increasing number of servers in its configuration without performance degradation. HiPERS Batch exploits the data and task level parallelism inherent in batch functionality. A salient feature of HiPERS multi server batch framework is that the communication between the servers takes place solely through the database -- this does not impact performance as is commonly believed. As part of work done for a large Insurer, HiPERS Batch was implemented using Microsoft"s.NET framework 2.0 (HiPERS Batch.NET) with virtual servers of modest specifications (no more powerful than a modern day laptop) to replace a powerful legacy mainframe batch system; the results of this implementation, as shown in this paper, prove that HiPERS Batch is a viable framework for a modern batch system.
Starting Page	1
Ending Page	8
Page Count	8
File Format	PDF
ISBN	9781450314404
DOI	10.1145/2459118.2459137
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2012-01-23
Publisher Place	New York
Access Restriction	Subscribed
Subject Keyword	Data parallelism Hipers batch Task parallelism Scalable High performance batch Microsoft .net Batch processing
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Task Parallelism in a High Performance Fortran Framework (1994)

RanKloud: a scalable ranked query processing framework on hadoop (2011)

A Distributed Virtual Machine for Microsoft .NET

.NET 4 for enterprise architects and developers

Extensible Architecture for High-Performance, Scalable, Reliable PublishSubscribe Eventing and Notification (2006)

A scalable task parallelism approach for LU decomposition with multicore CPUs

Multicore programming techniques for high-performance ATE

Scalable Anomaly Detection on Data Stream Processing with GPU Task Parallelism

TPS development using the Microsoft .NET Framework

HiPERS Batch.NET - a high performance, extensible, reliable and scalable batch framework using Microsoft.NET

Similar Documents

Task Parallelism in a High Performance Fortran Framework (1994)

RanKloud: a scalable ranked query processing framework on hadoop (2011)

A Distributed Virtual Machine for Microsoft .NET

.NET 4 for enterprise architects and developers

Extensible Architecture for High-Performance, Scalable, Reliable PublishSubscribe Eventing and Notification (2006)

A scalable task parallelism approach for LU decomposition with multicore CPUs

Multicore programming techniques for high-performance ATE

Scalable Anomaly Detection on Data Stream Processing with GPU Task Parallelism

TPS development using the Microsoft .NET Framework

HiPERS Batch.NET - a high performance, extensible, reliable and scalable batch framework using Microsoft.NET