NDLI: Elastic Scaling of e-Infrastructures to Support Data-Intensive Research Collaborations

Content Provider	IEEE Xplore Digital Library
Author	Nino-Ruiz, M. Bayliss, C. Galang, G. Grazioli, G. Rabanal, R. Tomko, M. Sinnott, R.O.
Copyright Year	2014
Description	Author affiliation: Dept. of Comput. & Inf. Syst., Univ. of Melbourne, Melbourne, VIC, Australia (Nino-Ruiz, M.; Bayliss, C.; Galang, G.; Grazioli, G.; Rabanal, R.; Tomko, M.; Sinnott, R.O.)
Abstract	For many research endeavours, e-Infrastructures need to provide predictable, on-demand access to large-scale computational resources with high data availability. These need to scale with the research communities requirements and use. One example of such an e-Infrastructure is the Australian Urban Research Infrastructure Network (AURIN -- www.aurin.org.au) project, which supports Australia-wide research in and across the urban and built environment. This paper describes the architecture of the AURIN infrastructure and its support for access to distributed (federated) and highly heterogeneous data sets from a wide range of providers. We present how this architecture solution leverages the intersection of high throughput computing (HTC), infrastructure as a service (IaaS) Cloud services and big data technologies including use of NoSQL resources. The driving concept in this architecture and the focus of this paper is the ability for scaling up or down depending on resource demands at any given time. This is done automatically and on demand avoiding either under-or over-utilization of resources. This resource-optimization-driven infrastructure has been designed to ensure that peak loads can be predicted and successfully coped with, as well as avoid wasting resources during non-peak times. This overall management strategy has resulted in an e-Infrastructure that provides a flexible, evolving research environment that scales with research needs, rather than providing a rigid (static) end product.
Starting Page	55
Ending Page	61
File Size	478289
Page Count	7
File Format	PDF
ISBN	9781479942886
e-ISBN	9781479942879
DOI	10.1109/eScience.2014.13
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2014-10-20
Publisher Place	Brazil
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Cloud computing Java e-Infrastructure resource optimization Software as a service Distributed databases Computer architecture distributed system cloud bursting cloud management Australia Resource management
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Applications of Provenance Data for Cloud Infrastructure

Greenhead: Virtual Data Center Embedding across Distributed Infrastructures

SLA-Based Profit Optimization in Cloud Bursting PaaS

Extended Service Registry for Distributed Computing Support in OSGi Architecture

A Self-Organizing Architecture for Cloud by Means of Infrastructure Performance and Event Data

A Framework for Data-Intensive Computing with Cloud Bursting

BIGhybrid -- A Toolkit for Simulating MapReduce in Hybrid Infrastructures

RESERVOIR: Management technologies and requirements for next generation Service Oriented Infrastructures

Cloud Storage Infrastructure Optimization Analytics

Elastic Scaling of e-Infrastructures to Support Data-Intensive Research Collaborations

Similar Documents

Applications of Provenance Data for Cloud Infrastructure

Greenhead: Virtual Data Center Embedding across Distributed Infrastructures

SLA-Based Profit Optimization in Cloud Bursting PaaS

Extended Service Registry for Distributed Computing Support in OSGi Architecture

A Self-Organizing Architecture for Cloud by Means of Infrastructure Performance and Event Data

A Framework for Data-Intensive Computing with Cloud Bursting

BIGhybrid -- A Toolkit for Simulating MapReduce in Hybrid Infrastructures

RESERVOIR: Management technologies and requirements for next generation Service Oriented Infrastructures

Cloud Storage Infrastructure Optimization Analytics

Elastic Scaling of e-Infrastructures to Support Data-Intensive Research Collaborations