NDLI: An Architecture for Automatic Deployment of Brown Dog Services at Scale into Diverse Computing Infrastructures

Please wait, while we are loading the content...

Image Analysis and Infrastructure Support for Data Mining the Farm Security Administration: Office of War Information Photography Collection

Jetstream: performance, early experiences, and early results

An Architecture for Automatic Deployment of Brown Dog Services at Scale into Diverse Computing Infrastructures

An Agile Approach for Engaging Students in Research and Development

Visualization of Geodynamo Simulations

UrbanFlow: Large-scale Framework to Integrate Social Media and Authoritative Landuse Maps

Experiences and Benefits of Running RDMA Hadoop and Spark on SDSC Comet

In-memory Integration of Existing Software Components for Parallel Adaptive Unstructured Mesh Workflows

Assisting Bioinformatics Programs at Minority Institutions: Needs Assessment, and Lessons Learned -- A Look at an Internship Program

Insights into Alzheimer's Disease: Molecular Dynamics (MD) Simulations of Peptide-Membrane Interactions

Accelerating TauDEM for Extracting Hydrology Information from National-Scale High Resolution Topographic Dataset: Extended Abstract

User Managed Virtual Clusters in Comet

A Virtual File System for On-Demand Processing of Multidimensional Datasets

Challenges and Accomplishments of the Computational Science Undergraduate Research Experiences Program

Time Propagation of Partial Differential Equations Using the Short Iterative Lanczos Method and Finite-Element Discrete Variable Representation: An Experiment Using the Intel Phi Coprocessors: Extended Abstract

Containers in Research: Initial Experiences with Lightweight Infrastructure

Optimization of 3D Fusion Devices

Orion: Discovery Environment for HPC Research and Bridging XSEDE Resources

Optimization and parallel load balancing of the MPAS Atmosphere Weather and Climate Code

An Overview of the Implementation of CILogon at NICS

CloudBridge: a Simple Cross-Cloud Python Library

XSEDE Training: Achieving Access and Inclusion

Optimization of non-linear image registration in AFNI

Globus: Recent Enhancements and Future Plans

Introducing a New Client/Server Framework for Big Data Analytics with the R Language

Rescuing Lost History: Using Big Data to Recover Black Women's Lived Experiences

A Parallel Evolutionary Algorithm for Subset Selection in Causal Inference Models

BIC-LSU: Big Data Research Integration with Cyberinfrastructure for LSU

TopoLens: Building a CyberGIS Community Data Service for Enhancing the Usability of High-resolution National Topographic Datasets

The Advanced Cyberinfrastructure Research and Education Facilitators Virtual Residency: Toward a National Cyberinfrastructure Workforce

Three Dimensional Simulations of Fluid Flow and Heat Transfer with Spectral Element Method

Developing Applications with Networking Capabilities via End-to-End SDN (DANCES)

Anatomy of the SEAGrid Science Gateway

Performance and Scalability Analysis for Parallel Reservoir Simulations on Three Supercomputer Architectures

Library Function Tracking with XALT

The XSEDE BLAST Gateway: Leveraging Campus Development for the XSEDE Community

Implementation of Simple XSEDE-Like Clusters: Science Enabled and Lessons Learned

A web interface for XALT log data analysis

Extended Batch Sessions and Three-Phase Debugging: Using DMTCP to Enhance the Batch Environment

A Scalable High-performance Topographic Flow Direction Algorithm for Hydrological Information Analysis

A Quantitative Analysis of Node Sharing on HPC Clusters Using XDMoD Application Kernels

Open OnDemand: Transforming Computational Science Through Omnidisciplinary Software Cyberinfrastructure

Using High Performance Computing to Model Cellular Embryogenesis

From OpenACC to OpenMP 4: Toward Automatic Translation

Delayed Update Algorithms for Quantum Monte Carlo Simulation on GPU: Extended Abstract

Understanding the Evolving Cyberinfrastructure Needs of the Neuroscience Community

Efficient Primitives for Standard Tensor Linear Algebra

User behavior and usage patterns for a highly accessed science gateway

Tools for studying populations and timeseries of neuroanatomy enabled through GPU acceleration in the Computational Anatomy Gateway

Case Study: Microservice Evolution and Software Lifecycle of the XSEDE User Portal API

Minimization of Xeon Phi Core Use with Negligible Execution Time Impact

SeedMe: A scientific data sharing and collaboration platform

Computational Considerations in Transcriptome Assemblies and Their Evaluation, using High Quality Human RNA-Seq data

Practical Monitoring of Resource Utilization for HPC Applications

Estimating the Accuracy of User Surveys for Assessing the Impact of HPC Systems

The 10 Attributes that Drive Adoption and Diffusion of Computational Tools in E-Science

Cross-Accelerator Performance Profiling

Improving the Scalability of a Charge Detection Mass Spectrometry Workflow

Scaling GIS analysis tasks from the desktop to the cloud utilizing contemporary distributed computing and data management approaches: A case study of project-based learning and cyberinfrastructure concepts

An Architecture for Automatic Deployment of Brown Dog Services at Scale into Diverse Computing Infrastructures

Content Provider	ACM Digital Library
Author	Padhy, Smruti Satheesan, Sandeep Puthanveetil Slavenas, Marcus Alameda, Jay Kumar, Praveen McHenry, Kenton Lee, Jong Sullivan, William Dietze, Michael C. Liu, Rui Navarro, Chris Marciano, Richard Marini, Luigi Zharnitsky, Inna Minsker, Barbara Kooper, Rob Jansen, Gregory
Abstract	Brown Dog is an extensible data cyberinfrastructure, that provides a set of extensible and distributed data conversion and metadata extraction services to enable access and search within unstructured, un-curated and inaccessible research data across different domains of sciences and social science, which ultimately aids in supporting reproducibility of results. We envision that Brown Dog, as a data cyberinfrastructure, is an essential service in a comprehensive cyberinfrastructure which includes data services, high performance computing services and more that would enable scholarly research in a variety of disciplines that today is not yet possible. Brown Dog focuses on four initial use cases, specifically, addressing the conversion and extraction needs in the research areas of ecology, civil and environmental engineering, library and information science, and use by the general public. In this paper, we describe an architecture that supports contribution of data transformation tools from users, and automatic deployment of the tools as Brown Dog services in diverse infrastructures such as cloud or high performance computing (HPC) based on user demands and load on the system. We also present results validating the performance of the initial implementation of Brown Dog.
Starting Page	1
Ending Page	8
Page Count	8
File Format	PDF
ISBN	9781450347556
DOI	10.1145/2949550.2949647
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2016-07-17
Publisher Place	New York
Access Restriction	Subscribed
Subject Keyword	Civil and environmental engineering Autocuration Data conversion Metadata extraction Data cyberinfrastructure Library and information science Cloud Elasticity Ecology Hpc Digital preservation
Content Type	Text
Resource Type	Article

Central Library (ISO-9001:2015 Certified)
Indian Institute of Technology Kharagpur
Kharagpur, West Bengal, India | PIN - 721302

See location in the Map
03222 282435
Mail: support@ndl.gov.in

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in