NDLI: Running many molecular dynamics simulations on many supercomputers

Please wait, while we are loading the content...

A distributed memory out-of-core method on HPC clusters and its application to quantum chemistry applications

High accuracy gravitational waveforms from black hole binary inspirals using OpenCL

Exploring similarities among many species distributions

Computational science certificates for the current workforce: lessons learned

Security for science gateways and campus bridging: XSEDE12 panel

Running many molecular dynamics simulations on many supercomputers

Transforming molecular biology research through extreme acceleration of AMBER molecular dynamics simulations: sampling for the 99%

The CIPRES science gateway: enabling high-impact science for phylogenetics researchers with limited resources

A blended, multimodal access eTextBook in computational physics

SaaS for science: the path to reality for research in the cloud

Gordon: design, performance, and experiences deploying and supporting a data intensive supercomputer

Membrane protein simulations under asymmetric ionic concentrations

Roadmaps, not blueprints: paving the way to science gateway success

Longitudinal user and usage patterns in the XSEDE user community

Campus bridging pilot project reports: XSEDE12 panel

Radiation modeling using the Uintah heterogeneous CPU/GPU runtime system

Benchmark calculations for multi-photon ionization of the hydrogen molecule and the hydrogen molecular ion by short-pulse intense laser radiation

Offline parallel debugging: a case study report

Cloud-enabling biological simulations for scalable and sustainable access: an experience report

Managing the long tail of science: data and communities

An analysis of GPU utilization trends on the Keeneland initial delivery system

Electrostatic screening effects on a model system for molecular electronics

Ultrascan solution modeler: integrated hydrodynamic parameter and small angle scattering computation and fitting tools

Conducting K-12 outreach to evoke early interest in IT, science, and advanced technology

A tale of two systems: flexibility of usage of Kraken and Nautilus at the National Institute for Computational Sciences

Exploiting HPC resources for the 3D-time series analysis of caries lesion activity

The Prickly Pear Archive: a portable hypermedia for scholarly publication

Computing MATTERS: building pathways to cyberinfrastructure

A framework for federated two-factor authentication enabling cost-effective secure access to distributed cyberinfrastructure

Multiscale simulations of Langmuir cells and submesoscale eddies using XSEDE resources

Mojave: a development environment for the Cactus computational framework

Enhancing chemistry teaching and learning through cyberinfrastructure

A systematic process for efficient execution on Intel's heterogeneous computation nodes

Comparing the performance of group detection algorithm in serial and parallel processing environments

Trinity RNA-Seq assembler performance optimization

Using stereoscopic 3D videos to inform the public about the benefits of computational science

Evaluation of parallel and distributed file system technologies for XSEDE

High performance mining of social media data

The anatomy of successful ECSS projects: lessons of supporting high-throughput high-performance ensembles on XSEDE

WaterHUB: a resource for students and educators for learning hydrology

Achieve better performance with PEAK on XSEDE resources

Massively parallel direct numerical simulations of forced compressible turbulence: a hybrid MPI/OpenMP approach

What is campus bridging and what is XSEDE doing about it?

A learning outcome driven cyber infrastructure for thermodynamics education

Analyzing throughput and utilization on trestles

Quantum algorithms for predicting the properties of complex materials

The Eclipse parallel tools platform: toward an integrated development environment for XSEDE resources

FutureGrid education: using case studies to develop a curriculum for communicating parallel and distributed computing concepts

Using kerberized lustre over the WAN for high energy physics data

Monte Carlo strategies for first-principles simulations of elemental systems

Enabling large-scale scientific workflows on petascale resources using MPI master/worker

The initial role of evaluation in a large-scale multi-site project

The data supercell

Computational challenges in nanoparticle partition function calculation

Campus bridging made easy via Globus services

Minority student involvement in computational science research at Texas Southern University

Ensemble modeling of storm interaction with XSEDE

Building a partnership for computer science education

Excited states in lattice QCD using the stochastic LapH method

Multiple concurrent queries on demand: large scale video analysis in a flash memory environment as a case for humanities supercomputing

A toolkit for the analysis and visualization of free volume in materials

Three-dimensional simulations of geometrically complex subduction with large viscosity variations

Multiscale modeling of high explosives for transportation accidents

Multiscale simulations of blood-flow: from a platelet to an artery

A high throughput workflow environment for cosmological simulations

Using the XSEDE supercomputing and visualization resources to improve tornado prediction using data mining

Optimization of density functional tight-binding and classical reactive molecular dynamics for high-throughput simulations of carbon materials

Extending parallel scalability of LAMMPS and multiscale reactive molecular simulations

Running many molecular dynamics simulations on many supercomputers

Content Provider	ACM Digital Library
Author	Mukherjee, Rajib Thota, Abhinav Jha, Shantenu Fujioka, Hideki Bishop, Thomas C.
Abstract	The challenges facing biomolecular simulations are many-fold. In addition to long time simulations of a single large system, an important challenge is the ability to run a large number of identical copies (ensembles) of the same system. Ensemble-based simulations are important for effective sampling. Due to the low-level of coupling between them, ensemble-based simulations are good candidates to utilize distributed cyberinfrastructure. The problem for the practitioner is thus effectively marshaling thousands if not millions of high-performance simulations on distributed cyberinfrastructure. Here we assess the ability of an interoperable and extensible pilot-job tool (BigJob), to support high-throughput simulations of high-performance molecular dynamics simulations across distributed supercomputing infrastructure. BigJob provides the capability to run hundreds or thousands of MPI ensembles concurrently. This is advantageous on large machines because it reduces the number of submissions to the queue, thereby reducing the overall waiting time in the queue. The wait time problem is further complicated by scheduling policies on some large XSEDE machines that prioritize large job requests over very small or single core job requests. Using a nucleosome positioning problem as an exemplar, we demonstrate how we have addressed this challenge on the TeraGrid/XSEDE. Specifically, we compute 336 independent trajectories of 20 ns each. Each trajectory is divided into twenty 1 ns long simulation tasks. A single task requires ≈ 42 MB of input, 9 hours of compute time on 32 cores, and generates 3.8 GB of data. In total we have 6,720 tasks (6.7 μs) and approximately 25 TB to manage. There is natural task-level concurrency, as these 6,720 tasks can be executed with 336-way task concurrency. This project requires approximately 2 million hours of CPU time and could be completed in just over 1 month on a dedicated supercomputer containing 3,000 cores. In practice, even such a modest supercomputer is a shared resource and our experience suggests that a simple scheme to automatically batch queue the tasks, might require several years to complete the project. In order to reduce the total time-to-completion, we need to scale-up, out and across various resources. Our approach is to aggregate many ensemble members into pilot-jobs, distribute pilot-jobs over multiple compute resources concurrently, and dynamically assign tasks across the available resources. Here we report the computational methodology employed in our study and refrain from analyzing the biological aspects of the simulations.
Starting Page	1
Ending Page	9
Page Count	9
File Format	PDF
ISBN	9781450316026
DOI	10.1145/2335755.2335787
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2012-07-16
Publisher Place	New York
Access Restriction	Subscribed
Subject Keyword	Experience Technology Md Xsede resources Hpc Large scale Distributed computing Namd
Content Type	Text
Resource Type	Article

Central Library (ISO-9001:2015 Certified)
Indian Institute of Technology Kharagpur
Kharagpur, West Bengal, India | PIN - 721302

See location in the Map
03222 282435
Mail: support@ndl.gov.in

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in