NDLI: ZOID: I/O-forwarding infrastructure for petascale architectures

Please wait, while we are loading the content...

Compilers and parallel computing systems

Automatic data movement and computation mapping for multi-level parallel architectures with explicitly managed memories

Scalable packet classification using interpreting: a cross-platform multi-core solution

Matrix product on heterogeneous master-worker platforms

Optimization principles and application performance evaluation of a multithreaded GPU using CUDA

Performance without pain = productivity: data layout and collective communication in UPC

SuperMatrix: a multithreaded runtime scheduling system for algorithms-by-blocks

Nested parallelism in transactional memory

Split hardware transactions: true nesting of transactions using best-effort hardware transactional memory

Toward high performance nonblocking software transactional memory

Where will all the threads come from?

Experiences using adaptive concurrency in transactional memory with Lee's routing algorithm

Type inference for locality analysis of distributed data structures

FastForward for efficient pipeline parallelism: a cache-optimized concurrent lock-free queue

High performance dense linear algebra on a spatially distributed processor

Massive parallel LDPC decoding on GPU

Programming with tiles

Design and implementation of a high-performance MPI for C# and the common language infrastructure

On the correctness of transactional memory

Transactional boosting: a methodology for highly-concurrent transactional objects

Dynamic performance tuning of word-based software transactional memory

An adaptive memory conscious approach for mining frequent trees: implications for multi-core architectures

Quasi-static scheduling for safe futures

A case study in SIMD text processing with parallel bit streams: UTF-8 to UTF-16 transcoding

A portable runtime interface for multi-level memory hierarchies

Modeling optimistic concurrency using quantitative dependence analysis

Concurrent GC leveraging transactional memory

Software transactional memory for large scale clusters

All-window profiling of concurrent executions

ZOID: I/O-forwarding infrastructure for petascale architectures

Assertional reasoning about data races in relaxed memory models

Cache-aware iteration space partitioning

Compiler optimizations for parallelizing general-purpose applications under thread-level speculation

Automated application-level checkpointing based on live-variable analysis in MPI programs

Compiler-enhanced incremental checkpointing for OpenMP applications

Enhancing the performance of MPI-IO applications by overlapping I/O, computation and communication

Experience on optimizing irregular computation for memory hierarchy in manycore architecture

Extracting coarse-grain parallelism in general-purpose programs

Formal specification of the MPI-2.0 standard in TLA+

ISP: a tool for model checking MPI programs

Practical experiences with Java software transactional memory

Probabilistic advanced reservations for batch-scheduled parallel machines

Safer open-nested transactions through ownership

Semantics-based distributed I/O for mpiBLAST

ZOID: I/O-forwarding infrastructure for petascale architectures

Content Provider	ACM Digital Library
Author	Iskra, Kamil Yoshii, Kazutomo Beckman, Pete Romein, John W.
Abstract	The ZeptoOS project is developing an open-source alternative to the proprietary software stacks available on contemporary massively parallel architectures. The aim is to enable computer science research on these architectures, enhance community collaboration, and foster innovation. In this paper, we introduce a component of ZeptoOS called ZOID---an I/O-forwarding infrastructure for architectures such as IBM Blue Gene that decouple file and socket I/O from the compute nodes, shipping those functions to dedicated I/O nodes. Through the use of optimized network protocols and data paths, as well as a multithreaded daemon running on I/O nodes, ZOID provides greater performance than does the stock infrastructure. We present a set of benchmark results that highlight the improvements. Crucially, the flexibility of our infrastructure is a vast improvement over the stock infrastructure, allowing users to forward data using custom-designed application interfaces, through an easy-to-use plug-in mechanism. This capability is used for real-time telescope data transfers, extensively discussed in the paper. Plug-in--specific threads implement prefetching of data obtained over sockets from an input cluster and merge results from individual compute nodes before sending them out, significantly reducing required network bandwidth. This approach allows a ZOID version of the application to handle a larger number of subbands per I/O node, or even to bypass the input cluster altogether, plugging the input from remote receiver stations directly into the I/O nodes. Using the resources more efficiently can result in considerable savings.
Starting Page	153
Ending Page	162
Page Count	10
File Format	PDF
ISBN	9781595937957
DOI	10.1145/1345206.1345230
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2008-02-20
Publisher Place	New York
Access Restriction	Subscribed
Subject Keyword	I/o forwarding Petascale
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

ZOID: I/Oforwarding infrastructure for petascale architectures (2008)

SRC: Damaris - using dedicated i/o cores for scalable post-petascale HPC simulations

Petascale I/O using HDF-5

An Optimizing Compiler for Petascale I/O on Leadership Class Architectures

An Optimizing Compiler for Petascale I/O on Leadership-Class Architectures

A layout-aware optimization strategy for collective I/O

Optimizing I/O forwarding techniques for extreme-scale event tracing

Optimizing I/O for Petascale Seismic Simulations on Unstructured Meshes

Enabling event tracing at leadership-class scale through I/O forwarding middleware

ZOID: I/O-forwarding infrastructure for petascale architectures

Similar Documents

ZOID: I/Oforwarding infrastructure for petascale architectures (2008)

SRC: Damaris - using dedicated i/o cores for scalable post-petascale HPC simulations

Petascale I/O using HDF-5

An Optimizing Compiler for Petascale I/O on Leadership Class Architectures

An Optimizing Compiler for Petascale I/O on Leadership-Class Architectures

A layout-aware optimization strategy for collective I/O

Optimizing I/O forwarding techniques for extreme-scale event tracing

Optimizing I/O for Petascale Seismic Simulations on Unstructured Meshes

Enabling event tracing at leadership-class scale through I/O forwarding middleware

ZOID: I/O-forwarding infrastructure for petascale architectures