NDLI: Kernel-Assisted MPI Collective Communication among Many-core Clusters

Please wait, while we are loading the content...

Message from the General Chair

Message from the Program Co-Chairs

External Reviewers

Keynote Addresses

Design and Implementation of Portable and Efficient Non-blocking Collective Communication

Productive Parallel Linear Algebra Programming with Unstructured Topology Adaption

User Transparent Data and Task Parallel Multimedia Computing with Pyxis-DT

CEFLS: A Cost-Effective File Lookup Service in a Distributed Metadata File System

Fine-Grained Access Control in the Chirp Distributed File System

Towards Trusted Services: Result Verification Schemes for MapReduce

MARLA: MapReduce for Heterogeneous Clusters

A Map-Reduce Based Framework for Heterogeneous Processing Element Cluster Environments

Workflow Scheduling to Minimize Data Movement Using Multi-constraint Graph Partitioning

Decentralized Orchestration of Data-centric Workflows Using the Object Modeling System

Efficient Disk I/O Scheduling with QoS Guarantee for Xen-based Hosting Platforms

MORPHOSYS: Efficient Colocation of QoS-Constrained Workloads in the Cloud

Reward Scheduling for QoS in Cloud Applications

Evaluating Dynamics and Bottlenecks of Memory Collaboration in Cluster Systems

Energy- and Cost-Efficiency Analysis of ARM-Based Clusters

Transparent Accelerator Migration in a Virtualized GPU Environment

GPU Performance Enhancement via Communication Cost Reduction: Case Studies of Radix Sort and WSN Relay Node Placement Problem

Scheduling Concurrent Applications on a Cluster of CPU-GPU Nodes

A Highly Parallel Multi-class Pattern Classification on GPU

Client Classification Policies for SLA Enforcement in Shared Cloud Datacenters

Policy-Based Automation of SLA Establishment for Cloud Computing Services

SLA-based Optimization of Power and Migration Cost in Cloud Computing

Service Level Agreement for Distributed Mutual Exclusion in Cloud Computing

On Urgency of I/O Operations

Boosting Application-Specific Parallel I/O Optimization Using IOSIG

SERA-IO: Integrating Energy Consciousness into Parallel I/O Middleware

Supporting User-Defined Subsetting and Aggregation over Parallel NetCDF Datasets

Scalable Multi-purpose Network Representation for Large Scale Distributed System Simulation

Topology Agnostic Dynamic Quick Reconfiguration for Large-Scale Interconnection Networks

Scalable Memcached Design for InfiniBand Clusters Using Hybrid Transports

Lowering Inter-datacenter Bandwidth Costs via Bulk Data Scheduling

A Scalable Parallel Debugging Library with Pluggable Communication Protocols

Task Scheduling Algorithm for Multicore Processor System for Minimizing Recovery Time in Case of Single Node Fault

Speculative Memory State Transfer for Active-Active Fault Tolerance

Checkpointing Orchestration: Toward a Scalable HPC Fault-Tolerant Environment

An Autonomous Reliability-Aware Negotiation Strategy for Cloud Computing Environments

Separating Performance Anomalies from Workload-Explained Failures in Streaming Servers

A Multi-objective Approach for Workflow Scheduling in Heterogeneous Environments

Automating Data-Throttling Analysis for Data-Intensive Workflows

Self-Healing of Operational Workflow Incidents on Distributed Computing Infrastructures

A Workflow-Aware Storage System: An Opportunity Study

Using Model Checking to Analyze the System Behavior of the LHC Production Grid

WSCOM: Online Task Scheduling with Data Transfers

Improving Grid Resource Usage: Metrics for Measuring Fragmentation

Malleable Model Coupling with Prediction

Load Balancing Query Processing in Metric-Space Similarity Search

Distributed Monitoring with Collaborative Prediction

Delta Send-Recv for Dynamic Pipelining in MPI Programs

Global Futures: A Multithreaded Execution Model for Global Arrays-based Applications

Productivity and Performance of Global-View Programming with XcalableMP PGAS Language

Distributed S-Net: Cluster and Grid Computing without the Hassle

Investigation of Data Locality in MapReduce

TomusBlobs: Towards Communication-Efficient Storage for MapReduce Applications in Azure

Maestro: Replica-Aware Map Scheduling for MapReduce

SciMATE: A Novel MapReduce-Like Framework for Multiple Scientific Data Formats

Pricing Cloud Compute Commodities: A Novel Financial Economic Model

A Time-Series Pattern Based Noise Generation Strategy for Privacy Protection in Cloud Computing

COCA: Computation Offload to Clouds Using AOP

ParaLite: Supporting Collective Queries in Database System to Parallelize User-Defined Executable

Snooze: A Scalable and Autonomic Virtual Machine Management Framework for Private Clouds

RO-BURST: A Robust Virtualization Cost Model for Workload Consolidation over Clouds

A Stable Network-Aware VM Placement for Cloud Systems

Surreptitious Deployment and Execution of Kernel Agents in Windows Guests

Cloud Service Negotiation: Concession vs. Tradeoff Approaches

Interactive Use of Cloud Services: Amazon SQS and S3

Dynamic Replication in Service-Oriented Systems

Selling T-shirts and Time Shares in the Cloud

Scalable Join Queries in Cloud Data Stores

Privacy Preserving Access Control with Authentication for Securing Data in Clouds

A Cost-Effective Mechanism for Cloud Data Reliability Management Based on Proactive Replica Checking

A Model and Decision Procedure for Data Storage in Cloud Computing

A Bandwidth-Optimized Multi-core Architecture for Irregular Applications

Parallel Real-Time OLAP on Multi-core Processors

Minimizing the Data Transfer Time Using Multicore End-System Aware Flow Bifurcation

Cache Conscious Task Regrouping on Multicore Processors

An Analysis of Provisioning and Allocation Policies for Infrastructure-as-a-Service Clouds

The Impact of User Rationality in Federated Clouds

Automated Tagging for the Retrieval of Software Resources in Grid and Cloud Infrastructures

Time and Cost Sensitive Data-Intensive Computing on Hybrid Clouds

Lightweight Resource Scaling for Cloud Applications

Performance Modeling and Comparative Analysis of the MILC Lattice QCD Application su3_rmd

An Efficient Parallel Implementation for Three-Dimensional Incompressible Pipe Flow Based on SIMPLE

Parallel Simulation of Peer-to-Peer Systems

Automated Construction of Performance Models for High Performance Distributed Applications

A Cloud Infrastructure for Optimization of a Massive Parallel Sequencing Workflow

Pseudo Random Number Generation for Parallelized Jobs on Clusters

Creating Your Own Private Cloud: Ezilla Toolkit -- For Coordinated Storage, Computing, and Networking Services

On Effective Quality of Service Negotiation

IDSaaS: Intrusion Detection System as a Service in Public Clouds

Distributed Shared Memory and Compiler-Induced Scalable Locality for Scalable Cluster Performance

A Compartive Study of Cloud Computing Middleware

Automatic Adaptive Page-Size Control for Remote Memory Paging

Analyzing Effect of Network Processor's Cache Dependent Parameter on MPI Broadcast Performance

Advanced MAC in HPC Systems: Performance Improvement

Cluster as a Service for Self-Deployable Cloud Applications

Accelerating 2-opt and 3-opt Local Search Using GPU in the Travelling Salesman Problem

Distributed Shared Memory Programming in the Cloud

A Fault Tolerance Framework for High Performance Computing in Cloud

Business Process Engine Simulator

Improving MapReduce Performance in Heterogeneous Network Environments and Resource Utilization

Perspectives of UnaCloud: An Opportunistic Cloud Computing Solution for Facilitating Research

Provisioning-Based Resource Management for Effective Workflow Scheduling on Utility Grids

Mining Concept Drifting Network Traffic in Cloud Computing Environments

VM Economics for Java Cloud Computing: An Adaptive and Resource-Aware Java Runtime with Quality-of-Execution

Combinatorial Auction-Based Mechanisms for VM Provisioning and Allocation in Clouds

Optimistic Scheduling with Geographically Replicated Services in the Cloud Environment (COLOR)

Kernel-Assisted MPI Collective Communication among Many-core Clusters

Enabling Application Resilience with and without the MPI Standard

Leveraging Heterogeneity for Energy Minimization in Data Centers

Executing Data-Intensive Workloads in a Cloud

Integration of Workflow Partitioning and Resource Provisioning

Hierarchical MapReduce Programming Model and Scheduling Algorithms

Resource Management for Elastic Cloud Workflows

Enhanced Energy-Efficient Scheduling for Parallel Applications in Cloud

The Cloud: Requirements for a Better Service

Reducing Operational Costs through Consolidation with Resource Prediction in the Cloud

Cellular STEM: Promoting Interest in Science, Technology, Engineering, and Math Education Using Cellular Messaging, Cloud Computing, and Web-Based Social Networks

Design and Implementation of a Secure Healthcare Social Cloud System

Optimizing Completion Time and Resource Provisioning of Pig Programs

Pricing and Resource Allocation in a Cloud Computing Market

Towards the Automated Engineering of Dependable Adaptive Services

Integrity Verification of Multiple Data Copies over Untrusted Cloud Servers

Optimal Reconfiguration of the Cloud Network for Maximum Energy Savings

Optimal Location of Data Centers and Software Components in Cloud Computing Network Design

Reducing Complexity in Management of eScience Computations

Conservative Distributed Discrete Event Simulation on Amazon EC2

Integrating HLA and Service-Oriented Architecture in a Simulation Framework

Simulation in the Cloud Using Handheld Devices

Goal-Directed Grid-Enabled Computing for Legacy Simulations

U.S. Army Modeling and Simulation Executable Architecture Deployment Cloud Virtualization Strategy

Simulation Processes in the Cloud for Emergency Planning

Development of a Metamodel for Medical Database Management on a Grid Network: Application to Health Watch and Epidemiology for Cancer and Perinatal Health

Towards Ontology-based Data Quality Inference in Large-Scale Sensor Networks

End-to-End QoS on Shared Clouds for Highly Dynamic, Large-Scale Sensing Data Streams

Human Postures Recognition Based on D-S Evidence Theory and Multi-sensor Data Fusion

On Managing Very Large Sensor-Network Data Using Bigtable

Data Outsourcing Simplified: Generating Data Connectors from Confidentiality and Access Policies

Publisher's Information

Kernel-Assisted MPI Collective Communication among Many-core Clusters

Content Provider	ACM Digital Library
Author	Ma, Teng
Abstract	Architectural hierarchies and hardware complexity brought by multicore or many-core Clusters, greatly challenge MPI applications' performance in two ways: performance efficiency and cross-platform portability. The cross-platform portability assumption, 'write once and efficiently run everywhere,' is not guaranteed by current MPI libraries, mainly due to implementation details. To partially address the performance issue exposed by hardware complexity and memory hierarchies, we propose a kernel assisted MPI collective communication approach, directly based on the kernel assisted one-sided single-copy module: KNEM. First, we introduce the general operating principles of KNEM memory copy, and then we present the design and implementation of KNEM collective, an intra-node collective component of Open MPI for shared memory nodes. Additionally, we describe how to integrate the kernel-assisted approach into collective communications on heterogeneous multicore clusters with intra- and inter-node communication. We evaluate and experimentally demonstrate the performance advantages of our kernel-assisted MPI collective over state-of-art MPI libraries (Open MPI and MVAPICH2).
Starting Page	741
Ending Page	745
Page Count	5
File Format	PDF
ISBN	9780769546919
DOI	10.1109/CCGrid.2012.38
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2012-05-13
Access Restriction	Subscribed
Subject Keyword	Mpi multicore cluster hpc collective communication kernel
Content Type	Text
Resource Type	Article

Central Library (ISO-9001:2015 Certified)
Indian Institute of Technology Kharagpur
Kharagpur, West Bengal, India | PIN - 721302

See location in the Map
03222 282435
Mail: support@ndl.gov.in

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in