NDLI: COSMIC: middleware for high performance and reliable multiprocessing on xeon phi coprocessors

Please wait, while we are loading the content...

Scalable in situ scientific data encoding for analytical query processing

Virtual TCP offload: optimizing ethernet overlay performance on advanced interconnects

NUMA-aware shared-memory collective communication for MPI

IBIS: interposed big-data I/O scheduler

Anton: a special-purpose machine that achieves a hundred-fold speedup in biomolecular simulations

WuKong: automatically detecting and localizing bugs that manifest at large system scales

A preemption-based runtime to efficiently schedule multi-process applications on heterogeneous clusters with GPUs

Interference and locality-aware task scheduling for MapReduce applications in virtual clusters

Taming massive distributed datasets: data sampling using bitmap indices

Scalanytics: a declarative multi-core platform for scalable composable traffic analytics

Modeling communication in cache-coherent SMP systems: a case-study with Xeon Phi

ACIC: automatic cloud I/O configurator for parallel applications

A 1 PB/s file system to checkpoint three million MPI tasks

On the efficacy of GPU-integrated MPI for scientific applications

A comparative study of high-performance computing on the cloud

I/O acceleration with pattern detection

CamCubeOS: a key-based network stack for 3D torus cluster topologies

Orthrus: a framework for implementing high-performance collective I/O in the multicore clusters

AI-Ckpt: leveraging memory access patterns for adaptive asynchronous incremental checkpointing

VGRIS: virtualized GPU resource isolation and scheduling in cloud gaming

kMemvisor: flexible system wide memory mirroring in virtual environments

MTC envelope: defining the capability of large scale computers in the context of parallel scripting applications

ElastMan: autonomic elasticity manager for cloud-based key-value stores

Correcting soft errors online in LU factorization

COSMIC: middleware for high performance and reliable multiprocessing on xeon phi coprocessors

Supporting parallel soft real-time applications in virtualized environment

Building and scaling virtual clusters with residual resources from interactive clouds

SCDA: SLA-aware cloud datacenter architecture for efficient content storage and retrieval

Load balancing in large-scale epidemiological simulations

Efficient analytics on ordered datasets using MapReduce

A framework for auto-tuning HDF5 applications

COSMIC: middleware for high performance and reliable multiprocessing on xeon phi coprocessors

Content Provider	ACM Digital Library
Author	Cadambi, Srihari Li, Cheng-Hong Chakradhar, Srimat Coviello, Giuseppe Rao, Kunal Phull, Rajat Sankaradass, Murugan
Abstract	It is remarkably easy to offload processing to Intel's newest manycore coprocessor, the Xeon-Phi: it supports a popular ISA (x86-based), a popular OS (Linux) and a popular programming model (OpenMP). Unfortunately, easy portability does not automatically ensure high performance. Additional programmer effort is necessary to leverage the new performance-oriented hardware features. But programmer optimizations alone are insufficient. Multiprocessing is also necessary to improve hardware utilization, and Linux makes it easy for processes to share the manycore coprocessor. However multiprocessing inefficiencies can easily offset gains made by the programmer. Our experiments on a production, high-performance Xeon server with multiple Xeon Phi coprocessors show that multiprocessing on coprocessors not only slows down the processes but also introduces unreliability (some processes crash unexpectedly). We propose a new, user-level middleware called COSMIC that improves performance and reliability of multiprocessing on coprocessors like the Xeon Phi. COSMIC seamlessly fits in the existing Xeon Phi software stack and is transparent to programmers. It manages Xeon Phi processes that execute parallel regions offloaded to the coprocessors. Offloads typically have programmer-driven performance directives like thread and affinity requirements. Unlike the existing Xeon Phi software stack, COSMIC does fair scheduling of both processes and offloads, and takes into account conflicting requirements of offloads belonging to different processes. By doing so, COSMIC has two clear benefits. First, it improves multiprocessing performance by preventing thread and memory oversubscription, by avoiding inter-offload interference and by reducing load imbalance on coprocessors and cores. Second, it increases multiprocessing reliability by exploiting programmer-specified per-process coprocessor memory requirements to completely avoid memory oversubscription and crashes. Our experiments on several representative Xeon Phi workloads show that, in a multiprocessing environment, COSMIC improves average core utilization by up to 3 times, reduces make-span by up to 52%, reduces average process latency (turn-around-time) by 70%, and completely eliminates process crashes.
Starting Page	215
Ending Page	226
Page Count	12
File Format	PDF
ISBN	9781450319102
DOI	10.1145/2462902.2462921
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2013-06-17
Publisher Place	New York
Access Restriction	Subscribed
Subject Keyword	Xeon phi System software Servers Manycore Middleware
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

A Coprocessor Sharing-Aware Scheduler for Xeon Phi-Based Compute Clusters

Revisiting virtual memory for high performance computing on manycore architectures: a hybrid segmentation kernel approach

Snapify: capturing snapshots of offload applications on xeon phi manycore processors

SCAN-XP: Parallel Structural Graph Clustering Algorithm on Intel Xeon Phi Coprocessors

Performance Evaluation of OpenFOAM* with MPI-3 RMA Routines on Intel® Xeon® Processors and Intel® Xeon Phi™ Coprocessors

Evaluation of Rodinia Codes on Intel Xeon Phi

Exploring SIMD for Molecular Dynamics, Using Intel® Xeon® Processors and Intel® Xeon Phi Coprocessors

Biosequence Analysis Using Intel® Xeon Phi

Communication Models for Distributed Intel Xeon Phi Coprocessors

COSMIC: middleware for high performance and reliable multiprocessing on xeon phi coprocessors

Similar Documents

A Coprocessor Sharing-Aware Scheduler for Xeon Phi-Based Compute Clusters

Revisiting virtual memory for high performance computing on manycore architectures: a hybrid segmentation kernel approach

Snapify: capturing snapshots of offload applications on xeon phi manycore processors

SCAN-XP: Parallel Structural Graph Clustering Algorithm on Intel Xeon Phi Coprocessors

Performance Evaluation of OpenFOAM* with MPI-3 RMA Routines on Intel® Xeon® Processors and Intel® Xeon Phi™ Coprocessors

Evaluation of Rodinia Codes on Intel Xeon Phi

Exploring SIMD for Molecular Dynamics, Using Intel® Xeon® Processors and Intel® Xeon Phi Coprocessors

Biosequence Analysis Using Intel® Xeon Phi

Communication Models for Distributed Intel Xeon Phi Coprocessors

COSMIC: middleware for high performance and reliable multiprocessing on xeon phi coprocessors