NDLI: Lessons learned at 208K: towards debugging millions of cores

Please wait, while we are loading the content...

Entering the petaflop era: the architecture and performance of Roadrunner

High-frequency simulations of global seismic wave propagation using SPECFEM3D_GLOBE on 62K processors

High performance discrete Fourier transforms on graphics processors

New algorithm to enable 400+ TFlop/s sustained performance in simulations of disorder effects in $high-T_{c}$ superconductors

Dynamically adapting file domain partitioning methods for collective I/O based on underlying parallel file system locking protocols

Scalable adaptive mantle convection simulation on petascale supercomputers

Stencil computation optimization and auto-tuning on state-of-the-art multicore architectures

0.374 Pflop/s trillion-particle kinetic modeling of laser plasma interaction on Roadrunner

Bandwidth intensive 3-D FFT kernel for GPUs using CUDA

369 Tflop/s molecular dynamics simulations on the Roadrunner general-purpose heterogeneous supercomputer

Using server-to-server communication in parallel file systems to simplify consistency and improve performance

Linearly scaling 3D fragment method for large-scale electronic structure calculations

Scientific application-based performance comparison of SGI Altix 4700, IBM POWER5+, and SGI ICE 8200 supercomputers

Adapting a message-driven parallel application to GPU-accelerated clusters

Scaling parallel I/O performance through I/O delegate and caching system

Efficient management of data center resources for massively multiplayer online games

Performance optimization of TCP/IP over 10 gigabit ethernet by precise instrumentation

A multi-level parallel simulation approach to electron transport in nano-scale transistors

Feedback-controlled resource sharing for predictable eScience

Wide-area performance profiling of 10GigE and InfiniBand technologies

Accelerating configuration interaction calculations for nuclear structure

Efficient auction-based grid reservations using dynamic programming

Asymmetric interactions in symmetric multi-core systems: analysis, enhancements and evaluation

Dendro: parallel algorithms for multigrid and AMR methods on 2:1 balanced octrees

Characterizing application sensitivity to OS interference using kernel-level noise injection

Performance prediction of large-scale parallell system and application using macro-level simulation

A novel domain oriented approach for scientific grid workflow composition

Toward loosely coupled programming on petascale systems

Early evaluation of IBM BlueGene/P

Nimrod/K: towards massively parallel dynamic grid workflows

SMARTMAP: operating system support for efficient data sharing among processes on a multi-core processor

Lessons learned at 208K: towards debugging millions of cores

Applying double auctions for scheduling of workflows on the Grid

A novel migration-based NUCA design for chip multiprocessors

Communication avoiding Gaussian elimination

Extending CC-NUMA systems to support write update optimizations

Benchmarking GPUs to tune dense linear algebra

High-radix crossbar switches enabled by proximity communication

Massively parallel genomic sequence search on the Blue Gene/P architecture

The role of MPI in development time: a case study

An efficient parallel approach for identifying protein families in large-scale metagenomic data sets

An adaptive cut-off for task parallelism

EpiSimdemics: an efficient algorithm for simulating the spread of infectious disease over large realistic social networks

Programming the Intel 80-core network-on-a-chip terascale processor

PAM: a novel performance/power aware meta-scheduler for multi-core systems

Hiding I/O latency with pre-execution prefetching for parallel applications

A dynamic scheduler for balancing HPC applications

Characterizing and predicting the I/O performance of HPC applications using a parameterized synthetic benchmark

Proactive process-level live migration in HPC environments

Parallel I/O prefetching using MPI file caching and I/O signatures

BitDew: a programmable environment for large-scale data management and distribution

Scalable load-balance measurement for SPMD codes

Using overlays for efficient data transfer over shared wide-area networks

Massively parallel volume rendering using 2-3 swap image compositing

Capturing performance knowledge for automated analysis

The cost of doing science on the cloud: the Montage example

High performance multivariate visual data exploration for extremely large data

Analysis of application heartbeats: learning structural and temporal features in time series data for identification of performance problems

Server-storage virtualization: integration and load balancing in data centers

Materialized community ground models for large-scale earthquake simulation

Positivity, posynomials and tile size selection

A scalable parallel framework for analyzing terascale molecular dynamics simulation trajectories

Global trees: a framework for linked data structures on distributed memory parallel systems

Parallel exact inference on the cell broadband engine processor

Prefetch throttling and data pinning for improving performance of shared caches

Lessons learned at 208K: towards debugging millions of cores

Content Provider	ACM Digital Library
Author	Ahn, Dong H. Legendre, Matthew de Supinski, Bronis R. Miller, Barton P. Schulz, Martin Lee, Gregory L. Arnold, Dorian C. Liblit, Ben
Abstract	Petascale systems will present several new challenges to performance and correctness tools. Such machines may contain millions of cores, requiring that tools use scalable data structures and analysis algorithms to collect and to process application data. In addition, at such scales, each tool itself will become a large parallel application - already, debugging the full Blue-Gene/L (BG/L) installation at the Lawrence Livermore National Laboratory requires employing 1664 tool daemons. To reach such sizes and beyond, tools must use a scalable communication infrastructure and manage their own tool processes efficiently. Some system resources, such as the file system, may also become tool bottlenecks. In this paper, we present challenges to petascale tool development, using the Stack Trace Analysis Tool (STAT) as a case study. STAT is a lightweight tool that gathers and merges stack traces from a parallel application to identify process equivalence classes. We use results gathered at thousands of tasks on an Infiniband cluster and results up to 208K processes on BG/L to identify current scalability issues as well as challenges that will be faced at the petascale. We then present implemented solutions to these challenges and show the resulting performance improvements. We also discuss future plans to meet the debugging demands of petascale machines.
Starting Page	1
Ending Page	9
Page Count	9
File Format	PDF
ISBN	9781424428359
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2008-11-15
Access Restriction	Subscribed
Content Type	Text
Resource Type	Article

Central Library (ISO-9001:2015 Certified)
Indian Institute of Technology Kharagpur
Kharagpur, West Bengal, India | PIN - 721302

See location in the Map
03222 282435
Mail: support@ndl.gov.in

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in