NDLI: Automatic data layout for distributed-memory machines

Content Provider	ACM Digital Library
Author	Kennedy, Ken Kremer, Ulrich
Copyright Year	1998
Abstract	The goal of languages like Fortran D or High Performance Fortran (HPF) is to provide a simple yet efficient machine-independent parallel programming model. After the algorithm selection, the data layout choice is the key intellectual challenge in writing an efficient program in such languages. The performance of a data layout depends on the target compilation system, the target machine, the problem size, and the number of available processors. This makes the choice of a good layout extremely difficult for most users of such languages. If languages such as HPF are to find general acceptance, the need for data layout selection support has to be addressed. We beleive that the appropriate way to provide the needed support is through a tool that generates data layout specifications automatically. This article discusses the design and implementation of a data layout selection tool that generates HPF-style data layout specifications automatically. Because layout is done in a tool that is not embedded in the target compiler and hence will be run only a few times during the tuning phase of an application, it can use techniques such as integer programming that may be considered too computationally expensive for inclusion in production compilers. The proposed framework for automatic data layout selection builds and examines search spaces of candidate data layouts. A candidate layout is an efficient layout for some part of the program. After the generation of search spaces, a single candidate layout is selected for each program part, resulting in a data layout for the entire program. A good overall data layout may require the remapping of arrays between program parts. A performance estimator based on a compiler model, an execution model, and a machine model are needed to predict the execution time of each candidate layout and the costs of possible remappings between candidate data layouts. In the proposed framework, instances of NP-complete problems are solved during the construction of candidate layout search spaces and the final selection of candidate layouts from each search space. Rather than resorting to heuristics, the framework capitalizes on state-of-the-art 0-1 integer programming technology to compute optimal solutions of these NP-complete problems. A prototype data layout assistant tool based on our framework has been implemented as part of the D system currently under development at Rice University. The article reports preliminary experimental results. The results indicate that the framework is efficient and allows the generation of data layouts of high quality.
Starting Page	869
Ending Page	916
Page Count	48
File Format	PDF
ISSN	01640925
e-ISSN	15584593
DOI	10.1145/291891.291901
Volume Number	20
Issue Number	4
Journal	ACM Transactions on Programming Languages and Systems (TOPLAS)
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	1998-07-01
Publisher Place	New York
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	High performance Fortran
Content Type	Text
Resource Type	Article
Subject	Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Automatic Data Layout for Distributed-memory Machines Automatic Data Layout for Distributed-memory Machines

Automatic Data Layout for High Performance Fortran Automatic Data Layout for High Performance Fortran

Automatic Data Layout for Distributed Memory Machines (1993)

Automatic Data Layout for Distributed Memory Machines (1995)

Automatic data layout for distributed-memory machines in the D programming environment (1993)

Automatic Data Layout for High-Performance Fortran (1994)

Automatic data layout for high performance Fortran

PGHPF – An Optimizing High Performance Fortran Compiler for Distributed Memory Machines

Automatic Data Layout for High Performance Fortran (1994)

Automatic data layout for distributed-memory machines

Similar Documents

Automatic Data Layout for Distributed-memory Machines Automatic Data Layout for Distributed-memory Machines

Automatic Data Layout for High Performance Fortran Automatic Data Layout for High Performance Fortran

Automatic Data Layout for Distributed Memory Machines (1993)

Automatic Data Layout for Distributed Memory Machines (1995)

Automatic data layout for distributed-memory machines in the D programming environment (1993)

Automatic Data Layout for High-Performance Fortran (1994)

Automatic data layout for high performance Fortran

PGHPF – An Optimizing High Performance Fortran Compiler for Distributed Memory Machines

Automatic Data Layout for High Performance Fortran (1994)

Automatic data layout for distributed-memory machines