NDLI: Parallel MATLAB for Extreme Virtual Memory

Content Provider	IEEE Xplore Digital Library
Author	Hahn Kim Kepner, J. Kahn, C.
Copyright Year	2005
Description	Author affiliation: MIT Lincoln Laboratory, Lexington, MA (Hahn Kim)
Abstract	Many DoD applications have extreme memory requirements, often with data sets larger than memory on a single computer. Such data sets can be addressed with out-of-core methods, which use memory as a "window" to view a section of the data stored on disk at a time. The Parallel Matlab for eXtreme Virtual Memory (pMatlab XVM) library adds out-of-core extensions to the Parallel Matlab (pMatlab) library. The DARPA High Productivity Computing Systems HPCchallenge FFT benchmark has been implemented in C+MPI, pMatlab, pMatlab hand coded for out-of-core and pMatlab XVM. We found that 1) the performance of the C+MPI and pMatlab versions were comparable; 2) the out-of-core versions deliver 80% of the performance of the in-core versions; 3) the out-of-core versions were able to perform a 1 TB (64 billion point) FFT; and 4) the pMatlab XVM program was smaller, easier to implement and verify, and more efficient than its hand coded equivalent. We plan to apply pMatlab XVM to the full HPCchallenge benchmark suite. Using next generation hardware, problems sizes a factor of 100 to 1000 times larger should be feasible. We are also transitioning this technology to several DoD signal processing applications. Finally, the flexibility of pMatlab XVM allows hardware designers to experiment with FFT parameters in software before designing hardware for a real-time, ultra-long FFT.
Starting Page	381
Ending Page	387
File Size	337563
Page Count	7
File Format	PDF
ISBN	0769524966
DOI	10.1109/DODUGC.2005.48
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2005-06-27
Publisher Place	USA
Access Restriction	Subscribed
Rights Holder	IEEE/CSP
Subject Keyword	Productivity Laboratories HPCchallenge Application software MATLAB parallel programming Concurrent computing Software design FFT Signal processing algorithms outof-core Signal processing HPCS Hardware Libraries
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Parallel Out-of-Core Matlab for Extreme Virtual Memory

pMATLAB: Parallel MATLAB Library for Signal Processing Applications

PVL: an object oriented software library for parallel signal processing

Out-of-core and pipeline techniques for wavefront algorithms

Task and Conduit Framework for Multi-core Systems

Performance of digital neuro-computers

Design patterns for parallel computing using a network of processors

Parallel scalable libraries and algorithms for computer vision

Design of a Heterogeneous Parallel Processing System for Beam Forming

Parallel MATLAB for Extreme Virtual Memory

Similar Documents

Parallel Out-of-Core Matlab for Extreme Virtual Memory

pMATLAB: Parallel MATLAB Library for Signal Processing Applications

PVL: an object oriented software library for parallel signal processing

Out-of-core and pipeline techniques for wavefront algorithms

Task and Conduit Framework for Multi-core Systems

Performance of digital neuro-computers

Design patterns for parallel computing using a network of processors

Parallel scalable libraries and algorithms for computer vision

Design of a Heterogeneous Parallel Processing System for Beam Forming

Parallel MATLAB for Extreme Virtual Memory