NDLI: Cache-conscious coallocation of hot data streams

Content Provider	ACM Digital Library
Author	Shaham, Ran Chilimbi, Trishul M.
Abstract	The memory system performance of many programs can be improved by coallocating contemporaneously accessed heap objects in the same cache block. We present a novel profile-based analysis for producing such a layout. The analysis achieves cacheconscious coallocation of a hot data stream H (i.e., a regular data access pattern that frequently repeats) by isolating and combining allocation sites of object instances that appear in H such that intervening allocations coming from other sites are separated. The coallocation solution produced by the analysis is enforced by an automatic tool, cminstr, that redirects a program's heap allocations to a run-time coallocation library comalloc. We also extend the analysis to coallocation at object field granularity. The resulting field coallocation solution generalizes common data restructuring techniques, such as field reordering, object splitting, and object merging, and allows their combination. Furthermore, it provides insight into object restructuring by breaking down the coallocation benefit on a per-technique basis, which provides the opportunity to pick the "sweet spot" for each program. Experimental results using a set of memory-performance-limited benchmarks, including a few SPECInt2000 programs, and Microsoft VisualFoxPro, indicate that programs possess significant coallocation opportunities. Automatic object coallocation improves execution time by 13% on average in the presence of hardware prefetching. Hand-implemented field coallocation solutions for two of the benchmarks produced additional improvements (12% and 22%) but the effort involved suggests implementing an automated version for type-safe languages, such as Java and C#.
Starting Page	252
Ending Page	262
Page Count	11
File Format	PDF
ISSN	03621340 15581160
DOI	10.1145/1133255.1134011
Journal	ACM SIGPLAN Notices (SIGP)
Volume Number	41
Issue Number	6
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	1983-05-01
Publisher Place	New York
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Dynamic allocation Data locality Hot data streams Data profiling Memory layout Cache optimization
Content Type	Text
Resource Type	Article
Subject	Computer Graphics and Computer-Aided Design Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Cache-conscious coallocation of hot data streams

Cache-conscious structure layout

Improving the cache locality of memory allocation

Dynamic hot data stream prefetching for general-purpose programs

Profile-guided proactive garbage collection for locality optimization

Memory allocation for long-running server applications

The hardness of cache conscious data placement

Using generational garbage collection to implement cache-conscious data placement

A graph theoretic approach to cache-conscious placement of data for direct mapped caches

Cache-conscious coallocation of hot data streams

Similar Documents

Cache-conscious coallocation of hot data streams

Cache-conscious structure layout

Improving the cache locality of memory allocation

Dynamic hot data stream prefetching for general-purpose programs

Profile-guided proactive garbage collection for locality optimization

Memory allocation for long-running server applications

The hardness of cache conscious data placement

Using generational garbage collection to implement cache-conscious data placement

A graph theoretic approach to cache-conscious placement of data for direct mapped caches

Cache-conscious coallocation of hot data streams