NDLI: Code cache management in managed language VMs to reduce memory consumption for embedded systems

Content Provider	ACM Digital Library
Author	Robinson, Forrest J. Jantz, Michael R. Kulkarni, Prasad A.
Abstract	The compiled native code generated by a just-in-time (JIT) compiler in managed language virtual machines (VM) is placed in a region of memory called the code cache. Code cache management (CCM) in a VM is responsible to find and evict methods from the code cache to maintain execution correctness and manage program performance for a given code cache size or memory budget. Effective CCM can also boost program speed by enabling more aggressive JIT compilation, powerful optimizations, and improved hardware instruction cache and I-TLB performance. Though important, CCM is an overlooked component in VMs. We find that the default CCM policies in Oracle’s production-grade HotSpot VM perform poorly even at modest memory pressure. We develop a detailed simulation-based framework to model and evaluate the potential efficiency of many different CCM policies in a controlled and realistic, but VM-independent environment. We make the encouraging discovery that effective CCM policies can sustain high program performance even for very small cache sizes. Our simulation study provides the rationale and motivation to improve CCM strategies in existing VMs. We implement and study the properties of several CCM policies in HotSpot. We find that in spite of working within the bounds of the HotSpot VM’s current CCM sub-system, our best CCM policy implementation in HotSpot improves program performance over the default CCM algorithm by 39%, 41%, 55%, and 50% with code cache sizes that are 90%, 75%, 50%, and 25% of the desired cache size, on average.
Starting Page	11
Ending Page	20
Page Count	10
File Format	PDF
ISSN	03621340 15581160
DOI	10.1145/2980930.2907958
Journal	ACM SIGPLAN Notices (SIGP)
Volume Number	51
Issue Number	5
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	1983-05-01
Publisher Place	New York
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Memory-constrained Code-cache Hotspot jvm
Content Type	Text
Resource Type	Article
Subject	Computer Graphics and Computer-Aided Design Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Code cache management in managed language VMs to reduce memory consumption for embedded systems

Cross-layer memory management for managed language applications

Compiler-managed partitioned data caches for low power

Impact of JVM superoperators on energy consumption in resource-constrained embedded systems

Adaptive code unloading for resource-constrained JVMs

Cache-Aware Scratchpad-Allocation Algorithms for Energy-Constrained Embedded Systems

Leveraging Managed Runtime Systems to Build, Analyze, and Optimize Memory Graphs

Compiler-directed cache polymorphism

Hardware-managed register allocation for embedded processors

Code cache management in managed language VMs to reduce memory consumption for embedded systems

Similar Documents

Code cache management in managed language VMs to reduce memory consumption for embedded systems

Cross-layer memory management for managed language applications

Compiler-managed partitioned data caches for low power

Impact of JVM superoperators on energy consumption in resource-constrained embedded systems

Adaptive code unloading for resource-constrained JVMs

Cache-Aware Scratchpad-Allocation Algorithms for Energy-Constrained Embedded Systems

Leveraging Managed Runtime Systems to Build, Analyze, and Optimize Memory Graphs

Compiler-directed cache polymorphism

Hardware-managed register allocation for embedded processors

Code cache management in managed language VMs to reduce memory consumption for embedded systems