NDLI: Practical Iterative Optimization for the Data Center

Content Provider	ACM Digital Library
Author	Wu, Chengyong Chen, Yunji Temam, Olivier Fang, Shuangde Xu, Wenwen Chen, Yang Feng, Xiaobing Eeckhout, Lieven
Copyright Year	2015
Abstract	Iterative optimization is a simple but powerful approach that searches the best possible combination of compiler optimizations for a given workload. However, iterative optimization is plagued by several practical issues that prevent it from being widely used in practice: a large number of runs are required to find the best combination, the optimum combination is dataset dependent, and the exploration process incurs significant overhead that needs to be compensated for by performance benefits. Therefore, although iterative optimization has been shown to have a significant performance potential, it seldom is used in production compilers. In this article, we propose iterative optimization for the data center (IODC): we show that the data center offers a context in which all of the preceding hurdles can be overcome. The basic idea is to spawn different combinations across workers and recollect performance statistics at the master, which then evolves to the optimum combination of compiler optimizations. IODC carefully manages costs and benefits, and it is transparent to the end user. To bring IODC to practice, we evaluate it in the presence of co-runners to better reflect real-life data center operation with multiple applications co-running per server. We enhance IODC with the capability to find compatible co-runners along with a mechanism to dynamically adjust the level of aggressiveness to improve its robustness in the presence of co-running applications. We evaluate IODC using both MapReduce and compute-intensive throughput server applications. To reflect the large number of users interacting with the system, we gather a very large collection of datasets (up to hundreds of millions of unique datasets per program), for a total storage of 16.4TB and 850 days of CPU time. We report an average performance improvement of 1.48 × and up to 2.08 × for five MapReduce applications, and 1.12 × and up to 1.39 × for nine server applications. Furthermore, our experiments demonstrate that IODC is effective in the presence of co-runners, improving performance by greater than 13% compared to the worst possible co-runner schedule.
Starting Page	1
Ending Page	26
Page Count	26
File Format	PDF
ISSN	15443566
e-ISSN	15443973
DOI	10.1145/2739048
Volume Number	12
Issue Number	2
Journal	ACM Transactions on Architecture and Code Optimization (TACO)
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2015-05-11
Publisher Place	New York
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Iterative optimization MapReduce Co-run Compiler Data center Server
Content Type	Text
Resource Type	Article
Subject	Hardware and Architecture Information Systems Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Iterative optimization for the data center (CARN, Vol. 40, Issue. 1)

Iterative optimization for the data center (SIGP, Vol. 47, Issue. 4)

Deconstructing iterative optimization

Iterative optimization for the data center

Layout-oblivious compiler optimization for matrix computations

Collective optimization: A practical collaborative approach

Continuous learning of compiler heuristics

Practical exhaustive optimization phase order exploration and evaluation

Extendable pattern-oriented optimization directives

Practical Iterative Optimization for the Data Center

Similar Documents

Iterative optimization for the data center (CARN, Vol. 40, Issue. 1)

Iterative optimization for the data center (SIGP, Vol. 47, Issue. 4)

Deconstructing iterative optimization

Iterative optimization for the data center

Layout-oblivious compiler optimization for matrix computations

Collective optimization: A practical collaborative approach

Continuous learning of compiler heuristics

Practical exhaustive optimization phase order exploration and evaluation

Extendable pattern-oriented optimization directives

Practical Iterative Optimization for the Data Center