NDLI: Distilling the essence of proprietary workloads into miniature benchmarks

Please wait, while we are loading the content...

Distilling the essence of proprietary workloads into miniature benchmarks

Content Provider	ACM Digital Library
Author	Bell, Robert H. John, Lizy K. Joshi, Ajay Eeckhout, Lieven
Copyright Year	2008
Abstract	Benchmarks set standards for innovation in computer architecture research and industry product development. Consequently, it is of paramount importance that these workloads are representative of real-world applications. However, composing such representative workloads poses practical challenges to application analysis teams and benchmark developers (1) real-world workloads are intellectual property and vendors hesitate to share these proprietary applications; and (2) porting and reducing these applications to benchmarks that can be simulated in a tractable amount of time is a nontrivial task. In this paper, we address this problem by proposing a technique that automatically distills key inherent behavioral attributes of a proprietary workload and captures them into a miniature synthetic benchmark clone. The advantage of the benchmark clone is that it hides the functional meaning of the code but exhibits similar performance characteristics as the target application. Moreover, the dynamic instruction count of the synthetic benchmark clone is substantially shorter than the proprietary application, greatly reducing overall simulation time for SPEC CPU, the simulation time reduction is over five orders of magnitude compared to entire benchmark execution. Using a set of benchmarks representative of general-purpose, scientific, and embedded applications, we demonstrate that the power and performance characteristics of the synthetic benchmark clone correlate well with those of the original application across a wide range of microarchitecture configurations.
Starting Page	1
Ending Page	33
Page Count	33
File Format	PDF
ISSN	15443566
e-ISSN	15443973
DOI	10.1145/1400112.1400115
Volume Number	5
Issue Number	2
Journal	ACM Transactions on Architecture and Code Optimization (TACO)
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2008-09-03
Publisher Place	New York
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Benchmarks Benchmark cloning Workload characterization
Content Type	Text
Resource Type	Article
Subject	Hardware and Architecture Information Systems Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

L.K.: Distilling the Essence of Proprietary Workloads Into Miniature Benchmarks (2008)

Distilling the essence of proprietary workloads into miniature benchmarks.

MINIME-GPU: Multicore Benchmark Synthesizer for GPUs

STMBench7:a benchmark for software transactional memory

STMBench7: a benchmark for software transactional memory

I/O reference behavior of production database workloads and the TPC benchmarks—an analysis at the logical level

Understanding architectural characteristics of multimedia retrieval workloads

Dispersing proprietary applications as benchmarks through code mutation (OPSR, Vol. 42, Issue. 2)

A Benchmark Characterization of the EEMBC Benchmark Suite

Distilling the essence of proprietary workloads into miniature benchmarks

Similar Documents

L.K.: Distilling the Essence of Proprietary Workloads Into Miniature Benchmarks (2008)

Distilling the essence of proprietary workloads into miniature benchmarks.

MINIME-GPU: Multicore Benchmark Synthesizer for GPUs

STMBench7:a benchmark for software transactional memory

STMBench7: a benchmark for software transactional memory

I/O reference behavior of production database workloads and the TPC benchmarks—an analysis at the logical level

Understanding architectural characteristics of multimedia retrieval workloads

Dispersing proprietary applications as benchmarks through code mutation (OPSR, Vol. 42, Issue. 2)

A Benchmark Characterization of the EEMBC Benchmark Suite

Distilling the essence of proprietary workloads into miniature benchmarks