NDLI: Initial design of a test suite for automatic performance analysis tools

Content Provider	IEEE Xplore Digital Library
Author	Mohr, B. Traff, J.L.
Copyright Year	2003
Description	Author affiliation: Forschungszentrum Julich GmbH, Germany (Mohr, B.)
Abstract	Automatic performance tools must of course be tested as to whether they perform their task correctly. Because performance tools are meta-programs, tool testing is more complex than ordinary program testing and comprises at least three aspects. First, it must be ensured that the tools do neither alter the semantics nor distort the run-time behavior of the application under investigation. Next, it must be verified that the tools collect the correct performance data as required by their specification. Finally, it must be checked that the tools indeed perform their intended tasks and detect relevant performance problems. Focusing on the latter (correctness) aspect, testing can be done using synthetic test functions with controllable performance properties, and/or real world applications with known performance behavior. A systematic test suite can be built from synthetic test functions and other components, possibly with the help of tools to assist the user in putting the pieces together into executable test programs. Clearly, such a test suite can be highly useful to builders of performance analysis tools. It is surprising that up till now, no systematic effort has been undertaken to provide such a suite. In this paper we discuss the initial design of a test suite for checking the correctness (in the above sense) of automatic performance analysis tools. In particular, we describe a collection of synthetic test functions which allows to easily construct both simple and more complex test programs with desired performance properties.
Sponsorship	IEEE Comput. Soc Tech. Committee on Parallel Process. IEEE Comput. Soc. Tech. Committee on Comput. Archit. IEEE Comput. Soc. Tech. Committee on Distrib. Process. ACM SIGARCH
File Size	359372
File Format	PDF
ISBN	0769519261
ISSN	15302075
DOI	10.1109/IPDPS.2003.1213255
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2003-04-22
Publisher Place	France
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Automatic testing Performance analysis System testing Performance evaluation Benchmark testing National electric code Europe Runtime Visualization Target recognition
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Initial design of a test suite for automatic performance analysis tools

Initial design of a test suite for automatic performance analysis tools (2002).

The design of a test suite for evaluating a parallelizing translator

Test suite design for code generation tools

Fault Detection Probability Analysis for Coverage-Based Test Suite Reduction

Static compaction using overlapped restoration and segment pruning

Automatic text alignment for speech system evaluation

Benchmark design for characterization of balanced high-performance architectures

Automatic test bench generation for simulation-based validation

Initial design of a test suite for automatic performance analysis tools

Similar Documents

Initial design of a test suite for automatic performance analysis tools

Initial design of a test suite for automatic performance analysis tools (2002).

The design of a test suite for evaluating a parallelizing translator

Test suite design for code generation tools

Fault Detection Probability Analysis for Coverage-Based Test Suite Reduction

Static compaction using overlapped restoration and segment pruning

Automatic text alignment for speech system evaluation

Benchmark design for characterization of balanced high-performance architectures

Automatic test bench generation for simulation-based validation

Initial design of a test suite for automatic performance analysis tools