NDLI: Statistical debugging for real-world performance problems

Content Provider	ACM Digital Library
Author	Lu, Shan Song, Linhai
Abstract	Design and implementation defects that lead to inefficient computation widely exist in software. These defects are difficult to avoid and discover. They lead to severe performance degradation and energy waste during production runs, and are becoming increasingly critical with the meager increase of single-core hardware performance and the increasing concerns about energy constraints. Effective tools that diagnose performance problems and point out the inefficiency root cause are sorely needed. The state of the art of performance diagnosis is preliminary. Profiling can identify the functions that consume the most computation resources, but can neither identify the ones that waste the most resources nor explain why. Performance-bug detectors can identify specific type of inefficient computation, but are not suited for diagnosing general performance problems. Effective failure diagnosis techniques, such as statistical debugging, have been proposed for functional bugs. However, whether they work for performance problems is still an open question. In this paper, we first conduct an empirical study to understand how performance problems are observed and reported by real-world users. Our study shows that statistical debugging is a natural fit for diagnosing performance problems, which are often observed through comparison-based approaches and reported together with both good and bad inputs. We then thoroughly investigate different design points in statistical debugging, including three different predicates and two different types of statistical models, to understand which design point works the best for performance diagnosis. Finally, we study how some unique nature of performance bugs allows sampling techniques to lower the overhead of run-time performance diagnosis without extending the diagnosis latency.
Starting Page	561
Ending Page	578
Page Count	18
File Format	PDF
ISSN	03621340 15581160
DOI	10.1145/2714064.2660234
Journal	ACM SIGPLAN Notices (SIGP)
Volume Number	49
Issue Number	10
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	1983-05-01
Publisher Place	New York
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Statistical debugging Empirical study Performance diagnosis Performance bugs
Content Type	Text
Resource Type	Article
Subject	Computer Graphics and Computer-Aided Design Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Statistical debugging for real-world performance problems

Understanding and detecting real-world performance bugs

Software debugging and testing using the abstract diagnosis theory

Performance debugging using parallel performance predicates

A software debugging glossary

Scalable parallel debugging with statistical assertions

SurveyMan:programming and automatically debugging surveys

HeapMD:identifying heap-based bugs using anomaly detection (SIGP, Vol. 41, Issue. 11)

Performance problems you can fix: a dynamic analysis of memoization opportunities

Statistical debugging for real-world performance problems

Similar Documents

Statistical debugging for real-world performance problems

Understanding and detecting real-world performance bugs

Software debugging and testing using the abstract diagnosis theory

Performance debugging using parallel performance predicates

A software debugging glossary

Scalable parallel debugging with statistical assertions

SurveyMan:programming and automatically debugging surveys

HeapMD:identifying heap-based bugs using anomaly detection (SIGP, Vol. 41, Issue. 11)

Performance problems you can fix: a dynamic analysis of memoization opportunities

Statistical debugging for real-world performance problems