NDLI: Predicting Effectiveness of IR-Based Bug Localization Techniques

Content Provider	IEEE Xplore Digital Library
Author	Le, T.-D.B. Thung, F. Lo, D.
Copyright Year	2014
Description	Author affiliation: Sch. of Inf. Syst., Singapore Manage. Univ., Singapore, Singapore (Le, T.-D.B.; Thung, F.; Lo, D.)
Abstract	Recently, many information retrieval (IR) based bug localization approaches have been proposed in the literature. These approaches use information retrieval techniques to process a textual bug report and a collection of source code files to find buggy files. They output a ranked list of files sorted by their likelihood to contain the bug. Recent approaches can achieve reasonable accuracy, however, even a state-of-the-art bug localization tool outputs many ranked lists where buggy files appear very low in the lists. This potentially causes developers to distrust bug localization tools. Parnin and Orso recently conduct a user study and highlight that developers do not find an automated debugging tool useful if they do not find the root cause of a bug early in a ranked list. To address this problem, we build an oracle that can automatically predict whether a ranked list produced by an IR-based bug localization tool is likely to be effective or not. We consider a ranked list to be effective if a buggy file appears in the top-N position of the list. If a ranked list is unlikely to be effective, developers do not need to waste time in checking the recommended files one by one. In such cases, it is better for developers to use traditional debugging methods or request for further information to localize bugs. To build this oracle, our approach extracts features that can be divided into four categories: score features, textual features, topic model features, and metadata features. We build a separate prediction model for each category, and combine them to create a composite prediction model which is used as the oracle. We name our proposed approach APRILE, which stands for Automated Prediction of IR-based Bug Localization's Effectiveness. We have evaluated APRILE to predict the effectiveness of three state-of-the-art IR based bug localization tools on more than three thousands bug reports from AspectJ, Eclipse, and SWT. APRILE can achieve an average precision, recall, and F-measure of at least 70.36%, 66.94%, and 68.03%, respectively. Furthermore, APRILE outperforms a baseline approach by 84.48%, 17.74%, and 31.56% for the AspectJ, Eclipse, and SWT bug reports, respectively.
Starting Page	335
Ending Page	345
File Size	317607
Page Count	11
File Format	PDF
ISSN	10719458
e-ISBN	9781479960330
DOI	10.1109/ISSRE.2014.39
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2014-11-03
Publisher Place	Italy
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Feature extraction Predictive models Support vector machines Training Computational modeling Computer bugs Debugging Effectiveness Prediction Text Classification Information Retrieval Bug Reports Bug Localization
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Will Fault Localization Work for These Failures? An Automated Approach to Predict Effectiveness of Fault Localization Tools

Where should the bugs be fixed? More accurate information retrieval-based bug localization based on bug reports

Automated Configuration Bug Report Prediction Using Text Mining

Towards more accurate retrieval of duplicate bug reports

Automatic recovery of root causes from bug-fixing changes

Combining Deep Learning with Information Retrieval to Localize Buggy Files for Bug Reports (N)

Predicting Bugs Using Antipatterns

Reducing Features to Improve Code Change-Based Bug Prediction

Evaluating text features for lyrics-based songwriter prediction

Predicting Effectiveness of IR-Based Bug Localization Techniques

Similar Documents

Will Fault Localization Work for These Failures? An Automated Approach to Predict Effectiveness of Fault Localization Tools

Where should the bugs be fixed? More accurate information retrieval-based bug localization based on bug reports

Automated Configuration Bug Report Prediction Using Text Mining

Towards more accurate retrieval of duplicate bug reports

Automatic recovery of root causes from bug-fixing changes

Combining Deep Learning with Information Retrieval to Localize Buggy Files for Bug Reports (N)

Predicting Bugs Using Antipatterns

Reducing Features to Improve Code Change-Based Bug Prediction

Evaluating text features for lyrics-based songwriter prediction

Predicting Effectiveness of IR-Based Bug Localization Techniques