Loading...
Please wait, while we are loading the content...
Similar Documents
Cost curve evaluation of fault prediction models (2008)
| Content Provider | CiteSeerX |
|---|---|
| Author | Jiang, Yue Cukic, Bojan Menzies, Tim |
| Description | Prediction of fault prone software components is one of the most researched problems in software engineering. Many statistical techniques have been proposed but there is no consensus on the methodology to select the “best model” for the specific project. In this paper, we introduce and discuss the merits of cost curve analysis of fault prediction models. Cost curves allow software quality engineers to introduce project-specific cost of module misclassification into model evaluation. Classifying a software module as fault-prone implies the application of some verification activities, thus adding to the development cost. Misclassifying a module as fault free carries the risk of system failure, also associated with cost implications. Through the analysis of sixteen projects from public repositories, we observe that software quality does not necessarily benefit from the prediction of fault prone components. The inclusion of misclassification cost in model evaluation may indicate that even the “best ” models achieve performance no better than trivial classification. Our results support a recommendation favoring the use of cost curves in practice with the hope they will become a standard tool for software quality model performance evaluation. 1 |
| File Format | |
| Language | English |
| Publisher | IEEE Computer Society |
| Publisher Date | 2008-01-01 |
| Publisher Institution | In Proceedings of the 2008 19th International Symposium on Software Reliability Engineering |
| Access Restriction | Open |
| Subject Keyword | Fault Prone Component Fault Prediction Model Standard Tool Verification Activity Software Quality Engineer Software Quality Researched Problem Model Evaluation Public Repository Fault-prone Implies Fault Prone Software Component Many Statistical Technique Specific Project System Failure Development Cost Software Module Module Misclassification Cost Curve Analysis Misclassification Cost Cost Implication Software Quality Model Performance Evaluation Software Engineering Sixteen Project Project-specific Cost Cost Curve Evaluation Cost Curve Trivial Classification |
| Content Type | Text |
| Resource Type | Article |
