NDLI: Comparative Assessment of Software Quality Classification Techniques: An Empirical Case Study

Please wait, while we are loading the content...

A Controlled Experiment Comparing the Maintainability of Programs Designed with and without Design Patterns—A Replication in a Real Programming Environment

Open-Source Change Logs

Are Individual Differences in Software Development Performance Possible to Capture Using a Quantitative Survey?

Comparative Assessment of Software Quality Classification Techniques: An Empirical Case Study

The Impact of Background and Experience on Software Inspections

Empirical Software Engineering : Volume 9, Issue 1-2, March 2004

Empirical Software Engineering : Volume 8

Empirical Software Engineering : Volume 7

Empirical Software Engineering : Volume 6

Empirical Software Engineering : Volume 5

Empirical Software Engineering : Volume 4

Empirical Software Engineering : Volume 3

Empirical Software Engineering : Volume 2

Comparative Assessment of Software Quality Classification Techniques: An Empirical Case Study

Content Provider	Springer Nature Link
Author	Khoshgoftaar, Taghi M. Seliya, Naeem
Copyright Year	2004
Abstract	Software metrics-based quality classification models predict a software module as either fault-prone (fp) or not fault-prone (nfp). Timely application of such models can assist in directing quality improvement efforts to modules that are likely to be fp during operations, thereby cost-effectively utilizing the software quality testing and enhancement resources. Since several classification techniques are available, a relative comparative study of some commonly used classification techniques can be useful to practitioners. We present a comprehensive evaluation of the relative performances of seven classification techniques and/or tools. These include logistic regression, case-based reasoning, classification and regression trees (CART), tree-based classification with S-PLUS, and the Sprint-Sliq, C4.5, and Treedisc algorithms. The use of expected cost of misclassification (ECM), is introduced as a singular unified measure to compare the performances of different software quality classification models. A function of the costs of the Type I (a nfp module misclassified as fp) and Type II (a fp module misclassified as nfp) misclassifications, ECM is computed for different cost ratios. Evaluating software quality classification models in the presence of varying cost ratios is important, because the usefulness of a model is dependent on the system-specific costs of misclassifications. Moreover, models should be compared and preferred for cost ratios that fall within the range of interest for the given system and project domain. Software metrics were collected from four successive releases of a large legacy telecommunications system. A two-way ANOVA randomized-complete block design modeling approach is used, in which the system release is treated as a block, while the modeling method is treated as a factor. It is observed that predictive performances of the models is significantly different across the system releases, implying that in the software engineering domain prediction models are influenced by the characteristics of the data and the system being modeled. Multiple-pairwise comparisons are performed to evaluate the relative performances of the seven models for the cost ratios of interest to the case study. In addition, the performance of the seven classification techniques is also compared with a classification based on lines of code. The comparative approach presented in this paper can also be applied to other software systems.
Starting Page	229
Ending Page	257
Page Count	29
File Format	PDF
ISSN	13823256
Journal	Empirical Software Engineering
Volume Number	9
Issue Number	3
e-ISSN	15737616
Language	English
Publisher	Kluwer Academic Publishers
Publisher Date	2004-01-01
Publisher Place	Boston
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Software Engineering/Programming and Operating Systems Programming Languages, Compilers, Interpreters
Content Type	Text
Resource Type	Article
Subject	Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

An empirical study of software release notes

Assessment of a New Three-Group Software Quality Classification Technique: An Empirical Case Study

An Empirical Study of Analogy-based Software Effort Estimation

Picking the Right Problem Frame—An Empirical Study

An empirical study on the impact of static typing on software maintainability

A Comparative Study of Ordering and Classification of Fault-Prone Software Modules

Can observational techniques help novices overcome the software inspection learning curve? An empirical investigation

Empirical Studies of Evolving Systems

An empirical study of the impact of modern code review practices on software quality

Comparative Assessment of Software Quality Classification Techniques: An Empirical Case Study

Similar Documents

An empirical study of software release notes

Assessment of a New Three-Group Software Quality Classification Technique: An Empirical Case Study

An Empirical Study of Analogy-based Software Effort Estimation

Picking the Right Problem Frame—An Empirical Study

An empirical study on the impact of static typing on software maintainability

A Comparative Study of Ordering and Classification of Fault-Prone Software Modules

Can observational techniques help novices overcome the software inspection learning curve? An empirical investigation

Empirical Studies of Evolving Systems

An empirical study of the impact of modern code review practices on software quality

Comparative Assessment of Software Quality Classification Techniques: An Empirical Case Study