NDLI: The Effects of Time Constraints on Test Case Prioritization: A Series of Controlled Experiments

Content Provider	IEEE Xplore Digital Library
Author	Hyunsook Do Mirarab, S. Tahvildari, L. Rothermel, G.
Copyright Year	1976
Abstract	Regression testing is an expensive process used to validate modified software. Test case prioritization techniques improve the cost-effectiveness of regression testing by ordering test cases such that those that are more important are run earlier in the testing process. Many prioritization techniques have been proposed and evidence shows that they can be beneficial. It has been suggested, however, that the time constraints that can be imposed on regression testing by various software development processes can strongly affect the behavior of prioritization techniques. If this is correct, a better understanding of the effects of time constraints could lead to improved prioritization techniques and improved maintenance and testing processes. We therefore conducted a series of experiments to assess the effects of time constraints on the costs and benefits of prioritization techniques. Our first experiment manipulates time constraint levels and shows that time constraints do play a significant role in determining both the cost-effectiveness of prioritization and the relative cost-benefit trade-offs among techniques. Our second experiment replicates the first experiment, controlling for several threats to validity including numbers of faults present, and shows that the results generalize to this wider context. Our third experiment manipulates the number of faults present in programs to examine the effects of faultiness levels on prioritization and shows that faultiness level affects the relative cost-effectiveness of prioritization techniques. Taken together, these results have several implications for test engineers wishing to cost-effectively regression test their software systems. These include suggestions about when and when not to prioritize, what techniques to employ, and how differences in testing processes may relate to prioritization cost--effectiveness.
Sponsorship	IEEE Computer Society Technical Council on Software Engineering Association for Computing Machinery (ACM) IEEE Computer Society
Starting Page	593
Ending Page	617
Page Count	25
File Size	8126341
File Format	PDF
ISSN	00985589
Volume Number	36
Issue Number	5
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2010-09-01
Publisher Place	U.S.A.
Access Restriction	One Nation One Subscription (ONOS)
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Time factors Software testing Automatic testing Maintenance engineering Programming System testing Computer Society Software systems Bayesian methods Software quality empirical studies. Regression testing test case prioritization cost-benefits Bayesian networks
Content Type	Text
Resource Type	Article
Subject	Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Prioritizing JUnit Test Cases: An Empirical Assessment and Cost-Benefits Analysis

On the Use of Mutation Faults in Empirical Assessments of Test Case Prioritization Techniques

Search Algorithms for Regression Test Case Prioritization

Size-Constrained Regression Test Case Selection Using Multicriteria Optimization

Semantics guided regression test cost reduction

Early fault detection model using integrated and cost-effective test case prioritization

System Test Planning of Software: An Optimization Approach

A heuristic-based regression test case prioritization approach for object-oriented programs

An approach to prioritize the regression test cases of object-oriented programs

The Effects of Time Constraints on Test Case Prioritization: A Series of Controlled Experiments

Similar Documents

Prioritizing JUnit Test Cases: An Empirical Assessment and Cost-Benefits Analysis

On the Use of Mutation Faults in Empirical Assessments of Test Case Prioritization Techniques

Search Algorithms for Regression Test Case Prioritization

Size-Constrained Regression Test Case Selection Using Multicriteria Optimization

Semantics guided regression test cost reduction

Early fault detection model using integrated and cost-effective test case prioritization

System Test Planning of Software: An Optimization Approach

A heuristic-based regression test case prioritization approach for object-oriented programs

An approach to prioritize the regression test cases of object-oriented programs

The Effects of Time Constraints on Test Case Prioritization: A Series of Controlled Experiments