NDLI: A Genetic Algorithm-Based Stress Test Requirements Generator Tool and Its Empirical Evaluation

Content Provider	IEEE Xplore Digital Library
Author	Garousi, V.
Copyright Year	1976
Abstract	Genetic algorithms (GAs) have been applied previously to UML-driven stress test requirements generation with the aim of increasing chances of discovering faults relating to network traffic in distributed real-time systems. However, since evolutionary algorithms are heuristic, their performance can vary across multiple executions, which may affect robustness and scalability. To address this, we present the design and technical detail of a UML-driven, GA-based stress test requirements generation tool, together with its empirical analysis. The main goal is to analyze and improve the applicability, efficiency, and effectiveness and also to validate the design choices of the GA used in the tool. Findings of the empirical evaluation reveal that the tool is robust and reasonably scalable when it is executed on large-scale experimental design models. The study also reveals the main bottlenecks and limitations of the tools, e.g., there is a performance bottleneck when the system under test has a large number of sequence diagrams which could be triggered independently from each other. In addition, issues specific to stress testing, e.g., the impact of variations in task arrival pattern types, reveal that the tool generally generates effective test requirements, although the features of those test requirements might be different in different runs (e.g., different stress times from the test start time might be chosen). While the use of evolutionary algorithms to generate software test cases has been widely reported, the extent, depth, and detail of the empirical findings presented in this paper are novel and suggest that the proposed approach is effective and efficient in generating stress test requirements. It is hoped that the findings of this empirical study will help other SBSE researchers with the empirical evaluation of their own techniques and tools.
Sponsorship	IEEE Computer Society Technical Council on Software Engineering Association for Computing Machinery (ACM) IEEE Computer Society
Starting Page	778
Ending Page	797
Page Count	20
File Size	6224191
File Format	PDF
ISSN	00985589
Volume Number	36
Issue Number	6
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2010-11-01
Publisher Place	U.S.A.
Access Restriction	One Nation One Subscription (ONOS)
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Stress System testing Robustness Genetic algorithms Telecommunication traffic Real time systems Evolutionary computation Scalability Large-scale systems Design for experiments empirical analysis. Index Term—Search-based testing genetic algorithms stress testing test tools test automation
Content Type	Text
Resource Type	Article
Subject	Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

A Systematic Review of the Application and Empirical Investigation of Search-Based Test Case Generation

A Theoretical and Empirical Study of Search-Based Testing: Local, Global, and Hybrid Search

A general-purpose tunable landscape generator

Search-Based Test Data Generator for Data-Flow Dependencies Using Dominance Concepts, Branch Distance and Elitism

On the Scalability of Real-Coded Bayesian Optimization Algorithm

Applying a Traffic Lights Evolutionary Optimization Technique to a Real Case: “Las Ramblas” Area in Santa Cruz de Tenerife

Generating Test Data from OCL Constraints with Search Techniques

Search-Based Procedural Content Generation: A Taxonomy and Survey

Multiple-Searching Genetic Algorithm for Whole Test Suites

A Genetic Algorithm-Based Stress Test Requirements Generator Tool and Its Empirical Evaluation

Similar Documents

A Systematic Review of the Application and Empirical Investigation of Search-Based Test Case Generation

A Theoretical and Empirical Study of Search-Based Testing: Local, Global, and Hybrid Search

A general-purpose tunable landscape generator

Search-Based Test Data Generator for Data-Flow Dependencies Using Dominance Concepts, Branch Distance and Elitism

On the Scalability of Real-Coded Bayesian Optimization Algorithm

Applying a Traffic Lights Evolutionary Optimization Technique to a Real Case: “Las Ramblas” Area in Santa Cruz de Tenerife

Generating Test Data from OCL Constraints with Search Techniques

Search-Based Procedural Content Generation: A Taxonomy and Survey

Multiple-Searching Genetic Algorithm for Whole Test Suites

A Genetic Algorithm-Based Stress Test Requirements Generator Tool and Its Empirical Evaluation