NDLI: A systematic test case selection methodology for product lines: results and insights from an industrial case study

Content Provider	Springer Nature Link
Author	Wang, Shuai Ali, Shaukat Gotlieb, Arnaud Liaaen, Marius
Copyright Year	2014
Abstract	In the context of product lines, test case selection aims at obtaining a set of relevant test cases for a product from the entire set of test cases available for a product line. While working on a research-based innovation project on automated testing of product lines of Video Conferencing Systems (VCSs) developed by Cisco, we felt the need to devise a cost-effective way of selecting relevant test cases for a product. To fulfill such need, we propose a systematic and automated test selection methodology using: 1) Feature Model for Testing (FM_T) to capture commonalities and variabilities of a product line; 2) Component Family Model for Testing (CFM_T) to model the structure of test case repository; 3) A tool to automatically build restrictions from CFM_T to FM_T and traces from CFM_T to the actual test cases. Using our methodology, a test engineer is only required to select relevant features through FM_T at a higher level of abstraction for a product and the corresponding test cases will be obtained automatically. We evaluate our methodology by applying it to a VCS product line called Saturn with seven commercial products and the results show that our methodology can significantly reduce cost measured as test selection time and at the same time achieves higher effectiveness (feature coverage, feature pairwise coverage and fault detection) as compared with the current manual process. Moreover, we conduct a questionnaire-based study to solicit the views of test engineers who are involved in developing FM_T and CFM_T. The results show that test engineers are positive about adapting our methodology in their current practice. Finally, we present a set of lessons learnt while applying product line engineering at Cisco for test case selection.
Starting Page	1586
Ending Page	1622
Page Count	37
File Format	PDF
ISSN	13823256
Journal	Empirical Software Engineering
Volume Number	21
Issue Number	4
e-ISSN	15737616
Language	English
Publisher	Springer US
Publisher Date	2014-12-10
Publisher Place	New York
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Test case selection Product line Feature model Component family model Software Engineering/Programming and Operating Systems Programming Languages, Compilers, Interpreters
Content Type	Text
Resource Type	Article
Subject	Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Automated product line test case selection: industrial case study and controlled experiment

Assessing software product line potential: an exploratory industrial case study

Performance variability in software product lines: proposing theories from a case study

Breathing ontological knowledge into feature model synthesis: an empirical study

Model-based pairwise testing for feature interaction coverage in software product line engineering

Large-scale information retrieval in software engineering - an experience report from industrial application

An algebra of product families

Quantifying structural attributes of system decompositions in 28 feature-oriented software product lines : An exploratory study

An evaluation of combination strategies for test case selection

A systematic test case selection methodology for product lines: results and insights from an industrial case study

Similar Documents

Automated product line test case selection: industrial case study and controlled experiment

Assessing software product line potential: an exploratory industrial case study

Performance variability in software product lines: proposing theories from a case study

Breathing ontological knowledge into feature model synthesis: an empirical study

Model-based pairwise testing for feature interaction coverage in software product line engineering

Large-scale information retrieval in software engineering - an experience report from industrial application

An algebra of product families

Quantifying structural attributes of system decompositions in 28 feature-oriented software product lines : An exploratory study

An evaluation of combination strategies for test case selection

A systematic test case selection methodology for product lines: results and insights from an industrial case study