NDLI: Measurable Metrics for Qualitative Guidelines of Metamorphic Relation

Content Provider	IEEE Xplore Digital Library
Author	Zhan-Wei Hui Song Huang Hui Li Jian-Hao Liu Li-Ping Rao
Copyright Year	2015
Description	Author affiliation: Inf. Countermeasure Dept., Air Force Early Warning Acad., Wuhan, China (Jian-Hao Liu) \|\| Software Testing & Evaluation Center, PLA Univ. of Sci. & Technol., Nanjing, China (Zhan-Wei Hui; Song Huang; Hui Li; Li-Ping Rao)
Abstract	In software testing, test oracles do not always exist or are too hard to generate, which is called "test oracle problem". Metamorphic testing (MT) provide an effective way to alleviate the problem based on metamorphic relations (MR). As a MR is satisfied by a set of test cases, it does not mean that the test cases are success. Therefore, more MRs are needed to improve the effectiveness of MT. For different programs, great deals of valuable MRs have been generated. But not all of them are effective in fault detection. Then, the next issue is how to select the better MRs which could detect the failed test cases as soon as possible. To resolve this problem, several qualitative guidelines were proposed for MR priority recently. For the MRs described with different forms, these guidelines could be used to select the effective MRs and improve the performance of MT observably. In our previous research, we constructed a formal model for MR, with which a MR could be decomposed into three sub relations. In this paper, based on the sub relations of MR, we provide three measurable metrics for MR selection: in-degree of MR, algebra complexity of MR, and distance between test inputs of MR. To evaluate the effectiveness of these metrics, we also conducted experiments on four programs with different numbers of MRs. The empirical results show that the metrics are correlated with the effectiveness of MRs and the previous MR selection guidelines.
Starting Page	417
Ending Page	422
File Size	190481
Page Count	6
File Format	PDF
ISSN	07303157
e-ISBN	9781467365642
DOI	10.1109/COMPSAC.2015.179
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2015-07-01
Publisher Place	Taiwan
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Testing Measurement Complexity theory Correlation Fault detection Guidelines Algebra metri metamorphic relation metamorphic testing test priority
Content Type	Text
Resource Type	Article
Subject	Computer Science Applications Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Achievements and Challenges of Metamorphic Testing

On the Correlation between the Effectiveness of Metamorphic Relations and Dissimilarities of Test Case Executions

On Testing Effectiveness of Metamorphic Relations: A Case Study

An Empirical Comparison of Fault-Prone Module Detection Approaches: Complexity Metrics and Text Feature Metrics

Testing extensible design patterns in object-oriented frameworks through scenario templates

Iterative Metamorphic Testing

Concolic Metamorphic Debugging

Metamorphic relations to improve the test accuracy of Multi Precision Arithmetic software applications

Fault Detection Effectiveness of Source Test Case Generation Strategies for Metamorphic Testing

Measurable Metrics for Qualitative Guidelines of Metamorphic Relation

Similar Documents

Achievements and Challenges of Metamorphic Testing

On the Correlation between the Effectiveness of Metamorphic Relations and Dissimilarities of Test Case Executions

On Testing Effectiveness of Metamorphic Relations: A Case Study

An Empirical Comparison of Fault-Prone Module Detection Approaches: Complexity Metrics and Text Feature Metrics

Testing extensible design patterns in object-oriented frameworks through scenario templates

Iterative Metamorphic Testing

Concolic Metamorphic Debugging

Metamorphic relations to improve the test accuracy of Multi Precision Arithmetic software applications

Fault Detection Effectiveness of Source Test Case Generation Strategies for Metamorphic Testing

Measurable Metrics for Qualitative Guidelines of Metamorphic Relation