NDLI: Using JML Runtime Assertion Checking to Automate Metamorphic Testing in Applications without Test Oracles

Content Provider	IEEE Xplore Digital Library
Author	Murphy, C. Kuang Shen Kaiser, G.
Copyright Year	2009
Abstract	It is challenging to test applications and functions for which the correct output for arbitrary input cannot be known in advance, e.g. some computational science or machine learning applications. In the absence of a test oracle, one approach to testing these applications is to use metamorphic testing: existing test case input is modified to produce new test cases in such a manner that, when given the new input, the application should produce an output that can be easily be computed based on the original output. That is, if input x produces output f(x), then we create input x' such that we can predict f(x') based on f(x); if the application or function does not produce the expected output, then a defect must exist, and either f(x) or f(x') (or both) is wrong. By using metamorphic testing, we are able to provide built-in "pseudo-oracles" for these so-called "nontestable programs" that have no test oracles.In this paper, we describe an approach in which a function's metamorphic properties are specified using an extension to the Java Modeling Language (JML), a behavioral interface specification language that is used to support the "design by contract" paradigm in Java applications. Our implementation, called Corduroy, pre-processes these specifications and generates test code that can be executed using JML runtime assertion checking, for ensuring that the specifications hold during program execution. In addition topresenting our approach and implementation, we also describe our findings from case studies in which we apply our technique to applications without test oracles.
Starting Page	436
Ending Page	445
File Size	310408
Page Count	10
File Format	PDF
ISBN	9781424437757
DOI	10.1109/ICST.2009.19
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2009-04-01
Publisher Place	USA
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Software testing Java software testing Specification languages Application software Data mining machine learning oracle problem Computer science Runtime Automatic testing Machine learning Contracts
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Using jml runtime assertion checking to automate metamorphic testing in applications without test oracles.

Techniques for testing scientific programs without an Oracle

Techniques for testing scientific programs without an oracle

Automatic system testing of programs without test oracles

temporaljmlc: A JML Runtime Assertion Checker Extension for Specification and Checking of Temporal Properties

A Runtime Assertion Checker for the Java Modeling Language (JML) (2002)

Using Metamorphic Testing at Runtime to Detect Defects in Applications without Test Oracles (2008)

A JML Compiler Based on AspectJ

Metamorphic Runtime Checking of Applications without Test Oracles

Using JML Runtime Assertion Checking to Automate Metamorphic Testing in Applications without Test Oracles

Similar Documents

Using jml runtime assertion checking to automate metamorphic testing in applications without test oracles.

Techniques for testing scientific programs without an Oracle

Techniques for testing scientific programs without an oracle

Automatic system testing of programs without test oracles

temporaljmlc: A JML Runtime Assertion Checker Extension for Specification and Checking of Temporal Properties

A Runtime Assertion Checker for the Java Modeling Language (JML) (2002)

Using Metamorphic Testing at Runtime to Detect Defects in Applications without Test Oracles (2008)

A JML Compiler Based on AspectJ

Metamorphic Runtime Checking of Applications without Test Oracles

Using JML Runtime Assertion Checking to Automate Metamorphic Testing in Applications without Test Oracles