NDLI: Identifying test-suite-overfitted patches through test case generation

Please wait, while we are loading the content...

One test to rule them all

Targeted property-based testing

Accelerating array constraints in symbolic execution

Efficient computation of happens-before relation for event-driven programs

Effective online software anomaly detection

Testing and analysis of web applications using page models

Experience paper: a study on behavioral backward incompatibilities of Java software libraries

Identifying test-suite-overfitted patches through test case generation

Boosting spectrum-based fault localization using PageRank

Just-in-time static analysis

Phriky-units: a lightweight, annotation-free physical unit inconsistency detection tool

Consistency checking in requirements analysis

Automatically inferring and enforcing user expectations

Data flow oriented UI testing: exploiting data flows and UI elements to test Android applications

Reinforcement learning for automatic test case prioritization and selection in continuous integration

Generating unit tests with descriptive names or: would you name your children thing1 and thing2?

Improving the cost-effectiveness of symbolic testing techniques for transport protocol implementations under packet dynamics

Automatic detection and validation of race conditions in interrupt-driven embedded software

Semi-automated discovery of server-based information oversharing vulnerabilities in Android applications

Automated layout failure detection for responsive web pages without an explicit oracle

Impact of tool support in patch construction

FLUCCS: using code and change metrics to improve fault localization

Refining interprocedural change-impact analysis using equivalence relations

A suite of tools for making effective use of automatically generated tests

Inferring page models for web application analysis

Understanding intended behavior using models of low-level signals

Dynamic tainting for automatic test case generation

PerfRanker: prioritization of performance regression tests for collection-intensive software

Combining symbolic execution and search-based testing for programs with complex heap inputs

Monitoring decentralized specifications

CPR: cross platform binary code reuse via platform independent trace program

Test execution checkpointing for web applications

Automated repair of layout cross browser issues using search-based techniques

Inferring mutant utility from program context

Boosting the precision of virtual call integrity protection with partial pointer analysis for C++

ReDeCheck: an automatic layout failure checking tool for responsively designed web pages

Path cost analysis for side channel detection

Version space learning for verification on temporal differentials

Mapping hardness of automated software testing

Compiler-assisted test acceleration on GPUs for embedded software

An actionable performance profiler for optimizing the order of evaluations

Faster mutation analysis via equivalence modulo states

Lightweight detection of physical unit inconsistencies without program annotations

CUT: automatic unit testing in the cloud

Oracle problem in software testing

XFix: an automated tool for the repair of layout cross browser issues

THEMIS: a tool for decentralized monitoring algorithms

JFIX: semantics-based repair of Java programs via symbolic PathFinder

ArtForm: a tool for exploring the codebase of form-based websites

ParTeCL: parallel testing using OpenCL

Verifying digital systems with MATLAB

SealTest: a simple library for test sequence generation

GitcProc: a tool for processing and classifying GitHub commits

Caret-HM: recording and replaying Android user sessions with heat map generation using UI state clustering

LabPal: repeatable computer experiments made easy

Identifying test-suite-overfitted patches through test case generation

Content Provider	ACM Digital Library
Author	Xin, Qi Reiss, Steven P.
Abstract	A typical automatic program repair technique that uses a test suite as the correct criterion can produce a patched program that is test-suite-overfitted, or overfitting, which passes the test suite but does not actually repair the bug. In this paper, we propose DiffTGen which identifies a patched program to be overfitting by first generating new test inputs that uncover semantic differences between the original faulty program and the patched program, then testing the patched program based on the semantic differences, and finally generating test cases. Such a test case could be added to the original test suite to make it stronger and could prevent the repair technique from generating a similar overfitting patch again. We evaluated DiffTGen on 89 patches generated by four automatic repair techniques for Java with 79 of them being likely to be overfitting and incorrect. DiffTGen identifies in total 39 (49.4%) overfitting patches and yields the corresponding test cases. We further show that an automatic repair technique, if configured with DiffTGen, could avoid yielding overfitting patches and potentially produce correct ones. .
Starting Page	226
Ending Page	236
Page Count	11
File Format	PDF
ISBN	9781450350761
DOI	10.1145/3092703.3092718
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2017-07-10
Publisher Place	New York
Access Restriction	Subscribed
Subject Keyword	Patch overfitting Test case generation Automatic program repair
Content Type	Text
Resource Type	Article

Central Library (ISO-9001:2015 Certified)
Indian Institute of Technology Kharagpur
Kharagpur, West Bengal, India | PIN - 721302

See location in the Map
03222 282435
Mail: support@ndl.gov.in

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in