NDLI: Test case permutation to improve execution time

Please wait, while we are loading the content...

Program generation for performance

An empirical investigation into the nature of test smells

Predicting semantically linkable knowledge in developer online forums via convolutional neural network

Automatically recommending code reviewers based on their expertise: an empirical comparison

Visualization of combinatorial models and test plans

Local-based active classification of test report to assist crowdsourced testing

Taming Android fragmentation: characterizing and detecting compatibility issues for Android apps

Locus: locating bugs from software changes

StraightTaint: decoupled offline symbolic taint analysis

Radius aware probabilistic testing of deadlocks with guarantees

An empirical evaluation of two user interfaces of an interactive program verifier

Inferring annotations for device drivers from verification histories

On essential configuration complexity: measuring interactions in highly-configurable systems

Symbolic execution of stored procedures in database management systems

Identifying domain elements from textual specifications

Greedy combinatorial test case generation using unsatisfiable cores

Move-optimized source code tree differencing

Bugram: bug detection with n-gram language models

Practical guidelines for change recommendation using association rule mining

Reflection-aware static analysis of Android apps

CORRECT: code reviewer recommendation at GitHub for Vendasta technologies

TeeVML: tool support for semi-automatic integration testing environment emulation

Towards efficient and effective automatic program repair

Changing microsoft's build: revolution or evolution

Evaluating non-adequate test-case reduction

Testing advanced driver assistance systems using multi-objective search and neural networks

Evaluating the evaluations of code recommender systems: a reality check

Finding access control bugs in web applications with CanCheck

Multi-objective test report prioritization using image understanding

Automated model-based Android GUI testing using multi-level GUI comparison criteria

Fine-tuning spectrum based fault localisation with frequent method item sets

IncA: a DSL for the definition of incremental program analyses

LockPeeker: detecting latent locks in Java APIs

Traceability maintenance: factors and guidelines

Array length inference for C library bindings

Precise semantic history slicing through dynamic delta refinement

Conc-iSE: incremental symbolic execution of concurrent software

Continuous detection of design flaws in evolving object-oriented programs using incremental multi-pattern matching

Towards automatically generating descriptive names for unit tests

Migrating cascading style sheets to preprocessors by introducing mixins

Mining input grammars from dynamic taints

Learning a dual-language vector space for domain-specific cross-lingual question retrieval

Relda2: an effective static analysis tool for resource leak detection in Android apps

ProcessPAIR: a tool for automated performance analysis and improvement recommendation in software development

The interactive verification debugger: effective understanding of interactive proof attempts

Automated testing and notification of mobile app privacy leak-cause behaviours

The power of probabilistic thinking

Optimizing customized program coverage

Privacy preserving via interval covering based subclass division and manifold learning based bi-directional obfuscation for effort estimation

Too much automation? the bellwether effect and its implications for transfer learning

SOFIA: an automated security oracle for black-box testing of SQL-injection vulnerabilities

CrowdService: serving the individuals through mobile crowdsourcing and service composition

HybriDroid: static analysis framework for Android hybrid applications

Recommending relevant classes for bug reports using multi-objective search

What developers want and need from program analysis: an empirical study

Sound static deadlock analysis for C/Pthreads

Usage, costs, and benefits of continuous integration in open-source projects

APEx: automated inference of error specifications for C APIs

Goal-conflict detection based on temporal satisfiability checking

Model-based whitebox fuzzing for program binaries

Efficient detection of inconsistencies in a multi-developer engineering environment

Applying combinatorial test data generation to big data applications

Automatic runtime recovery via error handler synthesis

Phrase-based extraction of user opinions in mobile app reviews

An end-user oriented tool suite for development of mobile applications

CVExplorer: identifying candidate developers by mining and exploring their open source contributions

Verifying simulink stateflow model: timed automata approach

Factoring requirement dependencies in software requirement selection using graphs and integer programming

What makes killing a mutant hard

Deep learning code fragments for code clone detection

Automatic microbenchmark generation to prevent dead code elimination and constant folding

Supporting oracle construction via static analysis

QUICKAR: automatic query reformulation for concept location using crowdsourced knowledge

An empirical study on dependence clusters for effort-aware fault-proneness prediction

DistIA: a cost-effective dynamic impact analysis for distributed programs

Static race detection for device drivers: the Goblint approach

DSL-maps: from requirements to design of domain-specific languages

Symbolic execution of complex program driven by machine learning based constraint solving

How good are the specs? a study of the bug-finding effectiveness of existing Java API specifications

Generating test cases to expose concurrency bugs in Android applications

Mining revision histories to detect cross-language clones without intermediates

Model driven design of heterogeneous synchronous embedded systems

Lightweight collection and storage of software repository data with DataRover

GUICat: GUI testing as a service

Statistical analysis of large sets of models

Test case permutation to improve execution time

The IDE as a scriptable information system

Towards bounded model checking using nonlinear programming solver

Automatic test image generation using procedural noise

Battery-aware transformations in mobile applications

MACKE: compositional analysis of low-level vulnerabilities with symbolic execution

Visual contract extractor: a tool for reverse engineering visual contracts using dynamic analysis

An automated collaborative requirements engineering tool for better validation of requirements

Developer targeted analytics: supporting software development decisions with runtime information

BovInspector: automatic inspection and repair of buffer overflow vulnerabilities

SuperMod: tool support for collaborative filtered model-driven software product line engineering

An extensible framework for variable-precision data-flow analyses in MPS

API recommendation system for software development

AnModeler: a tool for generating domain models from textual specifications

SimilarTech: automatically recommend analogical libraries across different programming languages

Test case permutation to improve execution time

Content Provider	ACM Digital Library
Author	Stratis, Panagiotis Rajan, Ajitha
Abstract	With the growing complexity of software, the number of test cases needed for effective validation is extremely large. Executing these large test suites is expensive, both in terms of time and energy. Cache misses are known to be one of the main factors contributing to execution time of a software. Cache misses are reduced by increasing the locality of memory references. For a single program run, compiler optimisations help improve data locality and code layout optimisations help improve spatial locality of instructions. Nevertheless, cache locality optimisations have not been proposed and explored across several program runs, which is the case when we run several test cases. In this paper, we propose and evaluate a novel approach to improve instruction locality across test case runs. Our approach measures the distance between test case runs (number of different instructions). We then permute the test cases for execution so that the distance between neighbouring test cases is minimised. We hypothesise that test cases executed in this new order for improved instruction locality will reduce time consumed. We conduct a preliminary evaluation with four subject programs and test suites from the SIR repository to answer the following questions, 1.~Is execution time of a test suite affected by the order in which test cases are executed? and 2.~How does time consumed in executing our permutation compare to random test case permutations? We found that the order in which test cases are executed has a definite impact on execution time. The extent of impact varies, based on program characteristics and test cases. Our approach outperformed more than 97% of random test case permutations on 3 of the 4 subject programs and did better than 93% of the random orderings on the remaining subject program. Using the optimised permutation, we saw a maximum reduction of 7.4% over average random permutation execution time and 34.7% over the worst permutation. .
Starting Page	45
Ending Page	50
Page Count	6
File Format	PDF
ISBN	9781450338455
DOI	10.1145/2970276.2970331
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2016-08-25
Publisher Place	New York
Access Restriction	Subscribed
Subject Keyword	Instruction locality Cache misses
Content Type	Text
Resource Type	Article

Central Library (ISO-9001:2015 Certified)
Indian Institute of Technology Kharagpur
Kharagpur, West Bengal, India | PIN - 721302

See location in the Map
03222 282435
Mail: support@ndl.gov.in

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in