NDLI: Experimenting with software testbeds for evaluating new technologies

Content Provider	Springer Nature Link
Author	Lindvall, Mikael Rus, Ioana Donzelli, Paolo Memon, Atif Zelkowitz, Marvin Betin Can, Aysu Bultan, Tevfik Ackermann, Chris Anders, Bettina Asgari, Sima Basili, Victor Hochstein, Lorin Fellmann, Jörg Shull, Forrest Tvedt, Roseanne Pech, Daniel Hirschbach, Daniel
Copyright Year	2007
Abstract	The evolution of a new technology depends upon a good theoretical basis for developing the technology, as well as upon its experimental validation. In order to provide for this experimentation, we have investigated the creation of a software testbed and the feasibility of using the same testbed for experimenting with a broad set of technologies. The testbed is a set of programs, data, and supporting documentation that allows researchers to test their new technology on a standard software platform. An important component of this testbed is the Unified Model of Dependability (UMD), which was used to elicit dependability requirements for the testbed software. With a collection of seeded faults and known issues of the target system, we are able to determine if a new technology is adept at uncovering defects or providing other aids proposed by its developers. In this paper, we present the Tactical Separation Assisted Flight Environment (TSAFE) testbed environment for which we modeled and evaluated dependability requirements and defined faults to be seeded for experimentation. We describe two completed experiments that we conducted on the testbed. The first experiment studies a technology that identifies architectural violations and evaluates its ability to detect the violations. The second experiment studies model checking as part of design for verification. We conclude by describing ongoing experimental work studying testing, using the same testbed. Our conclusion is that even though these three experiments are very different in terms of the studied technology, using and re-using the same testbed is beneficial and cost effective.
Starting Page	417
Ending Page	444
Page Count	28
File Format	PDF
ISSN	13823256
Journal	Empirical Software Engineering
Volume Number	12
Issue Number	4
e-ISSN	15737616
Language	English
Publisher	Kluwer Academic Publishers-Plenum Publishers
Publisher Date	2007-02-21
Publisher Place	New York
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Empirical study Technology evaluation Software testbed Programming Languages, Compilers, Interpreters Software Engineering/Programming and Operating Systems
Content Type	Text
Resource Type	Article
Subject	Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Empirical Evaluation of Software Maintenance Technologies

Experiences in developing and applying a software engineering technology testbed

Evaluating Impact Analysis – A Case Study

Empirical Evaluation of Aesthetics-based Graph Layout

Techniques for evaluating fault prediction models

Empirical Studies of Evolving Systems

Empirical Evaluation of CASE Tools Usage at Nokia

Interface Mutation Test Adequacy Criterion: An Empirical Evaluation

Directions and Methodologies for Empirical Software Engineering Research

Experimenting with software testbeds for evaluating new technologies

Similar Documents

Empirical Evaluation of Software Maintenance Technologies

Experiences in developing and applying a software engineering technology testbed

Evaluating Impact Analysis – A Case Study

Empirical Evaluation of Aesthetics-based Graph Layout

Techniques for evaluating fault prediction models

Empirical Studies of Evolving Systems

Empirical Evaluation of CASE Tools Usage at Nokia

Interface Mutation Test Adequacy Criterion: An Empirical Evaluation

Directions and Methodologies for Empirical Software Engineering Research

Experimenting with software testbeds for evaluating new technologies