NDLI: On the role of tests in test-driven development: a differentiated and partial replication

Please wait, while we are loading the content...

On the role of tests in test-driven development: a differentiated and partial replication

Content Provider	Springer Nature Link
Author	Fucci, Davide Turhan, Burak
Copyright Year	2013
Abstract	Background: Test-Driven Development (TDD) is claimed to have positive effects on external code quality and programmers’ productivity. The main driver for these possible improvements is the tests enforced by the test-first nature of TDD as previously investigated in a controlled experiment (i.e. the original study). Aim: Our goal is to examine the nature of the relationship between tests and external code quality as well as programmers’ productivity in order to verify/ refute the results of the original study. Method: We conducted a differentiated and partial replication of the original setting and the related analyses, with a focus on the role of tests. Specifically, while the original study compared test-first vs. test-last, our replication employed the test-first treatment only. The replication involved 30 students, working in pairs or as individuals, in the context of a graduate course, and resulted in 16 software artifacts developed. We performed linear regression to test the original study’s hypotheses, and analyses of covariance to test the additional hypotheses imposed by the changes in the replication settings. Results: We found significant correlation (Spearman coefficient = 0.66, with p-value = 0.004) between the number of tests and productivity, and a positive regression coefficient (p-value = 0.011). We found no significant correlation (Spearman coefficient = 0.41 with p-value = 0.11) between the number of tests and external code quality (regression coefficient p-value = 0.0513). For both cases we observed no statistically significant interaction caused by the subject units being individuals or pairs. Further, our results are consistent with the original study although there were changes in the timing constraints for finishing the task and the enforced development processes. Conclusions: This replication study confirms the results of the original study concerning the relationship between the number of tests vs. external code quality and programmer productivity. Moreover, this replication allows us to identify additional context variables, for which the original results still hold; namely the subject unit, timing constraint and isolation of test-first process. Based on our findings, we recommend practitioners to implement as many tests as possible in order to achieve higher baselines for quality and productivity.
Starting Page	277
Ending Page	302
Page Count	26
File Format	PDF
ISSN	13823256
Journal	Empirical Software Engineering
Volume Number	19
Issue Number	2
e-ISSN	15737616
Language	English
Publisher	Springer US
Publisher Date	2013-06-21
Publisher Place	Boston
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Test-driven development Software quality Productivity Software testing Replication Software Engineering/Programming and Operating Systems Programming Languages, Compilers, Interpreters
Content Type	Text
Resource Type	Article
Subject	Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

The effectiveness of test-driven development: an industrial case study

The effect of experience on the test-driven development process

Test-Driven Development in scientific software: a survey

Testing of model-driven development applications

Realizing quality improvement through test driven development: results and experiences of four industrial teams

Experiences with incorporating formal techniques into industrial practice

A successful application of a Test-Driven Development strategy in the industrial environment

The Economics of Unit Testing

Experience With Regression Test Selection

On the role of tests in test-driven development: a differentiated and partial replication

Similar Documents

The effectiveness of test-driven development: an industrial case study

The effect of experience on the test-driven development process

Test-Driven Development in scientific software: a survey

Testing of model-driven development applications

Realizing quality improvement through test driven development: results and experiences of four industrial teams

Experiences with incorporating formal techniques into industrial practice

A successful application of a Test-Driven Development strategy in the industrial environment

The Economics of Unit Testing

Experience With Regression Test Selection

On the role of tests in test-driven development: a differentiated and partial replication