NDLI: On the Effectiveness of Unit Test Automation at Microsoft

Content Provider	IEEE Xplore Digital Library
Author	Williams, L. Kudrjavets, G. Nagappan, N.
Copyright Year	2009
Abstract	Instituting an automated unit testing practice across a large software development team can be technically challenging and time consuming. As a result, teams may question the economic value of instituting such a practice. One large Microsoft team consisting of 32 developers transitioned from ad hoc and individualized unit testing practices to the utilization of the NUnit automated unit testing framework by all members of the team. These automated unit tests were typically written by developers after they completed coding functionality, approximately every two to three days. After a period of one year of utilizing this automated unit testing practice on Version 2 of a product, the team realized a 20.9% decrease in test defects at a cost of approximately 30% more development time relative to Version 1 of the product. The product also had a relative decrease in defects found by customers during the first two years of field use. Comparatively, other industrial teams have experienced larger decreases in defects when automated unit tests are written iteratively, as is done with the test driven development practice, for a similar time increase. These results indicate automated unit testing is beneficial but additional quality improvements may be realized if the tests are written iteratively.
Starting Page	81
Ending Page	89
File Size	339920
Page Count	9
File Format	PDF
ISBN	9781424453757
ISSN	10719458
DOI	10.1109/ISSRE.2009.32
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2009-11-16
Publisher Place	India
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Automatic testing Automation Software testing Programming Writing Software reliability Reliability engineering Computer science Performance analysis Performance evaluation test-driven development unit testing
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

An Experimental Evaluation of the Effectiveness and Efficiency of the Test Driven Development

On the Effectiveness of Unit Test Automation at Microsoft

What Makes Testing Work: Nine Case Studies of Software Development Teams

Test-driven development concepts, taxonomy, and future direction

Towards traceable test-driven development

Automated Software Testing for Matlab

On the Sustained Use of a Test-Driven Development Practice at IBM

N.: On the Effectiveness of Unit Test Automation at Microsoft (2010)

Automation component aspects for efficient unit testing

On the Effectiveness of Unit Test Automation at Microsoft

Similar Documents

An Experimental Evaluation of the Effectiveness and Efficiency of the Test Driven Development

On the Effectiveness of Unit Test Automation at Microsoft

What Makes Testing Work: Nine Case Studies of Software Development Teams

Test-driven development concepts, taxonomy, and future direction

Towards traceable test-driven development

Automated Software Testing for Matlab

On the Sustained Use of a Test-Driven Development Practice at IBM

N.: On the Effectiveness of Unit Test Automation at Microsoft (2010)

Automation component aspects for efficient unit testing

On the Effectiveness of Unit Test Automation at Microsoft