NDLI: Investigating data quality problems in the PSP

Content Provider	ACM Digital Library
Author	Disney, Anne M. Johnson, Philip M.
Abstract	The Personal Software Process (PSP) is used by software engineers to gather and analyze data about their work. Published studies typically use data collected using the PSP to draw quantitative conclusions about its impact upon programmer behavior and product quality. However, our experience using PSP in both industrial and academic settings revealed problems both in collection of data and its later analysis. We hypothesized that these two kinds of data quality problems could make a significant impact upon the value of PSP measures. To test this hypothesis, we built a tool to automate the PSP and then examined 89 projects completed by ten subjects using the PSP manually in an educational setting. We discovered 1539 primary errors and categorized them by type, subtype, severity, and age. To examine the collection problem we looked at the 90 errors that represented impossible combinations of data and at other less concrete anomalies in Time Recording Logs and Defect Recording Logs. To examine the analysis problem we developed a rule set, corrected the errors as far as possible, and compared the original and corrected data. This resulted in significant differences for measures such as yield and the cost-performance ratio, confirming our hypothesis. Our results raise questions about the accuracy of manually collected and analyzed PSP data, indicate that integrated tool support may be required for high quality PSP data analysis, and suggest that external measures should be used when attempting to evaluate the impact of the PSP upon programmer behavior and product quality.
Starting Page	143
Ending Page	152
Page Count	10
File Format	PDF
ISSN	01635948
DOI	10.1145/291252.288292
Journal	ACM SIGSOFT Software Engineering Notes (SOEN)
Volume Number	23
Issue Number	6
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	1979-04-01
Publisher Place	New York
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Automated process support Empirical software engineering Measurement dysfunction Personal software process Defects
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Investigating data quality problems in the PSP

The Impact of Design and Code Reviews on Software Quality: An Empirical Study Based on PSP Data

The personal software process (PSP): a full-day tutorial

Lessons learned from teaching reflective software engineering using the leap toolkit (2000).

Applying the personal software process (PSP) with Ada

An experiment measuring the effects of personal software process (PSP) training

Applying the PSP in industry

Automating a modified personal software process.

PSP PAIR: Automated Personal Software Process Performance Analysis and Improvement Recommendation

Investigating data quality problems in the PSP

Similar Documents

Investigating data quality problems in the PSP

The Impact of Design and Code Reviews on Software Quality: An Empirical Study Based on PSP Data

The personal software process (PSP): a full-day tutorial

Lessons learned from teaching reflective software engineering using the leap toolkit (2000).

Applying the personal software process (PSP) with Ada

An experiment measuring the effects of personal software process (PSP) training

Applying the PSP in industry

Automating a modified personal software process.

PSP PAIR: Automated Personal Software Process Performance Analysis and Improvement Recommendation

Investigating data quality problems in the PSP