NDLI: Can We Trust Our Results? A Mapping Study on Data Quality

Content Provider	IEEE Xplore Digital Library
Author	Rosli, M.M. Tempero, E. Luxton-Reilly, A.
Copyright Year	2013
Description	Author affiliation: Dept. of Comput. Sci., Univ. of Auckland, Auckland, New Zealand (Rosli, M.M.; Tempero, E.; Luxton-Reilly, A.)
Abstract	Background: The quality of data sets used in software engineering research is of the utmost importance. To ensure credibility of results obtained from use of data sets, the quality of the data must be examined. Objective: This study provides an overview of recent research(2008-2012) involving data quality in software engineering datasets, with the goal of generally understanding what research there is that addresses data quality, and in particular to determine to what degree researchers have addressed any data quality issues in order to evaluate the trustworthiness of their results. Method: We performed a systematic mapping study to investigate treatment of data quality issues in software engineering research. A total of 64 papers published from 2008 to 2012explicitly address issues with the quality of data and use software engineering data sets. These studies were classified according to the data quality topic, data set and data quality problem. Results: We found only 31 studies gave serious consideration for how the quality of the data affected their results. We observed that there is a lack of clear and consistent terminology regarding data quality, especially with respect to the kinds of quality problems a data set might have. As a first step to address this problem, we propose a model that describes the lifecycle that research data goes through when used in research. Conclusions: The results suggest that researchers should give more attention to the quality of data sets in order to produce trustworthy data for reliable empirical research, and that the research community needs to better understand and communicate issues with data quality.
Sponsorship	Prov. Electr. Auth.
Starting Page	116
Ending Page	123
File Size	416879
Page Count	8
File Format	PDF
ISSN	15301362
e-ISBN	9781479921447
DOI	10.1109/APSEC.2013.26
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2013-12-02
Publisher Place	Thailand
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Systematics Software engineering Noise Data collection Cleaning Context Manuals software engineering data sets data quality empirical studies systematic mapping
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Replication of Empirical Studies in Software Engineering: Preliminary Findings from a Systematic Mapping Study

Replication of Empirical Studies in Software Engineering: An Update of a Systematic Mapping Study

Data Sets and Data Quality in Software Engineering: Eight Years On

A Systematic Mapping Study on Software Engineering Testbeds

Support mechanisms to conduct empirical studies in software engineering: a systematic mapping study

Bloom's taxonomy in software engineering education: A systematic mapping study

What do we know about software product management? - a systematic mapping study

Systematic mapping study of missing values techniques in software engineering data

Variability in Software Systems—A Systematic Literature Review

Can We Trust Our Results? A Mapping Study on Data Quality

Similar Documents

Replication of Empirical Studies in Software Engineering: Preliminary Findings from a Systematic Mapping Study

Replication of Empirical Studies in Software Engineering: An Update of a Systematic Mapping Study

Data Sets and Data Quality in Software Engineering: Eight Years On

A Systematic Mapping Study on Software Engineering Testbeds

Support mechanisms to conduct empirical studies in software engineering: a systematic mapping study

Bloom's taxonomy in software engineering education: A systematic mapping study

What do we know about software product management? - a systematic mapping study

Systematic mapping study of missing values techniques in software engineering data

Variability in Software Systems—A Systematic Literature Review

Can We Trust Our Results? A Mapping Study on Data Quality