NDLI: Large-scale information retrieval in software engineering - an experience report from industrial application

Content Provider	Springer Nature Link
Author	Unterkalmsteiner, Michael Gorschek, Tony Feldt, Robert Lavesson, Niklas
Copyright Year	2015
Abstract	Software Engineering activities are information intensive. Research proposes Information Retrieval (IR) techniques to support engineers in their daily tasks, such as establishing and maintaining traceability links, fault identification, and software maintenance. We describe an engineering task, test case selection, and illustrate our problem analysis and solution discovery process. The objective of the study is to gain an understanding of to what extent IR techniques (one potential solution) can be applied to test case selection and provide decision support in a large-scale, industrial setting. We analyze, in the context of the studied company, how test case selection is performed and design a series of experiments evaluating the performance of different IR techniques. Each experiment provides lessons learned from implementation, execution, and results, feeding to its successor. The three experiments led to the following observations: 1) there is a lack of research on scalable parameter optimization of IR techniques for software engineering problems; 2) scaling IR techniques to industry data is challenging, in particular for latent semantic analysis; 3) the IR context poses constraints on the empirical evaluation of IR techniques, requiring more research on developing valid statistical approaches. We believe that our experiences in conducting a series of IR experiments with industry grade data are valuable for peer researchers so that they can avoid the pitfalls that we have encountered. Furthermore, we identified challenges that need to be addressed in order to bridge the gap between laboratory IR experiments and real applications of IR in the industry.
Starting Page	2324
Ending Page	2365
Page Count	42
File Format	PDF
ISSN	13823256
Journal	Empirical Software Engineering
Volume Number	21
Issue Number	6
e-ISSN	15737616
Language	English
Publisher	Springer US
Publisher Date	2015-11-09
Publisher Place	New York
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Test case selection Information retrieval Data mining Experiment Software Engineering/Programming and Operating Systems Programming Languages, Compilers, Interpreters
Content Type	Text
Resource Type	Article
Subject	Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Experience With Regression Test Selection

An evaluation of combination strategies for test case selection

Automated product line test case selection: industrial case study and controlled experiment

A systematic test case selection methodology for product lines: results and insights from an industrial case study

An industrial case study in reconstructing requirements views

Report from an Experiment: Impact of Documentation on Maintenance

Empirical software engineering: Industrial experience reports

Change-based test selection: an empirical evaluation

Reporting experiments to satisfy professionals’ information needs

Large-scale information retrieval in software engineering - an experience report from industrial application

Similar Documents

Experience With Regression Test Selection

An evaluation of combination strategies for test case selection

Automated product line test case selection: industrial case study and controlled experiment

A systematic test case selection methodology for product lines: results and insights from an industrial case study

An industrial case study in reconstructing requirements views

Report from an Experiment: Impact of Documentation on Maintenance

Empirical software engineering: Industrial experience reports

Change-based test selection: an empirical evaluation

Reporting experiments to satisfy professionals’ information needs

Large-scale information retrieval in software engineering - an experience report from industrial application