NDLI: Evaluation in Music Information Retrieval

Content Provider	Springer Nature Link
Author	Urba, Julián Schedl, Markus Serra, Xavier
Copyright Year	2013
Abstract	The field of Music Information Retrieval has always acknowledged the need for rigorous scientific evaluations, and several efforts have set out to develop and provide the infrastructure, technology and methodologies needed to carry out these evaluations. The community has enormously gained from these evaluation forums, but we have reached a point where we are stuck with evaluation frameworks that do not allow us to improve as much and as well as we want. The community recently acknowledged this problem and showed interest in addressing it, though it is not clear what to do to improve the situation. We argue that a good place to start is again the Text IR field. Based on a formalization of the evaluation process, this paper presents a survey of past evaluation work in the context of Text IR, from the point of view of validity, reliability and efficiency of the experiments. We show the problems that our community currently has in terms of evaluation, point to several lines of research to improve it and make various proposals in that line.
Starting Page	345
Ending Page	369
Page Count	25
File Format	PDF
ISSN	09259902
Journal	Journal of Intelligent Information Systems
Volume Number	41
Issue Number	3
e-ISSN	15737675
Language	English
Publisher	Springer US
Publisher Date	2013-07-13
Publisher Place	Boston
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Music Information Retrieval Text Information Retrieval Evaluation and Experimentation Survey Information Storage and Retrieval Data Structures, Cryptology and Information Theory Artificial Intelligence (incl. Robotics) Business Information Systems Document Preparation and Text Processing
Content Type	Text
Resource Type	Article
Subject	Artificial Intelligence Computer Networks and Communications Information Systems Software Hardware and Architecture

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

The neglected user in music information retrieval research

Editorial—Music Information Retrieval

Classification accuracy is not enough : On the evaluation of music genre recognition systems

Automatic music transcription: challenges and future directions

Robust Polyphonic Music Retrieval with N-grams

Mining complex patterns

Feature learning and deep architectures: new directions for music informatics

MIRrors: Music Information Research reflects on its future : Special issue foreword

Capturing the workflows of music information retrieval for repeatability and reuse

Evaluation in Music Information Retrieval

Similar Documents

The neglected user in music information retrieval research

Editorial—Music Information Retrieval

Classification accuracy is not enough : On the evaluation of music genre recognition systems

Automatic music transcription: challenges and future directions

Robust Polyphonic Music Retrieval with N-grams

Mining complex patterns

Feature learning and deep architectures: new directions for music informatics

MIRrors: Music Information Research reflects on its future : Special issue foreword

Capturing the workflows of music information retrieval for repeatability and reuse

Evaluation in Music Information Retrieval