NDLI: Real-time audio-to-score alignment of music performances containing errors and arbitrary repeats and skips

Please wait, while we are loading the content...

IEEE/ACM Transactions on Audio, Speech and Language Processing (TASLP) : Volume 24

Issue 9, September 2016

Issue 2, February 2016

Regularization approaches for synthesizing HRTF directivity patterns

Design of directivity patterns with a unique null of maximum multiplicity

Robust speech recognition via enhancing the complex-valued acoustic spectrum in modulation domain

Boosting contextual information for deep neural network based voice activity detection

Source and filter estimation for throat-microphone speech enhancement

Speech dereverberation using non-negative convolutive transfer function and spectro-temporal modeling

Two-stage supervised learning-based method to detect screams and cries in urban environments

Directivity factors of the first-order steerable differential array with microphone mismatches: deterministic and worst-case analysis

A fast method for high-resolution voiced/unvoiced detection and glottal closure/opening instant estimation of speech

Real-time audio-to-score alignment of music performances containing errors and arbitrary repeats and skips

Optimizing the similarity of loudspeaker-room responses in multiple listening positions

The hearing-aid audio quality index (HAAQI)

A semidefinite programming approach to min-max estimation of the common part of acoustic feedback paths in hearing aids

Packet loss concealment based on deep neural networks for digital speech transmission

On the evaluation of adaptive machine translation for human post-editing

Issue 1, January 2016

IEEE/ACM Transactions on Audio, Speech and Language Processing (TASLP) : Volume 23

IEEE/ACM Transactions on Audio, Speech and Language Processing (TASLP) : Volume 22

Real-time audio-to-score alignment of music performances containing errors and arbitrary repeats and skips

Content Provider	ACM Digital Library
Author	Sagayama, Shigeki Nakamura, Tomohiko Nakamura, Eita
Copyright Year	2016
Abstract	This paper discusses real-time alignment of audio signals of music performance to the corresponding score (a.k.a. score following) which can handle tempo changes, errors and arbitrary repeats and/or skips (repeats/skips) in performances. This type of score following is particularly useful in automatic accompaniment for practices and rehearsals, where errors and repeats/skips are often made. Simple extensions of the algorithms previously proposed in the literature are not applicable in these situations for scores of practical length due to the problem of large computational complexity. To cope with this problem, we present two hidden Markov models of monophonic performance with errors and arbitrary repeats/skips, and derive efficient score-following algorithms with an assumption that the prior probability distributions of score positions before and after repeats/skips are independent from each other. We confirmed real-time operation of the algorithms with music scores of practical length (around 10000 notes) on a modern laptop and their tracking ability to the input performance within 0.7 s on average after repeats/skips in clarinet performance data. Further improvements and extension for polyphonic signals are also discussed.
Starting Page	329
Ending Page	339
Page Count	11
File Format	PDF
ISSN	23299290
e-ISSN	23299304
DOI	10.1109/TASLP.2015.2507862
Volume Number	24
Issue Number	2
Journal	IEEE/ACM Transactions on Audio, Speech and Language Processing (TASLP)
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2016-02-01
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Arbitrary repeats and skips Audio-to-score alignment Fast Viterbi algorithm Hidden Markov model Music signal processing Score following
Content Type	Text
Resource Type	Article
Subject	Instrumentation Computational Mathematics Signal Processing Electrical and Electronic Engineering Acoustics and Ultrasonics Speech and Hearing Media Technology

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Real-Time Audio-to-Score Alignment of Music Performances Containing Errors and Arbitrary Repeats and Skips

Real-Time Audio-to-Score Alignment of Music Performances Containing Errors and Arbitrary Repeats and Skips

A Conditional Random Field Framework for Robust and Scalable Audio-to-Score Matching

Codebook-Based Audio Feature Representation for Music Information Retrieval

Off-line refinement of audio-to-score alignment by observation template adaptation

Audio Bandwidth Extension Based on Ensemble Echo State Networks with Temporal Evolution

HMM-Based Speech Segmentation: Improvements of Fully Automatic Approaches

Acoustic Score Following to Musical Performance With Errors and Arbitrary Repeats and Skips for Automatic Accompaniment

HMM-based speech segmentation: improvements of fully automatic approaches

Real-time audio-to-score alignment of music performances containing errors and arbitrary repeats and skips

Similar Documents

Real-Time Audio-to-Score Alignment of Music Performances Containing Errors and Arbitrary Repeats and Skips

Real-Time Audio-to-Score Alignment of Music Performances Containing Errors and Arbitrary Repeats and Skips

A Conditional Random Field Framework for Robust and Scalable Audio-to-Score Matching

Codebook-Based Audio Feature Representation for Music Information Retrieval

Off-line refinement of audio-to-score alignment by observation template adaptation

Audio Bandwidth Extension Based on Ensemble Echo State Networks with Temporal Evolution

HMM-Based Speech Segmentation: Improvements of Fully Automatic Approaches

Acoustic Score Following to Musical Performance With Errors and Arbitrary Repeats and Skips for Automatic Accompaniment

HMM-based speech segmentation: improvements of fully automatic approaches

Real-time audio-to-score alignment of music performances containing errors and arbitrary repeats and skips