NDLI: Unsupervised speaker identification in TV broadcast based on written names

Content Provider	ACM Digital Library
Author	Besacier, Laurent Poignant, Johann Quénot, Georges
Copyright Year	2015
Abstract	Identifying speakers in TV broadcast in an unsupervised way (i.e., without biometric models) is a solution for avoiding costly annotations. Existing methods usually use pronounced names, as a source of names, for identifying speech clusters provided by a diarization step but this source is too imprecise for having sufficient confidence. To overcome this issue, another source of names can be used: the names written in a title block in the image track. We first compared these two sources of names on their abilities to provide the name of the speakers in TV broadcast. This study shows that it is more interesting to use written names for their high precision for identifying the current speaker. We also propose two approaches for finding speaker identity based only on names written in the image track. With the "late naming" approach, we propose different propagations of written names onto clusters. Our second proposition, "Early naming," modifies the speaker diarization module (agglomerative clustering) by adding constraints preventing two clusters with different associated written names to be merged together. These methods were tested on the REPERE corpus phase 1, containing 3 hours of annotated videos. Our best "late naming" system reaches an F-measure of 73.1%. "early naming" improves over this result both in terms of identification error rate and of stability of the clustering stopping criterion. By comparison, a mono-modal, supervised speaker identification system with 535 speaker models trained on matching development data and additional TV and radio data only provided a 57.2% F-measure.
Starting Page	57
Ending Page	68
Page Count	12
File Format	PDF
ISSN	23299290
e-ISSN	23299304
DOI	10.1109/TASLP.2014.2367822
Volume Number	23
Issue Number	1
Journal	IEEE/ACM Transactions on Audio, Speech and Language Processing (TASLP)
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2015-01-01
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	TV broadcast Multimodal fusion Speaker diarization Speaker identification Written names
Content Type	Text
Resource Type	Article
Subject	Instrumentation Computational Mathematics Signal Processing Electrical and Electronic Engineering Acoustics and Ultrasonics Speech and Hearing Media Technology

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Unsupervised Speaker Identification in TV Broadcast Based on Written Names

Fast single- and cross-show speaker diarization using binary key speaker modeling

An Adaptive Method for Cross-Recording Speaker Diarization

Overlapping Speech Detection Using Long-Term Conversational Features for Speaker Diarization in Meeting Room Conversations

Overlapping speech detection using long-term conversational features for speaker diarization in meeting room conversations

A Multimodal Approach to Speaker Diarization on TV Talk-Shows

Fast Single- and Cross-Show Speaker Diarization Using Binary Key Speaker Modeling

Speaker Tracking Using Recursive EM Algorithms

A Study of the Cosine Distance-Based Mean Shift for Telephone Speech Diarization

Unsupervised speaker identification in TV broadcast based on written names

Similar Documents

Unsupervised Speaker Identification in TV Broadcast Based on Written Names

Fast single- and cross-show speaker diarization using binary key speaker modeling

An Adaptive Method for Cross-Recording Speaker Diarization

Overlapping Speech Detection Using Long-Term Conversational Features for Speaker Diarization in Meeting Room Conversations

Overlapping speech detection using long-term conversational features for speaker diarization in meeting room conversations

A Multimodal Approach to Speaker Diarization on TV Talk-Shows

Fast Single- and Cross-Show Speaker Diarization Using Binary Key Speaker Modeling

Speaker Tracking Using Recursive EM Algorithms

A Study of the Cosine Distance-Based Mean Shift for Telephone Speech Diarization

Unsupervised speaker identification in TV broadcast based on written names