NDLI: Multi-dimensional long short-term memory networks for artificial Arabic text recognition in news video

Content Provider	IET Digital Library
Author	Zayene, Oussama Touj, Sameh Masmoudi Hennebert, Jean Ingold, Rolf Amara, Najoua Essoukri Ben
Abstract	This study presents a novel approach for Arabic video text recognition based on recurrent neural networks. In fact, embedded texts in videos represent a rich source of information for indexing and automatically annotating multimedia documents. However, video text recognition is a non-trivial task due to many challenges like the variability of text patterns and the complexity of backgrounds. In the case of Arabic, the presence of diacritic marks, the cursive nature of the script and the non-uniform intra/inter word distances, may introduce many additional challenges. The proposed system presents a segmentation-free method that relies specifically on a multi-dimensional long short-term memory coupled with a connectionist temporal classification layer. It is shown that using an efficient pre-processing step and a compact representation of Arabic character models brings robust performance and yields a low-error rate than other recently published methods. The authors’ system is trained and evaluated using the public AcTiV-R dataset under different evaluation protocols. The obtained results are very interesting. They also outperform current state-of-the-art approaches on the public dataset ALIF in terms of recognition rates at both character and line levels.
Starting Page	710
Ending Page	719
Page Count	10
ISSN	17519632
Volume Number	12
e-ISSN	17519640
Issue Number	Issue 5, Aug (2018)
Alternate Webpage(s)	https://digital-library.theiet.org/content/journals/iet-cvi/12/5
Alternate Webpage(s)	https://digital-library.theiet.org/content/journals/10.1049/iet-cvi.2017.0468
Journal	IET Computer Vision
Publisher Date	2018-03-14
Access Restriction	Open
Rights Holder	© The Institution of Engineering and Technology
Subject Keyword	Arabic Character Model Artificial Arabic Video Text Recognition Character Recognition Computer Vision And Image Processing Technique Connectionist Temporal Classification Layer Diacritic Marks Embedded Texts Evaluation Protocol Image Annotation Image Classification Image Recognition Image Representation Indexing Interword Distances Line Levels Multidimensional Long Short-term Memory Network Multimedia Document Annotation Multimedia Document Indexing Neural Computing Technique News Video Nonuniform Intraword Distances Public AcTiV-R Dataset Public Dataset ALIF Recurrent Neural Nets Recurrent Neural Network Segmentation-free Method Text Detection Text Pattern Variability Video Signal Processing
Content Type	Text
Resource Type	Article
Subject	Computer Vision and Pattern Recognition Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

A Novel Connectionist System for Unconstrained Handwriting Recognition

Recurrent Convolutional Neural Network MSER-Based Approach for Payable Document Processing

An Efficient Hybrid Model for Arabic Text Recognition

Semi-supervised long short-term memory for human action recognition

CNN-RNN based method for license plate recognition

Automatic diacritization of Arabic text using recurrent neural networks

Structured RNN for human interaction

From Recurrent Neural Network to Long Short Term Memory Architecture

Generating image descriptions with multidirectional 2D long short-term memory

Multi-dimensional long short-term memory networks for artificial Arabic text recognition in news video

Similar Documents

A Novel Connectionist System for Unconstrained Handwriting Recognition

Recurrent Convolutional Neural Network MSER-Based Approach for Payable Document Processing

An Efficient Hybrid Model for Arabic Text Recognition

Semi-supervised long short-term memory for human action recognition

CNN-RNN based method for license plate recognition

Automatic diacritization of Arabic text using recurrent neural networks

Structured RNN for human interaction

From Recurrent Neural Network to Long Short Term Memory Architecture

Generating image descriptions with multidirectional 2D long short-term memory

Multi-dimensional long short-term memory networks for artificial Arabic text recognition in news video