NDLI: Deriving Symbol Dependent Edit Weights for Text Correction

Content Provider	IEEE Xplore Digital Library
Author	Ringlstetter, C. Reffle, U. Gotscharek, A. Schulz, K.U.
Copyright Year	2007
Description	Author affiliation: Univ. of Alberta, Edmonton (Ringlstetter, C.)
Abstract	Most systems for correcting errors in texts make use of specific word distance measures such as the Levenshtein distance. In many experiments it has been shown that correction accuracy is improved when using edit weights that depend on the particular symbols of the edit operation. However, most proposed approaches so far rely on high amounts of training data where errors and their corrections are collected. In practice, the preparation of suitable ground truth data is often too costly, which means that uniform edit costs are used. In this paper we evaluate approaches for deriving symbol dependent edit weights that do not need any ground truth training data, comparing them with methods based on ground truth training. We suggest a new approach where special error dictionaries are used to estimate weights. The method is simple and very efficient, needing one pass of the document to be corrected. Our experiments with different OCR systems and textual data show that the method consistently improves correction accuracy in a significant way, often leading to results comparable to those achieved with ground truth training.
Starting Page	639
Ending Page	643
File Size	97196
Page Count	5
File Format	PDF
ISBN	9780769528229
ISSN	15205363
DOI	10.1109/ICDAR.2007.4376993
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2007-09-23
Publisher Place	Brazil
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Error correction Dictionaries Optical character recognition software Training data Frequency estimation Costs Web pages Feedback Engines Computational Intelligence Society
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Error Correction with In-domain Training across Multiple OCR System Outputs

Probabilistic Approach for Correction of Optically-Character-Recognized Strings Using Suffix Tree

Fast Selection of Small and Precise Candidate Sets from Dictionaries for Text Correction Tasks

Lexical postcorrection of OCR-results:the web as a dynamic secondary dictionary?

Based on the Phonetic Spelling Correction System Research and Implementation

Progressive Alignment and Discriminative Error Correction for Multiple OCR Engines

Computation of normalized edit distance and applications

Shape Encoded Post Processing of Gurmukhi OCR

Thai OCR error correction using token passing algorithm

Deriving Symbol Dependent Edit Weights for Text Correction_The Use of Error Dictionaries

Similar Documents

Error Correction with In-domain Training across Multiple OCR System Outputs

Probabilistic Approach for Correction of Optically-Character-Recognized Strings Using Suffix Tree

Fast Selection of Small and Precise Candidate Sets from Dictionaries for Text Correction Tasks

Lexical postcorrection of OCR-results:the web as a dynamic secondary dictionary?

Based on the Phonetic Spelling Correction System Research and Implementation

Progressive Alignment and Discriminative Error Correction for Multiple OCR Engines

Computation of normalized edit distance and applications

Shape Encoded Post Processing of Gurmukhi OCR

Thai OCR error correction using token passing algorithm

Deriving Symbol Dependent Edit Weights for Text Correction_The Use of Error Dictionaries