NDLI: Improved Chinese--English SMT with Chinese “DE” Construction Classification and Reordering

Please wait, while we are loading the content...

ACM Transactions on Asian Language Information Processing (TALIP) : Volume 13

ACM Transactions on Asian Language Information Processing (TALIP) : Volume 12

ACM Transactions on Asian Language Information Processing (TALIP) : Volume 11

ACM Transactions on Asian Language Information Processing (TALIP) : Volume 10

Issue 4, December 2011

Improved Chinese--English SMT with Chinese “DE” Construction Classification and Reordering

Language Modeling for Syntax-Based Machine Translation Using Tree Substitution Grammars: A Case Study on Chinese-English Translation

Mining English-Chinese Named Entity Pairs from Comparable Corpora

User Behaviors in Related Word Retrieval and New Word Detection: A Collaborative Perspective

Deep Learning Approaches to Semantic Relevance Modeling for Chinese Question-Answer Pairs

Issue 3, September 2011

Issue 2, June 2011

Issue 1, March 2011

ACM Transactions on Asian Language Information Processing (TALIP) : Volume 9

ACM Transactions on Asian Language Information Processing (TALIP) : Volume 8

ACM Transactions on Asian Language Information Processing (TALIP) : Volume 7

ACM Transactions on Asian Language Information Processing (TALIP) : Volume 6

ACM Transactions on Asian Language Information Processing (TALIP) : Volume 5

ACM Transactions on Asian Language Information Processing (TALIP) : Volume 4

ACM Transactions on Asian Language Information Processing (TALIP) : Volume 3

ACM Transactions on Asian Language Information Processing (TALIP) : Volume 2

ACM Transactions on Asian Language Information Processing (TALIP) : Volume 1

Improved Chinese--English SMT with Chinese “DE” Construction Classification and Reordering

Content Provider	ACM Digital Library
Author	Way, Andy Du, Jinhua
Copyright Year	2011
Abstract	Syntactic reordering on the source side has been demonstrated to be helpful and effective for handling different word orders between source and target languages in SMT. In this article, we focus on the Chinese (DE) construction which is flexible and ubiquitous in Chinese and has many different ways to be translated into English so that it is a major source of word order differences in terms of translation quality. This article carries out the Chinese “DE” construction study for Chinese--English SMT in which we propose a new classifier model---discriminative latent variable model (DPLVM)---with new features to improve the classification accuracy and indirectly improve the translation quality compared to a log-linear classifier. The DE classifier is used to recognize DE structures in both training and test sentences of Chinese, and then perform word reordering to make the Chinese sentences better match the word order of English. In order to investigate the impact of the DE classification and reordering in the source side on different types of SMT systems (namely PB-SMT, hierarchical PB-SMT (HPB-SMT) as well as the syntax-based SMT (SAMT)), we conduct a series of experiments on NIST 2005 and 2008 test sets to verify the effectiveness of our proposed model. The experimental results show that the MT systems using the data reordered by our proposed model outperform the baseline systems by 3.01% and 4.03% relative points on the NIST 2005 test set, 4.64% and 4.62% relative points on the NIST 2008 test set in terms of BLEU score for PB-SMT and HPB-SMT respectively. However, the DE classification method does not perform significantly well for SAMT. Additionally, we also conducted some experiments to evaluate our DE classification and reordering approach on the word alignment and phrase table in terms of these three types of SMT systems.
Starting Page	1
Ending Page	22
Page Count	22
File Format	PDF
ISSN	15300226
e-ISSN	15583430
DOI	10.1145/2025384.2025385
Volume Number	10
Issue Number	4
Journal	ACM Transactions on Asian Language Information Processing (TALIP)
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2011-12-01
Publisher Place	New York
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Chinese DE construction Dynamic probabilistic latent variable model Log-linear model Source-side reordering
Content Type	Text
Resource Type	Article
Subject	Computer Science

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

A Discriminative Latent Variable-Based “DE ” Classifier for Chinese–English SMT

Source-side syntactic reordering patterns with functional words for improved phrase-based smt.

Sourceside syntactic reordering patterns with functional words for improved phrase-based SMT (2010)

A Discriminative Latent Variable-Based “DE ” Classifier for Chinese–English SMT

The Impact of Source–Side Syntactic Reordering on Hierarchical Phrase-based SMT

Improved phrase-based smt with syntactic reordering patterns learned from lattice scoring.

Multinomial Latent Logistic Regression for Image Understanding

Discriminative Training for Log-Linear Based SMT: Global or Local Methods

Latent log-linear models for handwritten digit classification (2011)

Improved Chinese--English SMT with Chinese “DE” Construction Classification and Reordering

Similar Documents

A Discriminative Latent Variable-Based “DE ” Classifier for Chinese–English SMT

Source-side syntactic reordering patterns with functional words for improved phrase-based smt.

Sourceside syntactic reordering patterns with functional words for improved phrase-based SMT (2010)

A Discriminative Latent Variable-Based “DE ” Classifier for Chinese–English SMT

The Impact of Source–Side Syntactic Reordering on Hierarchical Phrase-based SMT

Improved phrase-based smt with syntactic reordering patterns learned from lattice scoring.

Multinomial Latent Logistic Regression for Image Understanding

Discriminative Training for Log-Linear Based SMT: Global or Local Methods

Latent log-linear models for handwritten digit classification (2011)

Improved Chinese--English SMT with Chinese “DE” Construction Classification and Reordering