NDLI: Integrated phrase segmentation and alignment algorithm for statistical machine translation

Content Provider	IEEE Xplore Digital Library
Author	Zhang, Y. Vogel, S. Waibel, A.
Copyright Year	2003
Description	Author affiliation: Language Technol. Inst., Carnegie Mellon Univ., Pittsburgh, PA, USA (Zhang, Y.; Vogel, S.; Waibel, A.)
Abstract	We present an integrated phrase segmentation/alignment algorithm (ISA) for statistical machine translation. Without the need of building an initial word-to-word alignment or initially segmenting the monolingual text into phrases as other methods do, this algorithm segments the sentences into phrases and finds their alignments simultaneously. For each sentence pair, ISA builds a two-dimensional matrix to represent a sentence pair where the value of each cell corresponds to the point-wise mutual information (MI) between the source and target words. Based on the similarities of MI values among cells, we identify the aligned phrase pairs. Once all the phrase pairs are found, we know both how to segment one sentence into phrases and also the alignments between the source and target sentences. We use monolingual bigram language models to estimate the joint probabilities of the identified phrase pairs. The joint probabilities are then normalized to conditional probabilities, which are used by the decoder. Despite its simplicity, this approach yields phrase-to-phrase translations with significant higher precisions than our baseline system where phrase translations are extracted from the HMM word alignment. When we combine the phrase-to-phrase translations generated by this algorithm with the baseline system, the improvement on translation quality is even larger.
Sponsorship	Chinese Assoc. for Artificial Intelligence, China Chinese Inst. of Electron., China Chinese Inf. Processing Soc., China Beijing Network and Multimedia Lab., China IEEE Signal Processing Soc. IEEE Syst., Man and Cybernetics Soc. IEEE Beijing Section
Starting Page	567
Ending Page	573
File Size	400041
Page Count	7
File Format	PDF
ISBN	0780379020
DOI	10.1109/NLPKE.2003.1275970
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2003-10-26
Publisher Place	China
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Greedy algorithms Surface-mount technology Viterbi algorithm Instruction sets Natural languages Hidden Markov models Decoding Data mining Joining processes Context modeling
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Towards integrated machine translation using structural alignment from syntax-augmented synchronous parsing

HMM Word and Phrase Alignment for Statistical Machine Translation

SYNTACTIC PHRASE-BASED STATISTICAL MACHINE TRANSLATION

Hierarchical chunking-phrase based translation

Bilingual Segmenter for Statistical Machine Translation

Competitive grouping in integrated phrase segmentation and alignment model.

The CASIA phrase-based machine translation system

Competitive grouping in integrated phrase segmentation and alignment model (2005).

INVERSION TRANSDUCTION GRAMMAR COVERAGE OF ARABIC-ENGLISH WORD ALIGNMENT FOR TREE-STRUCTURED STATISTICAL MACHINE TRANSLATION

Integrated phrase segmentation and alignment algorithm for statistical machine translation

Similar Documents

Towards integrated machine translation using structural alignment from syntax-augmented synchronous parsing

HMM Word and Phrase Alignment for Statistical Machine Translation

SYNTACTIC PHRASE-BASED STATISTICAL MACHINE TRANSLATION

Hierarchical chunking-phrase based translation

Bilingual Segmenter for Statistical Machine Translation

Competitive grouping in integrated phrase segmentation and alignment model.

The CASIA phrase-based machine translation system

Competitive grouping in integrated phrase segmentation and alignment model (2005).

INVERSION TRANSDUCTION GRAMMAR COVERAGE OF ARABIC-ENGLISH WORD ALIGNMENT FOR TREE-STRUCTURED STATISTICAL MACHINE TRANSLATION

Integrated phrase segmentation and alignment algorithm for statistical machine translation