NDLI: A Rule-Based Method for Thai Elementary Discourse Unit Segmentation (TED-Seg)

Content Provider	IEEE Xplore Digital Library
Author	Ketui, N. Theeramunkong, T. Onsuwan, C.
Copyright Year	2012
Abstract	Discovering discourse units in Thai, a language without word and sentence boundaries, is not a straightforward task due to its high part-of-speech (POS) ambiguity and serial verb constituents. This paper introduces definitions of Thai elementary discourse units (T-EDUs), grammar rules for T-EDU segmentation and a longest-matching-based chart parser. The T-EDU definitions are used for constructing a set of context free grammar (CFG) rules. As a result, 446 CFG rules are constructed from 1,340 T-EDUs, extracted from the NE- and POS-tagged corpus, Thai-NEST. These T-EDUs are evaluated with two linguists and the kappa score is 0.68. Separately, a two-level evaluation is applied, one is done in an arranged situation where a text is pre-chunked while the other is performed in a normal situation where the original running text is used for test. By specifying one grammar rule per one T-EDU instance, it is possible to make the perfect recall (100%) in a close environment when the testing corpus and the training corpus are the same, but the recall of approximately 36.16% and 31.69% are obtained for the chunked and the running texts, respectively. For an open test with 3-fold cross validation, the recall is around 67% while the precision is only 25-28%. To improve the precision score, two alternative strategies are applied, left-to-right longest matching (L2R-LM) and maximal longest matching (M-LM). The results show that in the L2R-LM and M-LM can improve the precision to 93.97% and 94.03% for the running text in the close test. However, the recall drops slightly to 94.18% and 92.91%. For the running text in the open test, the f-score improves to 57.70% and 54.14% for the L2R-LM and M-LM.
Starting Page	195
Ending Page	202
File Size	1152458
Page Count	8
File Format	PDF
ISBN	9781467345644
DOI	10.1109/KICSS.2012.33
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2012-11-08
Publisher Place	Australia
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Discourse unit Segmentation Speech recognition Syntactics Speech Educational institutions Grammar Compounds Indexes Thai Elementary Discourse Unit Chart parser
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Recognizing Chinese Elementary Discourse Unit on Comma

A rule-based method for Chinese punctuations processing in sentences segmentation

Lattice parsing to integrate speech recognition and rule-based machine translation.

Rule-Based and Example-Based Machine Translation from English to Arabic

Thai elementary discourse unit segmentation by discourse segmentation cues and syntactic information.

Grammar-based and example-based techniques in machine translation from English to Arabic

Lattice Parsing to Integrate Speech Recognition and Rule-Based Machine Translation

Automatic discourse segmentation using neural networks.

Rule Based Machine Translation System from English to Tamil

A Rule-Based Method for Thai Elementary Discourse Unit Segmentation (TED-Seg)

Similar Documents

Recognizing Chinese Elementary Discourse Unit on Comma

A rule-based method for Chinese punctuations processing in sentences segmentation

Lattice parsing to integrate speech recognition and rule-based machine translation.

Rule-Based and Example-Based Machine Translation from English to Arabic

Thai elementary discourse unit segmentation by discourse segmentation cues and syntactic information.

Grammar-based and example-based techniques in machine translation from English to Arabic

Lattice Parsing to Integrate Speech Recognition and Rule-Based Machine Translation

Automatic discourse segmentation using neural networks.

Rule Based Machine Translation System from English to Tamil

A Rule-Based Method for Thai Elementary Discourse Unit Segmentation (TED-Seg)