Loading...
Please wait, while we are loading the content...
Similar Documents
Extracting paraphrase patterns from bilingual parallel corpora
| Content Provider | Scilit |
|---|---|
| Author | Zhao, Shiqi Wang, Haifeng Liu, Ting Li, Sheng |
| Copyright Year | 2009 |
| Description | Paraphrase patterns are semantically equivalent patterns, which are useful in both paraphrase recognition and generation. This paper presents a pivot approach for extracting paraphrase patterns from bilingual parallel corpora, whereby the paraphrase patterns in English are extracted using the patterns in another language as pivots. We make use of log-linear models for computing the paraphrase likelihood between pattern pairs and exploit feature functions based on maximum likelihood estimation (MLE), lexical weighting (LW), and monolingual word alignment (MWA). Using the presented method, we extract more than 1 million pairs of paraphrase patterns from about 2 million pairs of bilingual parallel sentences. The precision of the extracted paraphrase patterns is above 78%. Experimental results show that the presented method significantly outperforms a well-known method called discovery of inference rules from text (DIRT). Additionally, the log-linear model with the proposed feature functions are effective. The extracted paraphrase patterns are fully analyzed. Especially, we found that the extracted paraphrase patterns can be classified into five types, which are useful in multiple natural language processing (NLP) applications. |
| Related Links | https://www.cambridge.org/core/services/aop-cambridge-core/content/view/BE0C837C388A047761CAE677D7BE60B2/S1351324909990155a.pdf/div-class-title-extracting-paraphrase-patterns-from-bilingual-parallel-corpora-div.pdf |
| Ending Page | 526 |
| Page Count | 24 |
| Starting Page | 503 |
| ISSN | 13513249 |
| e-ISSN | 14698110 |
| DOI | 10.1017/s1351324909990155 |
| Journal | Natural Language Engineering |
| Issue Number | 4 |
| Volume Number | 15 |
| Language | English |
| Publisher | Cambridge University Press (CUP) |
| Publisher Date | 2009-10-01 |
| Access Restriction | Open |
| Subject Keyword | Natural Language Engineering Language Studies Extracted Paraphrase Patterns |
| Content Type | Text |
| Resource Type | Article |
| Subject | Artificial Intelligence Linguistics and Language Software |
