Loading...
Please wait, while we are loading the content...
Similar Documents
A Statistical Analysis of Automated MT Evaluation Metrics for Assessments in Task-Based MT Evaluation
| Content Provider | Semantic Scholar |
|---|---|
| Author | Tate, Calandra Rilette |
| Copyright Year | 2008 |
| Abstract | This paper applies nonparametric statistical techniques toMachine Translation(MT) Evaluationusing data from a large scale task-based study. In particular, the relationship between human task performance on an information extraction task with translated documents and well-known automated translation evaluation metric scores for those documents is studied. Findings from a correlation analysis of this connection are presented and contrasted with current strategies for evaluating translations. An extended analysis that involves a novel idea for assessing partial rank correlation within the presence of grouping factors is also discussed. This work exposes the limitations of descriptive statistics generally used in this area, mainly correlation analysis, when using automated metrics for assessments in task handling purposes. |
| File Format | PDF HTM / HTML |
| Alternate Webpage(s) | http://www.amtaweb.org/papers/2.18_Tate.pdf |
| Alternate Webpage(s) | http://www.mt-archive.info/AMTA-2008-Tate.pdf |
| Language | English |
| Access Restriction | Open |
| Content Type | Text |
| Resource Type | Article |