Loading...
Please wait, while we are loading the content...
Similar Documents
Overview of the Answer Validation Exercise 2007 (2007)
| Content Provider | CiteSeerX |
|---|---|
| Author | Peñas, Anselmo Rodrigo, Álvaro Verdejo, Felisa |
| Description | The Answer Validation Exercise at the Cross Language Evaluation Forum is aimed at developing systems able to decide whether the answer of a Question Answering system is correct or not. We present here the exercise description, the changes in the evaluation methodology with respect to the first edition, and the results of this second edition (AVE 2007). The changes in the evaluation methodology had two objectives: the first one was to quantify the gain in performance when more sophisticated validation modules are introduced in QA systems. The second objective was to bring systems based on Textual Entailment to the Automatic Hypothesis Generation problem which is not part itself of the Recognising Textual Entailment (RTE) task but a need of the Answer Validation setting. 9 groups have participated with 16 runs in 4 different languages. Compared with the QA systems, the results show an evidence of the potential gain that more sophisticated AV modules introduce in the task of QA. In Working notes for the Cross Language Evaluation Forum Workshop (CLEF 2007 |
| File Format | |
| Language | English |
| Publisher Date | 2007-01-01 |
| Access Restriction | Open |
| Subject Keyword | Automatic Hypothesis Generation Problem Second Edition Answer Validation Exercise Textual Entailment Sophisticated Av Module Question Answering System Exercise Description Evaluation Methodology Answer Validation First Edition Potential Gain First One Different Language Cross Language Evaluation Forum Sophisticated Validation Module Qa System Recognising Textual Entailment Second Objective |
| Content Type | Text |
| Resource Type | Article |
