Loading...
Please wait, while we are loading the content...
Similar Documents
Overview of the Answer Validation Exercise 2008
| Content Provider | CiteSeerX |
|---|---|
| Author | Rodrigo, Álvaro Peñas, Anselmo Verdejo, Felisa |
| Description | The Answer Validation Exercise at the Cross Language Evaluation Forum (CLEF) is aimed at developing systems able to decide whether the answer of a Question Answering (QA) system is correct or not. We present here the exercise description, the changes in the evaluation with respect to the last edition, and the results of this third edition (AVE 2008). Last year’s changes allowed us to measure the possible gain in performance obtained by using AV systems as the selection method of QA systems. In this edition we wanted to reward AV systems able to detect if all the candidate answers to a question are incorrect. 9 groups have participated with 24 runs in 5 different languages, and compared with the QA systems, the results show an evidence of the potential gain that more sophisticated AV modules might introduce in the task of QA. |
| File Format | |
| Language | English |
| Access Restriction | Open |
| Subject Keyword | Selection Method Answer Validation Exercise Sophisticated Av Module Question Answering Av System Last Year Exercise Description Last Edition Potential Gain Different Language Possible Gain Cross Language Evaluation Forum Third Edition Candidate Answer Qa System |
| Content Type | Text |
| Resource Type | Article |
