Loading...
Please wait, while we are loading the content...
Similar Documents
22nd International Conference on Computational Linguistics Proceedings of the workshop on Human Judgements in Computational Linguistics
| Content Provider | Semantic Scholar |
|---|---|
| Author | Artstein, Ron Boleda, Gemma Keller, Frank |
| Copyright Year | 2008 |
| Abstract | We address the problem of distinguishing between two sources of disagreement in annotations: genuine subjectivity and slip of attention. The latter is especially likely when the classification task has a default class, as in tasks where annotators need to find instances of the phenomenon of interest, such as in a metaphor detection task discussed here. We apply and extend a data analysis technique proposed by Beigman Klebanov and Shamir (2006) to first distill reliably deliberate (non-chance) annotations and then to estimate the amount of attention slips vs genuine disagreement in the reliably deliberate annotations. |
| File Format | PDF HTM / HTML |
| DOI | 10.3115/1611628 |
| Alternate Webpage(s) | http://wing.comp.nus.edu.sg/~antho/W/W08/W08-12.pdf |
| Alternate Webpage(s) | http://aclweb.org/anthology//W/W08/W08-12.pdf |
| Alternate Webpage(s) | http://anthology.aclweb.org/W/W08/W08-12.pdf |
| Alternate Webpage(s) | http://aclweb.org/anthology/W/W08/W08-1200.pdf |
| Alternate Webpage(s) | http://aclweb.org/anthology//W/W08/W08-1200.pdf |
| Alternate Webpage(s) | http://www.aclweb.org/anthology/W/W08/W08-12.pdf |
| Alternate Webpage(s) | http://aclweb.org/anthology/W/W08/W08-12.pdf |
| Alternate Webpage(s) | http://aclweb.org/anthology/W08-1200 |
| Alternate Webpage(s) | http://newdesign.aclweb.org/anthology-new/W/W08/W08-12.pdf |
| Alternate Webpage(s) | http://aclweb.org/anthology/W08-12 |
| Alternate Webpage(s) | http://anthology.aclweb.org/W/W08/W08-1200.pdf |
| Alternate Webpage(s) | http://wing.comp.nus.edu.sg/~antho/W/W08/W08-1200.pdf |
| Alternate Webpage(s) | http://www.aclweb.org/anthology/W/W08/W08-1200.pdf |
| Alternate Webpage(s) | http://aclweb.org/anthology-new/W/W08/W08-12.pdf |
| Alternate Webpage(s) | https://doi.org/10.3115/1611628 |
| Language | English |
| Access Restriction | Open |
| Content Type | Text |
| Resource Type | Article |
