Loading...
Please wait, while we are loading the content...
Similar Documents
Machine Reading Between the Lines: A Simple Evaluation Framework for Extracted Knowledge Bases
| Content Provider | Semantic Scholar |
|---|---|
| Author | Sil, Avirup Yates, Alexander |
| Copyright Year | 2011 |
| Abstract | The traditional method to evaluate a knowledge extraction system is to measure precision and recall. But this method only partially measures the quality of a knowledge base (KB) as it cannot predict whether a KB is useful or not. One of the ways in which a KB can be useful is if it is able to deduce implicit information from text which standard information extraction techniques cannot extract. We propose a novel, simple evaluation framework called “Machine Reading between the Lines” (MRbtL) which measures the usefulness of extracted KBs by determining how much they can help improve a relation extraction system. In our experiments, we compare two KBs which both have high precision and recall according to annotators who evaluate the knowledge in the KBs independently from any application or context. But, we show that one outperforms the other in terms of MRbtL experiments, as it can accurately deduce more new facts from the output of a relation extractor more accurately. In short, one extracted KB can read between the lines to identify extra information, whereas the other one cannot. |
| Starting Page | 37 |
| Ending Page | 40 |
| Page Count | 4 |
| File Format | PDF HTM / HTML |
| Alternate Webpage(s) | http://wing.comp.nus.edu.sg/~antho/W/W11/W11-4007.pdf |
| Alternate Webpage(s) | http://anthology.aclweb.org/W/W11/W11-4007.pdf |
| Alternate Webpage(s) | http://aclweb.org/anthology-new/W/W11/W11-4007.pdf |
| Alternate Webpage(s) | http://knight.cis.temple.edu/~yates/papers/ranlp-ieka-camera-ready.pdf |
| Alternate Webpage(s) | http://aclweb.org/anthology/W/W11/W11-4007.pdf |
| Alternate Webpage(s) | http://aclweb.org/anthology/W11-4007 |
| Alternate Webpage(s) | http://www.aclweb.org/anthology-new/W/W11/W11-4007.pdf |
| Alternate Webpage(s) | http://www.aclweb.org/anthology/W/W11/W11-4007.pdf |
| Alternate Webpage(s) | http://aclweb.org/anthology//W/W11/W11-4007.pdf |
| Alternate Webpage(s) | http://www.cis.temple.edu/~yates/papers/ranlp-ieka-camera-ready.pdf |
| Alternate Webpage(s) | http://www.cs.washington.edu/homes/ayates/papers/ranlp-ieka-camera-ready.pdf |
| Language | English |
| Access Restriction | Open |
| Content Type | Text |
| Resource Type | Article |
