Loading...
Please wait, while we are loading the content...
Similar Documents
Capturing Text Semantics for Concept Detection in News Video
| Content Provider | Semantic Scholar |
|---|---|
| Author | Wang, Gang Chua, Tat-Seng |
| Copyright Year | 2009 |
| Abstract | The overwhelming amounts of multimedia contents have triggered the need for automatic semantic concept detection. However, as there are large variations in the visual feature space, text from automatic speech recognition (ASR) has been extensively used and found to be effective to complement visual features in the concept detection task. Generally, there are two common text analysis methods. One is text classification and the other is text retrieval. Both methods have their own strengths and weaknesses. In addition, fusion of text and visual analysis is still an open problem. In this paper, we present a novel multiresolution, multisource and multimodal (M3) transductive learning framework. We fuse text and visual features via a multiresolution model. This is because different modal features only work well in different temporal resolutions, which exhibit different types of semantics. We perform a multiresolution analysis at the shot, multimedia discourse, and story levels to capture the semantics in a news video. While visual features play a dominant role at the shot level, text plays an increasingly important role as we move from the multimedia discourse towards the story levels. Our multisource inference transductive model provides a solution to combine text classification and retrieval method together. We test our M3 transductive model of semantic concept detection on the TRECVID 2004 dataset. Preliminary results demonstrate that our approach is effective. |
| Starting Page | 1 |
| Ending Page | 25 |
| Page Count | 25 |
| File Format | PDF HTM / HTML |
| DOI | 10.1007/978-0-387-76569-3_5 |
| Alternate Webpage(s) | http://lms.comp.nus.edu.sg/sites/default/files/publication-attachments/bookchapter-wanggang.pdf |
| Alternate Webpage(s) | https://lms.comp.nus.edu.sg/sites/default/files/publication-attachments/bookchapter-wanggang.pdf |
| Alternate Webpage(s) | https://doi.org/10.1007/978-0-387-76569-3_5 |
| Language | English |
| Access Restriction | Open |
| Content Type | Text |
| Resource Type | Notice |
