Loading...
Please wait, while we are loading the content...
Similar Documents
Multimodal Deep Learning for Group Activity Recognition in Smart Office Environments
| Content Provider | MDPI |
|---|---|
| Author | Florea, George Albert Mihailescu, Radu-Casian |
| Copyright Year | 2020 |
| Description | Deep learning (DL) models have emerged in recent years as the state-of-the-art technique across numerous machine learning application domains. In particular, image processing-related tasks have seen a significant improvement in terms of performance due to increased availability of large datasets and extensive growth of computing power. In this paper we investigate the problem of group activity recognition in office environments using a multimodal deep learning approach, by fusing audio and visual data from video. Group activity recognition is a complex classification task, given that it extends beyond identifying the activities of individuals, by focusing on the combinations of activities and the interactions between them. The proposed fusion network was trained based on the audio–visual stream from the AMI Corpus dataset. The procedure consists of two steps. First, we extract a joint audio–visual feature representation for activity recognition, and second, we account for the temporal dependencies in the video in order to complete the classification task. We provide a comprehensive set of experimental results showing that our proposed multimodal deep network architecture outperforms previous approaches, which have been designed for unimodal analysis, on the aforementioned AMI dataset. |
| Starting Page | 133 |
| e-ISSN | 19995903 |
| DOI | 10.3390/fi12080133 |
| Journal | Future Internet |
| Issue Number | 8 |
| Volume Number | 12 |
| Language | English |
| Publisher | MDPI |
| Publisher Date | 2020-08-09 |
| Access Restriction | Open |
| Subject Keyword | Future Internet Artificial Intelligence Multimodal Learning Deep Learning Activity Recognition |
| Content Type | Text |
| Resource Type | Article |
