Loading...
Please wait, while we are loading the content...
Similar Documents
Continuous Emotion Recognition with Spatiotemporal Convolutional Neural Networks
| Content Provider | MDPI |
|---|---|
| Author | Teixeira, Thomas Granger, Éric Koerich, Alessandro Lameiras |
| Copyright Year | 2021 |
| Description | Facial expressions are one of the most powerful ways to depict specific patterns in human behavior and describe the human emotional state. However, despite the impressive advances of affective computing over the last decade, automatic video-based systems for facial expression recognition still cannot correctly handle variations in facial expression among individuals as well as cross-cultural and demographic aspects. Nevertheless, recognizing facial expressions is a difficult task, even for humans. This paper investigates the suitability of state-of-the-art deep learning architectures based on convolutional neural networks (CNNs) to deal with long video sequences captured in the wild for continuous emotion recognition. For such an aim, several 2D CNN models that were designed to model spatial information are extended to allow spatiotemporal representation learning from videos, considering a complex and multi-dimensional emotion space, where continuous values of valence and arousal must be predicted. We have developed and evaluated convolutional recurrent neural networks, combining 2D CNNs and long short term-memory units and inflated 3D CNN models, which are built by inflating the weights of a pre-trained 2D CNN model during fine-tuning, using application-specific videos. Experimental results on the challenging SEWA-DB dataset have shown that these architectures can effectively be fine-tuned to encode spatiotemporal information from successive raw pixel images and achieve state-of-the-art results on such a dataset. |
| Starting Page | 11738 |
| e-ISSN | 20763417 |
| DOI | 10.3390/app112411738 |
| Journal | Applied Sciences |
| Issue Number | 24 |
| Volume Number | 11 |
| Language | English |
| Publisher | MDPI |
| Publisher Date | 2021-12-10 |
| Access Restriction | Open |
| Subject Keyword | Applied Sciences Artificial Intelligence Facial Expression Recognition Deep Learning Convolutional Recurrent Neural Networks Inflated 3d Cnns Dimensional Emotion Representation Long Short-term Memory |
| Content Type | Text |
| Resource Type | Article |
