Loading...
Please wait, while we are loading the content...
Similar Documents
Real-time Gesture Animation Generation from Speech for Virtual Human Interaction
| Content Provider | arXiv |
|---|---|
| Author | Rebol, Manuel Gütl, Christian Pietroszek, Krzysztof |
| Date of Submission | 2022-08-05 |
| Abstract | We propose a real-time system for synthesizing gestures directly from speech. Our data-driven approach is based on Generative Adversarial Neural Networks to model the speech-gesture relationship. We utilize the large amount of speaker video data available online to train our 3D gesture model. Our model generates speaker-specific gestures by taking consecutive audio input chunks of two seconds in length. We animate the predicted gestures on a virtual avatar. We achieve a delay below three seconds between the time of audio input and gesture animation. Code and videos are available at https://github.com/mrebol/Gestures-From-Speech |
| Related Links | https://arxiv.org/pdf/2208.03244.pdf |
| arXiv | 2208.03244 |
| Language | English |
| Access Restriction | Open |
| Subject Keyword | Computer Science - Computer Vision and Pattern Recognition Computer Science |
| Content Type | Text |
| Resource Type | Article |
| Subject | Computer Science |
