Loading...
Please wait, while we are loading the content...
Similar Documents
Animating lip-sync characters with dominated animeme models (2012).
| Content Provider | CiteSeerX |
|---|---|
| Author | Chen, Yu-Mei Huang, Fu-Chun Guan, Shuen-Huei Chen, Bing-Yu |
| Abstract | Character speech animation is traditionally considered as important but tedious work, especially when taking lip synchronization (lip-sync) into consideration. Although there are some methods proposed to ease the burden on artists to create facial and speech animation, almost none are fast and efficient. In this paper, we introduce a framework for synthesizing lip-sync character speech animation in real time from a given speech sequence and its corresponding texts. Starting from training dominated animeme models for each kind of phoneme by learning the character’s animation control signal through an EM-style optimization approach. The dominated animeme models are further decomposed to polynomial-fitted animeme models and corresponding dominance functions while taking coarticulation into account. Finally, given a novel speech sequence and its corresponding texts, the animation control signal of the character can be synthesized in real time with the trained dominated animeme models. The synthesized lip-sync animation can even preserve exaggerated characteristics of the character’s facial geometry. Moreover, since our method can perform in real time, it can be used for many applications, such as lip-sync animation prototyping, multilingual animation reproduction, avatar speech, mass animation production, etc. Furthermore, the synthesized animation control signal can still be imported into 3D packages for further adjustment, so our method can be easily integrated into existing production pipeline. |
| File Format | |
| Publisher Date | 2012-01-01 |
| Access Restriction | Open |
| Subject Keyword | Dominated Animeme Model Lip-sync Character Real Time Animeme Model Corresponding Text Speech Animation Novel Speech Sequence Lip-sync Character Speech Animation Synthesized Animation Control Signal Tedious Work Lip Synchronization Polynomial-fitted Animeme Model Speech Sequence Mass Animation Production Many Application Character Animation Control Signal Animation Control Signal Em-style Optimization Approach Facial Geometry Multilingual Animation Reproduction Synthesized Lip-sync Animation Avatar Speech Dominance Function Character Speech Animation Lip-sync Animation Prototyping Production Pipeline Exaggerated Characteristic |
| Content Type | Text |
