Loading...
Please wait, while we are loading the content...
Similar Documents
Double Linear Transformer for Background Music Generation from Videos
| Content Provider | MDPI |
|---|---|
| Author | Yang, Xueting Yu, Ying Wu, Xiaoyu |
| Copyright Year | 2022 |
| Description | Many music generation research works have achieved effective performance, while rarely combining music with given videos. We propose a model with two linear Transformers to generate background music according to a given video. To enhance the melodic quality of the generated music, we firstly input note-related and rhythm-related music features separately into each Transformer network. In particular, we pay attention to the connection and the independence of music features. Then, in order to generate the music that matches the given video, the current state-of-the-art cross-modal inference method is set up to establish the relationship between visual mode and sound mode. Subjective and objective experiment indicate that the generated background music matches the video well and is also melodious. |
| Starting Page | 5050 |
| e-ISSN | 20763417 |
| DOI | 10.3390/app12105050 |
| Journal | Applied Sciences |
| Issue Number | 10 |
| Volume Number | 12 |
| Language | English |
| Publisher | MDPI |
| Publisher Date | 2022-05-17 |
| Access Restriction | Open |
| Subject Keyword | Applied Sciences Video Background Music Generation Music Feature Extraction Linear Transformer |
| Content Type | Text |
| Resource Type | Article |
