Loading...
Please wait, while we are loading the content...
Similar Documents
Combining Optimization Methods Using an Adaptive Meta Optimizer
| Content Provider | MDPI |
|---|---|
| Author | Landro, Nicola Gallo, Ignazio Grassa, Riccardo La |
| Copyright Year | 2021 |
| Description | Optimization methods are of great importance for the efficient training of neural networks. There are many articles in the literature that propose particular variants of existing optimizers. In our article, we propose the use of the combination of two very different optimizers that, when used simultaneously, can exceed the performance of the single optimizers in very different problems. We propose a new optimizer called ATMO (AdapTive Meta Optimizers), which integrates two different optimizers simultaneously weighing the contributions of both. Rather than trying to improve each single one, we leverage both at the same time, as a meta-optimizer, by taking the best of both. We have conducted several experiments on the classification of images and text documents, using various types of deep neural models, and we have demonstrated through experiments that the proposed ATMO produces better performance than the single optimizers. |
| Starting Page | 186 |
| e-ISSN | 19994893 |
| DOI | 10.3390/a14060186 |
| Journal | Algorithms |
| Issue Number | 6 |
| Volume Number | 14 |
| Language | English |
| Publisher | MDPI |
| Publisher Date | 2021-06-19 |
| Access Restriction | Open |
| Subject Keyword | Algorithms Artificial Intelligence Deep Learning Optimization Algorithm Optimizers Text Classification Image Classification |
| Content Type | Text |
| Resource Type | Article |
