Loading...
Please wait, while we are loading the content...
Similar Documents
Accelerating Look-ahead in Bayesian Optimization: Multilevel Monte Carlo is All you Need
| Content Provider | arXiv |
|---|---|
| Author | Yang, Shangda Zankin, Vitaly Balandat, Maximilian Scherer, Stefan Carlberg, Kevin Walton, Neil Law, Kody J. H. |
| Date of Submission | 2024-02-03 |
| Abstract | We leverage multilevel Monte Carlo (MLMC) to improve the performance of multi-step look-ahead Bayesian optimization (BO) methods that involve nested expectations and maximizations. The complexity rate of naive Monte Carlo degrades for nested operations, whereas MLMC is capable of achieving the canonical Monte Carlo convergence rate for this type of problem, independently of dimension and without any smoothness assumptions. Our theoretical study focuses on the approximation improvements for one- and two-step look-ahead acquisition functions, but, as we discuss, the approach is generalizable in various ways, including beyond the context of BO. Findings are verified numerically and the benefits of MLMC for BO are illustrated on several benchmark examples. Code is available here https://github.com/Shangda-Yang/MLMCBO. |
| Related Links | https://arxiv.org/pdf/2402.02111.pdf |
| arXiv | 2402.02111 |
| Language | English |
| Access Restriction | Open |
| Subject Keyword | Statistics - Machine Learning Computer Science - Machine Learning Mathematics - Optimization and Control Mathematics - Probability Statistics - Computation Statistics - Methodology Statistics Computer Science Mathematics |
| Content Type | Text |
| Resource Type | Article |
| Subject | Statistics and Probability |
