Batch Bayesian optimization with adaptive batch acquisition functions via multi-objective optimization

Chen，Jixiang1; Luo，Fu1; Li，Genghui1; Wang，Zhenkun1,2

2023-06-01

10.1016/j.swevo.2023.101293

Swarm and Evolutionary Computation   Impact Factor & Quartile

2210-6502

Bayesian optimization (BO) is a powerful method for solving expensive black-box optimization problems, and it determines the candidate solutions for expensive evaluation via optimizing the acquisition function. Benefiting from the development of the hardware resources, batch Bayesian optimization (BBO) approaches, characterized by selecting a batch of solutions for expensive evaluation in each iteration, have attracted more and more attention. However, existing BBO methods, using a single or fixed combination of acquisition functions, suffer from lousy flexibility and low robustness when facing various problems. To deal with these issues, this paper proposes a BBO method with adaptive batch acquisition functions via multi-objective optimization (called BBO-ABAFMo). Specifically, multiple acquisition functions are adaptively chosen to form a multi-objective optimization problem (MOP). Its Pareto-optimal solutions provide the candidate solutions for expensive evaluation according to a minimum-diverse-exploitative (MDE) strategy. The experimental results show the advantages of the proposed BBO-ABAFMo over some state-of-the-art methods.

Acquisition function Adaptive selection Batch optimization Bayesian optimization Multi-objective optimization

English

First ; Corresponding

National Natural Science Foundation of China[62106096];National Natural Science Foundation of China[62206120];

2-s2.0-85151247731

Scopus

1.School of System Design and Intelligent Manufacturing,Southern University of Science and Technology,Shenzhen,518000,China
2.Department of Computer Science and Engineering,Southern University of Science and Technology,Shenzhen,518000,China

Chen，Jixiang,Luo，Fu,Li，Genghui,et al. Batch Bayesian optimization with adaptive batch acquisition functions via multi-objective optimization[J]. Swarm and Evolutionary Computation,2023,79.

Chen，Jixiang,Luo，Fu,Li，Genghui,&Wang，Zhenkun.(2023).Batch Bayesian optimization with adaptive batch acquisition functions via multi-objective optimization.Swarm and Evolutionary Computation,79.

Chen，Jixiang,et al."Batch Bayesian optimization with adaptive batch acquisition functions via multi-objective optimization".Swarm and Evolutionary Computation 79(2023).