Bayesian Optimization over Mixed Type Inputs with Encoding Methods
Traditional Bayesian Optimization (BO) algorithms assume that the objective function is defined over numeric input space. To generalize BO for mixed numeric and categorical inputs, existing approaches mainly model or optimize them separately and thus cannot fully capture the relationship among different types of inputs. The complexity incurred by additional operations for the categorical inputs in these approaches can also reduce the efficiency of BO, especially when facing high-cardinality inputs. In this paper, we revisit the encoding approaches, which transfer categorical inputs to numerical ones to form a concise and easy-to-use BO framework. Specifically, we propose the target mean encoding BO (TmBO) and aggregate encoding BO (AggBO), where TmBO transfers each value of a categorical input based on the outputs corresponding to this value, and AggBO encodes multiple choices of a categorical input through several distinct ranks. Different from the prominent one-hot encoding, both approaches transfer each categorical input into exactly one numerical input and thus avoid severely increasing the dimension of the input space. We demonstrate that TmBO and AggBO are more efficient than existing approaches on several synthetic and real-world optimization tasks.
First ; Corresponding
Cited Times [WOS]:0
|Document Type||Conference paper|
|Department||Southern University of Science and Technology|
SUSTech Business School,Southern University of Science and Technology,Shenzhen,518055,China
|First Author Affilication||Southern University of Science and Technology|
|Corresponding Author Affilication||Southern University of Science and Technology|
|First Author's First Affilication||Southern University of Science and Technology|
Liu，Zhihao,Ou，Weiming,Wang，Songhao. Bayesian Optimization over Mixed Type Inputs with Encoding Methods[C],2023:203-215.
|Files in This Item:||There are no files associated with this item.|
|Recommend this item|
|Export to Endnote|
|Export to Excel|
|Export to Csv|
|Similar articles in Google Scholar|
|Similar articles in Baidu Scholar|
|Similar articles in Bing Scholar|
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.