CDSBen: Benchmarking the Performance of Storage Services in Cloud-native Database System at ByteDance

Zhang, Jiashu1; Jiang, Wen1; Tang, Bo1; Ma, Haoxiang2; Cao, Lixun2; Jiang, Zhongbin2; Nie, Yuanyuan2; Wang, Fan2; Zhang, Lei2; Liang, Yuming2

2023-08-01

10.14778/3611540.3611549

PROCEEDINGS OF THE VLDB ENDOWMENT   Impact Factor & Quartile

2150-8097

In this work, we focus on the performance benchmarking problem of storage services in cloud-native database systems, which are widely used in various cloud applications. The core idea of these systems is to separate computation and storage in traditional monolithic OLTP databases. Specifically, we first present the characteristics of two representative real I/O workloads at the storage tier of ByteDance's cloud-native database veDB. We then elaborate the limitations of using standard benchmarks such as TPC-C and YCSB to resemble these workloads. To overcome these limitations, we devise a learning-based I/O workload benchmark called CDSBen. We demonstrate the superiority of CDSBen by deploying it at ByteDance and showing that its generated I/O traces accurately resemble the real I/O traces in production. Additionally, we verify the accuracy and flexibility of CDSBen by generating a wide range of I/O workloads with different I/O characteristics.

SCI

English

First ; Corresponding

Shenzhen Fundamental Research Program[20220815112848002] ; Guangdong Provincial Key Laboratory[2020B121201001]

Computer Science

Computer Science, Information Systems ; Computer Science, Theory & Methods

WOS:001067701000010

ASSOC COMPUTING MACHINERY

Web of Science

1.Southern Univ Sci & Technol, Dept Comp Sci & Engn, Shenzhen, Peoples R China
2.ByteDance, Beijing, Peoples R China

Zhang, Jiashu,Jiang, Wen,Tang, Bo,et al. CDSBen: Benchmarking the Performance of Storage Services in Cloud-native Database System at ByteDance[J]. PROCEEDINGS OF THE VLDB ENDOWMENT,2023,16(12).

Zhang, Jiashu.,Jiang, Wen.,Tang, Bo.,Ma, Haoxiang.,Cao, Lixun.,...&Liang, Yuming.(2023).CDSBen: Benchmarking the Performance of Storage Services in Cloud-native Database System at ByteDance.PROCEEDINGS OF THE VLDB ENDOWMENT,16(12).

Zhang, Jiashu,et al."CDSBen: Benchmarking the Performance of Storage Services in Cloud-native Database System at ByteDance".PROCEEDINGS OF THE VLDB ENDOWMENT 16.12(2023).