Multiple-GPU accelerated high-order gas-kinetic scheme for direct numerical simulation of compressible turbulence

Wang，Yuhang1; Cao，Guiyu2; Pan，Liang1

2023-03-01

10.1016/j.jcp.2022.111899

JOURNAL OF COMPUTATIONAL PHYSICS   Impact Factor & Quartile

0021-9991

1090-2716

High-order gas-kinetic scheme (HGKS) has become a workable tool for the direct numerical simulation (DNS) of turbulence. In this paper, to accelerate the computation, HGKS is implemented with the graphical processing unit (GPU) using the compute unified device architecture (CUDA). Due to the limited available memory size, the computational scale is constrained by single GPU. For large-scale DNS of turbulence, we develop a multi-GPU HGKS simulation using message passing interface (MPI) and CUDA. The benchmark cases for compressible turbulence, including Taylor-Green vortex and turbulent channel flows, are presented to assess the numerical performance of HGKS with Nvidia TITAN RTX and Tesla V100 GPUs. For single-GPU computation, compared with the parallel central processing unit (CPU) code running on the Intel Core i7-9700 with open multi-processing (OpenMP) directives, 7x speedup is achieved by TITAN RTX and 16x speedup is achieved by Tesla V100. For multiple-GPU computation, multiple-GPU accelerated HGKS code scales properly with the increasing number of GPU. The computational time of parallel CPU code running on 1024 Intel Xeon E5-2692 cores with MPI is approximately 3 times longer than that of GPU code using 8 Tesla V100 GPUs with MPI and CUDA. Numerical results confirm the excellent performance of multiple-GPU accelerated HGKS for large-scale DNS of turbulence. Besides reducing memory access pressure, we also exploit single precision floating point arithmetic to accelerate HGKS on GPUs. Reasonably, compared to the computation with FP64 precision, the efficiency is improved and the memory cost is reduced with FP32 precision. Meanwhile, the differences in accuracy for statistical turbulent quantities appear. For turbulent channel flows, difference in long-time statistical turbulent quantities is acceptable between FP32 and FP64 precision solutions. While the obvious discrepancy in instantaneous turbulent quantities can be observed, which shows that FP32 precision is not safe for DNS in compressible turbulence. The choice of precision should be depended on the requirement of accuracy and the available computational resources.

Compressible turbulence Direct numerical simulation High-order gas-kinetic scheme Multiple-GPU accelerated computation

SCI

English

Others

National Natural Science Foundation of China[11701038] ; Fundamental Research Funds for the Central Universities[2018NTST19]

Computer Science ; Physics

Computer Science, Interdisciplinary Applications ; Physics, Mathematical

WOS:000923255500001

ACADEMIC PRESS INC ELSEVIER SCIENCE

PHYSICS

2-s2.0-85146050650

Scopus

1.Laboratory of Mathematics and Complex Systems,School of Mathematical Sciences,Beijing Normal University,Beijing,China
2.Academy for Advanced Interdisciplinary Studies,Southern University of Science and Technology,Shenzhen,China

Wang，Yuhang,Cao，Guiyu,Pan，Liang. Multiple-GPU accelerated high-order gas-kinetic scheme for direct numerical simulation of compressible turbulence[J]. JOURNAL OF COMPUTATIONAL PHYSICS,2023,476.

Wang，Yuhang,Cao，Guiyu,&Pan，Liang.(2023).Multiple-GPU accelerated high-order gas-kinetic scheme for direct numerical simulation of compressible turbulence.JOURNAL OF COMPUTATIONAL PHYSICS,476.

Wang，Yuhang,et al."Multiple-GPU accelerated high-order gas-kinetic scheme for direct numerical simulation of compressible turbulence".JOURNAL OF COMPUTATIONAL PHYSICS 476(2023).