Secure Federated Learning over Wireless Communication Networks with Model Compression

DING Yahao; Mohammad SHIKH?BAHAEI; YANG Zhaohui; HUANG Chongwen; YUAN Weijie

2023

10.12142/ZTECOM.202301006

中兴通讯技术（英文版）   Impact Factor & Quartile

1673-5188

Although federated learning (FL) has become very popular recently, it is vulnerable to gradient leakage attacks. Recent studies have shown that attackers can reconstruct clients' private data from shared models or gradients. Many existing works focus on adding privacy protection mechanisms to prevent user privacy leakages, such as differential privacy (DP) and homomorphic encryption. These defenses may cause an increase in computation and communication costs or degrade the performance of FL. Besides, they do not consider the impact of wireless network resources on the FL training process. Herein, we propose weight compression, a defense method to prevent gradient leakage attacks for FL over wireless networks. The gradient compression matrix is determined by the user's location and channel conditions. We also add Gaussian noise to the compressed gradients to strengthen the defense. This joint learning of wireless resource allocation and weight com-pression matrix is formulated as an optimization problem with the objective of minimizing the FL loss function. To find the solution, we first analyze the convergence rate of FL and quantify the effect of the weight matrix on FL convergence. Then, we seek the optimal resource block (RB) allocation by exhaustive search or ant colony optimization (ACO) and then use the CVX toolbox to obtain the optimal weight matrix to minimize the optimization function. The simulation results show that the optimized RB can accelerate the convergence of FL.

English

Others

WanFang

zxtxjs-e202301006

1.King's College London,London WC2R 2LS,U.K.
2.Zhejiang University,Hangzhou 310058,China
3.Southern University of Science and Technology,Shenzhen 518055,China

DING Yahao,Mohammad SHIKH?BAHAEI,YANG Zhaohui,et al. Secure Federated Learning over Wireless Communication Networks with Model Compression[J]. 中兴通讯技术（英文版）,2023,21(1):46-54.

DING Yahao,Mohammad SHIKH?BAHAEI,YANG Zhaohui,HUANG Chongwen,&YUAN Weijie.(2023).Secure Federated Learning over Wireless Communication Networks with Model Compression.中兴通讯技术（英文版）,21(1),46-54.

DING Yahao,et al."Secure Federated Learning over Wireless Communication Networks with Model Compression".中兴通讯技术（英文版） 21.1(2023):46-54.