面向异构联邦边缘学习的数据驱动参与者选择与带宽分配

Data-Driven Participant Selection and Bandwidth Allocation for Heterogeneous Federated Edge Learning

IEEE Transactions on Systems, Man, and Cybernetics: Systems · 2023
被引 21
ABS 3

中文导读

针对联邦边缘学习中数据异构、无线资源有限和设备异构的挑战,提出联合参与者选择和带宽分配方案,通过松弛方法和优先级选择算法加速收敛,实验表明收敛速度最高提升55%。

Abstract

Federated edge learning (FEEL) is a rapidly growing distributed learning technique for next-generation wireless edge systems. Smart systems across various application domains face challenges, such as data heterogeneity, limited wireless resources, and device heterogeneity, which necessitate intelligent participant selection schemes that accelerate convergence rates. Consequently, this article presents joint participant selection and bandwidth allocation schemes to address these challenges. First, we formulate an optimization problem that considers communication and computation latencies, as well as imbalanced data distribution, while meeting round deadlines and bandwidth constraints. To address the combinatorial problems of participant selection, we employ a relaxation method followed by a proposed priority selection algorithm to select near-optimal participants. The proposed algorithm initially prioritizes participants with larger datasets, effective channel states, and better CPU speeds. To address data heterogeneity, we propose a randomized deadline-controlling algorithm that diversifies updates by allowing the edge server to include different participants with fewer data samples in training rounds. The proposed algorithms offer near-optimal performance compared to the brute-force method. Experiments demonstrate that our proposed scheme accelerates the convergence rate by up to 55% under extensive non-IID settings compared to benchmarks. Furthermore, the deadline-controlling algorithm improves performance at high levels of data heterogeneity, resulting in faster FEEL systems.

联邦学习边缘计算无线资源分配数据异构参与者选择