Effective 3C Resource Utilization and Fair Allocation Strategy for Multi-Task Federated Learning

作     者：Zhang, Chaofeng Dong, Mianxiong Ota, Kaoru 

作者机构：Adv Inst Ind Technol Sch Informat & Elect Engn Shinagawa Tokyo 1400011 Japan Muroran Inst Technol Dept Sci & Informat Muroran 0500071 Japan 

出 版 物：《IEEE TRANSACTIONS ON MACHINE LEARNING IN COMMUNICATIONS AND NETWORKING》 (IEEE. Trans. Mach. Learn. Commun. Netw.)

年 卷 期：2023年第1卷

页      面：153-167页

核心收录：

基　　金：JSPS KAKENHI [JP22K17884, JP20H04174, JP22K11989] Leading Initiative for Excellent Young Researchers (LEADER), MEXT, Japan JST, PRESTO, Japan [JPMJPR21P3] Grants-in-Aid for Scientific Research [22K17884, 22K11989] Funding Source: KAKEN 

主　　题：Task analysis Federated learning Resource management Optimization Convergence Training Cloud computing multitasking learning systems user centered design mobile communication 

摘      要：Nowadays, one of the main challenges in expanding AI applications is the effective use of Computation, Communication, and Caching (3C) resources. The complexity of the cloud environment and the diversity of resource usage make it challenging to complete federated learning tasks in a cost-effective, timely, and seamless manner. To address these issues, this paper proposes a comprehensive approach to optimize the overall service efficiency of federated learning in time-varying and 3C-constrained environments. Firstly, a utility function based on convergence efficiency is proposed to reflect the physical benefits of processing AI tasks. Then, a fair allocation strategy consistent with the optimization goal is designed by modeling the task allocation process through virtual queue Lyapunov drift. Next, a Federated Learning Long Short-Term Memory (LSTM) based Queuing Optimization and Allocation Policy Calculation Algorithm (FL-QAPC) is proposed for resource allocation policy calculation using multi-dimensional network state inputs with time series. This algorithm implements predictive control based on historical records. Finally, a feasible experimental test platform is conducted, which is extended to an actual wireless mobile scenario based on 5G. The superiority of the proposed solution is verified through comparison with other benchmarks.