论文标题
完善的人:通过生成对抗网络的个性化联合学习
PerFED-GAN: Personalized Federated Learning via Generative Adversarial Networks
论文作者
论文摘要
联合学习正在作为一种分布式机器学习方法越来越受欢迎,该方法可用于部署AI依赖的物联网应用程序,同时保护客户数据隐私和安全性。由于客户的差异,单个全球模型可能对所有客户都表现不佳,因此,个性化的联合学习方法,该方法为每个客户培训一个个性化模型,以更好地适合其个人需求,成为研究热点。但是,大多数个性化的联合学习研究集中在数据异质性上,同时忽略了模型架构异质性的需求。大多数现有的联合学习方法均匀地设置了所有参与联合学习的客户的模型体系结构,这对于每个客户的个人模型和本地数据分配要求都是不便的,并且也增加了客户端模型泄漏的风险。本文提出了一种基于共同培训和生成的对抗网络(GAN)的联合学习方法,该方法允许每个客户设计自己的模型,以独立参与联邦学习培训,而无需与其他客户或中心共享任何模型架构或参数信息。在我们的实验中,当客户的模型体系结构和数据分布差异很大时,所提出的方法在平均测试准确性中的现有方法优于42%。
Federated learning is gaining popularity as a distributed machine learning method that can be used to deploy AI-dependent IoT applications while protecting client data privacy and security. Due to the differences of clients, a single global model may not perform well on all clients, so the personalized federated learning method, which trains a personalized model for each client that better suits its individual needs, becomes a research hotspot. Most personalized federated learning research, however, focuses on data heterogeneity while ignoring the need for model architecture heterogeneity. Most existing federated learning methods uniformly set the model architecture of all clients participating in federated learning, which is inconvenient for each client's individual model and local data distribution requirements, and also increases the risk of client model leakage. This paper proposes a federated learning method based on co-training and generative adversarial networks(GANs) that allows each client to design its own model to participate in federated learning training independently without sharing any model architecture or parameter information with other clients or a center. In our experiments, the proposed method outperforms the existing methods in mean test accuracy by 42% when the client's model architecture and data distribution vary significantly.