论文标题
炼油厂:针对联邦学习中的梯度泄漏攻击进行完善的数据
Refiner: Data Refining against Gradient Leakage Attacks in Federated Learning
论文作者
论文摘要
最近的作品引起了人们对联邦学习(FL)系统对梯度泄漏攻击的脆弱性的关注。此类攻击利用客户的上传梯度来重建其敏感数据,从而损害了FL的隐私保护能力。作为回应,已经提出了各种防御机制来通过操纵上传梯度来减轻这种威胁。不幸的是,经验评估表明,针对复杂攻击的这些防御能力有限,这表明迫切需要更有效的防御能力。在本文中,我们探讨了一种新颖的防御范式,该范式偏离了传统的梯度扰动方法,而是专注于稳健数据的构建。直觉上,如果强大的数据与客户的原始数据表现出低的语义相似性,那么与稳健数据相关的梯度可以有效地混淆攻击者。为此,我们设计的炼油厂共同优化了两个指标,以保护隐私保护和绩效维护。该实用程序指标旨在促进与鲁棒数据相关的关键参数梯度与客户数据衍生的梯度之间的一致性,从而维持模型性能。此外,隐私度量指标可以指导生成强大的数据,以通过客户的数据扩大语义差距。理论分析支持炼油厂的有效性,对多个基准数据集的经验评估证明了炼油厂在防御最新攻击方面具有出色的防御效果。
Recent works have brought attention to the vulnerability of Federated Learning (FL) systems to gradient leakage attacks. Such attacks exploit clients' uploaded gradients to reconstruct their sensitive data, thereby compromising the privacy protection capability of FL. In response, various defense mechanisms have been proposed to mitigate this threat by manipulating the uploaded gradients. Unfortunately, empirical evaluations have demonstrated limited resilience of these defenses against sophisticated attacks, indicating an urgent need for more effective defenses. In this paper, we explore a novel defensive paradigm that departs from conventional gradient perturbation approaches and instead focuses on the construction of robust data. Intuitively, if robust data exhibits low semantic similarity with clients' raw data, the gradients associated with robust data can effectively obfuscate attackers. To this end, we design Refiner that jointly optimizes two metrics for privacy protection and performance maintenance. The utility metric is designed to promote consistency between the gradients of key parameters associated with robust data and those derived from clients' data, thus maintaining model performance. Furthermore, the privacy metric guides the generation of robust data towards enlarging the semantic gap with clients' data. Theoretical analysis supports the effectiveness of Refiner, and empirical evaluations on multiple benchmark datasets demonstrate the superior defense effectiveness of Refiner at defending against state-of-the-art attacks.