论文标题
计算法和网络安全的危险;工程和AI法案的观点
The Dangers of Computational Law and Cybersecurity; Perspectives from Engineering and the AI Act
论文作者
论文摘要
计算法已经开始在社会中扮演角色,该角色已经预测了一段时间。现在在各种司法管辖区使用自动决策和帮助用户的系统,但是随着这种成熟度,某些需要注意。在平台上存在计算法,在这种情况下,在这种情况下,数字系统可以继承相同的缺陷。网络安全解决了这些潜在的弱点。在本文中,我们讨论已知问题,并在各个层面上(从设计到物理领域)进行讨论。我们还考虑机器学习特定的对抗问题。此外,我们对计算法以及现有和未来立法的某些考虑。最后,我们提出了三个建议,这些建议是计算法在全球范围内运行的必要条件,并遵循安全和安全工程中的想法。如前所述,我们发现计算法必须认真考虑,它不仅面临与其他类型的软件和计算机系统相同的风险,而且其中的失败可能会造成财务或物理损害,以及不公正。计算法律系统失败的后果比仅仅是软件和硬件更大。如果系统采用机器学习,则必须注意这带来的非常具体的危险,其中数据中毒是经典的例子。还必须明确立法计算法,我们表明,目前在欧盟中不是这种情况,对于将与之相关的网络安全方面也是如此。但是,欧盟提出的AI法案有巨大的希望,这是一个重要的尝试,即将计算法带入法律领域的具体问题。我们对计算法和网络安全的建议是:适应威胁,充分使用,人类仍然处于部署的中心。
Computational Law has begun taking the role in society which has been predicted for some time. Automated decision-making and systems which assist users are now used in various jurisdictions, but with this maturity come certain caveats. Computational Law exists on the platforms which enable it, in this case digital systems, which means that it inherits the same flaws. Cybersecurity addresses these potential weaknesses. In this paper we go through known issues and discuss them in the various levels, from design to the physical realm. We also look at machine-learning specific adversarial problems. Additionally, we make certain considerations regarding computational law and existing and future legislation. Finally, we present three recommendations which are necessary for computational law to function globally, and which follow ideas in safety and security engineering. As indicated, we find that computational law must seriously consider that not only does it face the same risks as other types of software and computer systems, but that failures within it may cause financial or physical damage, as well as injustice. Consequences of Computational Legal systems failing are greater than if they were merely software and hardware. If the system employs machine-learning, it must take note of the very specific dangers which this brings, of which data poisoning is the classic example. Computational law must also be explicitly legislated for, which we show is not the case currently in the EU, and this is also true for the cybersecurity aspects that will be relevant to it. But there is great hope in EU's proposed AI Act, which makes an important attempt at taking the specific problems which Computational Law bring into the legal sphere. Our recommendations for Computational Law and Cybersecurity are: Accommodation of threats, adequate use, and that humans remain in the centre of their deployment.