论文标题

在AI注入系统开发和部署中,克服想象力的失败

Overcoming Failures of Imagination in AI Infused System Development and Deployment

论文作者

Boyarskaya, Margarita, Olteanu, Alexandra, Crawford, Kate

论文摘要

Neurips 2020要求研究论文提交的内容包括对“潜在的邪恶用途和失败后果”的影响声明。但是,作为研究人员,从业人员和系统设计师,预期风险的关键挑战是克服克拉克(1962)所说的“想象力失败”。对计算系统中偏见,公平性和透明度的越来越多的研究旨在阐明和减轻危害,因此可以帮助您对特定技术工作的可能的负面影响表示反思。计算危害的普遍概念 - 被狭义地解释为独立危害或代表性危害 - 并不能完全捕获开放的,上下文的依赖性,以及在广泛的AI注入系统中危害的不可观察的性质。当前的文献集中于一小部分危害范围,以激励算法危害,忽略危害的危害,可能会忽略这些危害的可能性,并影响了这些危害的可能性,并影响了这些危害的可能性。系统负担也可能会以不可预测的方式加剧危害,因为他们决定利益相关者对他们如何使用和与系统输出进行交互的控制(包括非用户)。为了有效地协助预测有害用途,我们认为危害框架必须具有上下文感知,并考虑更广泛的潜在利益相关者,系统提供的以及可行的代理,以评估最广泛意义的危害。

NeurIPS 2020 requested that research paper submissions include impact statements on "potential nefarious uses and the consequences of failure." However, as researchers, practitioners and system designers, a key challenge to anticipating risks is overcoming what Clarke (1962) called 'failures of imagination.' The growing research on bias, fairness, and transparency in computational systems aims to illuminate and mitigate harms, and could thus help inform reflections on possible negative impacts of particular pieces of technical work. The prevalent notion of computational harms -- narrowly construed as either allocational or representational harms -- does not fully capture the open, context dependent, and unobservable nature of harms across the wide range of AI infused systems.The current literature focuses on a small range of examples of harms to motivate algorithmic fixes, overlooking the wider scope of probable harms and the way these harms might affect different stakeholders. The system affordances may also exacerbate harms in unpredictable ways, as they determine stakeholders' control(including of non-users) over how they use and interact with a system output. To effectively assist in anticipating harmful uses, we argue that frameworks of harms must be context-aware and consider a wider range of potential stakeholders, system affordances, as well as viable proxies for assessing harms in the widest sense.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源