论文标题

RescueNet:卫星图像的联合建筑物细分和损坏评估

RescueNet: Joint Building Segmentation and Damage Assessment from Satellite Imagery

论文作者

Gupta, Rohit, Shah, Mubarak

论文摘要

有关建筑物损害程度的准确和细粒度的信息对于指导人道主义援助和灾难响应(HADR)行动至关重要,这是任何自然灾害的立即发生的。近年来,卫星和无人机(无人机)图像已用于此目的,有时是由计算机视觉算法辅助的。现有的计算机视觉方法用于建筑损害评估通常依赖于两级方法,包括使用对象检测模型建筑物检测,然后通过对检测到的建筑物瓷砖进行分类而进行损坏评估。这些多阶段方法不可端到端训练,并且总体结果差。我们提出了RescueNet,这是一个统一的模型,可以同时分割建筑物并评估对单个建筑物的损害水平,并且可以终止训练。为了对该问题的综合性质进行建模,我们提出了一种新的定位意识损失函数,该损失函数由二进制的跨熵损失用于建筑物分割,而前景仅选择性地分类的跨透明损失损失,并且在广泛使用的交叉循环损失上显示出显着改善。与以前的方法相比,大规模测试了RESCUENET,并进行了多种XBD数据集的大规模测试,并实现了建筑细分和损坏分类性能的明显更好,并实现了各种地理区域和灾难类型的概括。

Accurate and fine-grained information about the extent of damage to buildings is essential for directing Humanitarian Aid and Disaster Response (HADR) operations in the immediate aftermath of any natural calamity. In recent years, satellite and UAV (drone) imagery has been used for this purpose, sometimes aided by computer vision algorithms. Existing Computer Vision approaches for building damage assessment typically rely on a two stage approach, consisting of building detection using an object detection model, followed by damage assessment through classification of the detected building tiles. These multi-stage methods are not end-to-end trainable, and suffer from poor overall results. We propose RescueNet, a unified model that can simultaneously segment buildings and assess the damage levels to individual buildings and can be trained end-toend. In order to to model the composite nature of this problem, we propose a novel localization aware loss function, which consists of a Binary Cross Entropy loss for building segmentation, and a foreground only selective Categorical Cross-Entropy loss for damage classification, and show significant improvement over the widely used Cross-Entropy loss. RescueNet is tested on the large scale and diverse xBD dataset and achieves significantly better building segmentation and damage classification performance than previous methods and achieves generalization across varied geographical regions and disaster types.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源