论文标题
用于卫星图像的卷积神经过程
Convolutional Neural Processes for Inpainting Satellite Images
论文作者
论文摘要
卫星图像的广泛可用性使研究人员能够对复杂的系统(例如疾病动态)进行建模。但是,许多卫星图像由于测量缺陷而缺少值,这使得它们无法使用而没有数据插补。例如,Landsat 7卫星的扫描线校正器在2003年破裂,导致其数据的20 \%丢失。 indpainting涉及根据已知像素的预测缺失的内容,并且是图像处理中的一个旧问题,基于PDE或插值方法,但是最近的深度学习方法已显示出希望。但是,其中许多方法并未明确考虑卫星图像的固有时空结构。在这项工作中,我们将卫星图像作为自然的元学习问题进行了介绍,并建议使用卷积神经过程(Convnps),在此我们将每个卫星图像作为其自身任务或2D回归问题。我们表明,在landsat 7卫星图像的扫描线上贴上涂料问题上,Convnps可以超越经典方法和最先进的深度学习模型,并根据各种在分发图像进行评估。
The widespread availability of satellite images has allowed researchers to model complex systems such as disease dynamics. However, many satellite images have missing values due to measurement defects, which render them unusable without data imputation. For example, the scanline corrector for the LANDSAT 7 satellite broke down in 2003, resulting in a loss of around 20\% of its data. Inpainting involves predicting what is missing based on the known pixels and is an old problem in image processing, classically based on PDEs or interpolation methods, but recent deep learning approaches have shown promise. However, many of these methods do not explicitly take into account the inherent spatiotemporal structure of satellite images. In this work, we cast satellite image inpainting as a natural meta-learning problem, and propose using convolutional neural processes (ConvNPs) where we frame each satellite image as its own task or 2D regression problem. We show ConvNPs can outperform classical methods and state-of-the-art deep learning inpainting models on a scanline inpainting problem for LANDSAT 7 satellite images, assessed on a variety of in and out-of-distribution images.