论文标题
用热位置编码的卫星图像时间序列的一般分类
Generalized Classification of Satellite Image Time Series with Thermal Positional Encoding
论文作者
论文摘要
大规模的农作物类型分类是遥感工作的核心,具有经济和生态重要性的应用。当前的最新深度学习方法基于自我注意事项,并使用卫星图像时间序列(sits)根据其独特的生长模式来区分作物类型。但是,现有方法对训练期间未观察到的区域的概括很差,这主要是因为由于气候变化而导致生长季节的时间变化不健全。为此,我们建议用于基于注意的农作物分类器的热位置编码(TPE)。与以前的位置编码基于日历时间(例如年度日)不同,TPE基于热时间,这是通过在整个生长季节积累每日平均温度来获得的。由于农作物的生长与热时间直接相关,但与日历时间无关,因此TPE解决了不同区域之间的时间变化以改善概括。我们提出了多种TPE策略,包括可学习的方法,以进一步改善与常见的固定位置编码相比。我们证明了我们在四个不同欧洲地区的农作物分类任务上的方法,在那里我们获得了最新的概括结果。
Large-scale crop type classification is a task at the core of remote sensing efforts with applications of both economic and ecological importance. Current state-of-the-art deep learning methods are based on self-attention and use satellite image time series (SITS) to discriminate crop types based on their unique growth patterns. However, existing methods generalize poorly to regions not seen during training mainly due to not being robust to temporal shifts of the growing season caused by variations in climate. To this end, we propose Thermal Positional Encoding (TPE) for attention-based crop classifiers. Unlike previous positional encoding based on calendar time (e.g. day-of-year), TPE is based on thermal time, which is obtained by accumulating daily average temperatures over the growing season. Since crop growth is directly related to thermal time, but not calendar time, TPE addresses the temporal shifts between different regions to improve generalization. We propose multiple TPE strategies, including learnable methods, to further improve results compared to the common fixed positional encodings. We demonstrate our approach on a crop classification task across four different European regions, where we obtain state-of-the-art generalization results.