论文标题
具有多层对比单元的主动域适应性,用于语义分割
Active Domain Adaptation with Multi-level Contrastive Units for Semantic Segmentation
论文作者
论文摘要
为了进一步降低半监督域适应(SSDA)标签的成本,一种更有效的方法是使用主动学习(AL)注释具有特定属性的选定子集。但是,域的适应任务始终在两个交互式方面解决:域传输和歧视的增强,这要求所选数据在模型下既不确定,又在特征空间中多样化。与分类任务中的积极学习相反,通常在分割任务中包含上述属性的像素通常具有挑战性,从而导致像素选择策略的复杂设计。为了解决这一问题,我们提出了一种新型的活动域适应方案,该方案具有多层对比单元(ADA-MCU),用于语义图像分割。引入了一个简单的像素选择策略,然后引入多层对比单元的构建,以优化域适应性和主动监督学习的模型。实际上,MCU是通过使用标记和未标记的像素来由内图像,跨图像和跨域水平构建的。在每个级别,我们定义了从中心到中心和像素的方式进行对比损失,目的是共同使类别中心保持一致并减少决策范围附近的异常值。此外,我们还引入了一个类别相关矩阵,以隐式描述类别之间的关系,该类别用于调整MCUS的损失权重。对标准基准测试的广泛实验结果表明,该提出的方法针对最先进的SSDA方法具有竞争性能,其标记像素少50%,并且通过使用相同水平的注释成本来胜过较大的幅度,并显着优于最先进的差距。
To further reduce the cost of semi-supervised domain adaptation (SSDA) labeling, a more effective way is to use active learning (AL) to annotate a selected subset with specific properties. However, domain adaptation tasks are always addressed in two interactive aspects: domain transfer and the enhancement of discrimination, which requires the selected data to be both uncertain under the model and diverse in feature space. Contrary to active learning in classification tasks, it is usually challenging to select pixels that contain both the above properties in segmentation tasks, leading to the complex design of pixel selection strategy. To address such an issue, we propose a novel Active Domain Adaptation scheme with Multi-level Contrastive Units (ADA-MCU) for semantic image segmentation. A simple pixel selection strategy followed with the construction of multi-level contrastive units is introduced to optimize the model for both domain adaptation and active supervised learning. In practice, MCUs are constructed from intra-image, cross-image, and cross-domain levels by using both labeled and unlabeled pixels. At each level, we define contrastive losses from center-to-center and pixel-to-pixel manners, with the aim of jointly aligning the category centers and reducing outliers near the decision boundaries. In addition, we also introduce a categories correlation matrix to implicitly describe the relationship between categories, which are used to adjust the weights of the losses for MCUs. Extensive experimental results on standard benchmarks show that the proposed method achieves competitive performance against state-of-the-art SSDA methods with 50% fewer labeled pixels and significantly outperforms state-of-the-art with a large margin by using the same level of annotation cost.