论文标题

增强双路线网络,用于几次学习

Augmented Bi-path Network for Few-shot Learning

论文作者

Yan, Baoming, Zhou, Chen, Zhao, Bo, Guo, Kan, Yang, Jiang, Li, Xiaobo, Zhang, Ming, Wang, Yizhou

论文摘要

旨在从几乎没有标记的培训数据中学习的几个射击学习(FSL)由于许多现实世界应用中的昂贵标签成本而成为一个流行的研究主题。一种成功的FSL方法学会了通过简单地将两个图像的特征与将其馈入神经网络来比较测试(查询)图像和训练(支持)图像。但是,由于每个类别的数据很少,因此神经网络很难学习或比较两个图像的局部特征。这种简单的图像级比较可能会导致严重的错误分类。为了解决这个问题,我们提出了增强的双径网络(ABNET),以学习比较多尺度上的全球和本地特征。具体而言,将显着贴片提取并嵌入为每个图像的本地特征。然后,该模型学会了增强功能以​​提高鲁棒性。最后,该模型学会了在合并相似性之前分别比较全球和本地特征,即在两个路径中进行比较。广泛的实验表明,所提出的ABNET优于最新方法。提供了定量和视觉消融研究,以验证提出的模块是否导致更精确的比较结果。

Few-shot Learning (FSL) which aims to learn from few labeled training data is becoming a popular research topic, due to the expensive labeling cost in many real-world applications. One kind of successful FSL method learns to compare the testing (query) image and training (support) image by simply concatenating the features of two images and feeding it into the neural network. However, with few labeled data in each class, the neural network has difficulty in learning or comparing the local features of two images. Such simple image-level comparison may cause serious mis-classification. To solve this problem, we propose Augmented Bi-path Network (ABNet) for learning to compare both global and local features on multi-scales. Specifically, the salient patches are extracted and embedded as the local features for every image. Then, the model learns to augment the features for better robustness. Finally, the model learns to compare global and local features separately, i.e., in two paths, before merging the similarities. Extensive experiments show that the proposed ABNet outperforms the state-of-the-art methods. Both quantitative and visual ablation studies are provided to verify that the proposed modules lead to more precise comparison results.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源