论文标题

地理表:通过原型表示形式的图形少数射击课程学习

Geometer: Graph Few-Shot Class-Incremental Learning via Prototype Representation

论文作者

Lu, Bin, Gan, Xiaoying, Yang, Lina, Zhang, Weinan, Fu, Luoyi, Wang, Xinbing

论文摘要

随着图形数据的巨大扩展,节点分类在许多现实世界应用中都表明了其非常重要的。现有的基于图形神经网络的方法主要集中于对具有丰富标签的固定类中的未标记节点进行分类。但是,在许多实际情况下,随着新节点和边缘的出现而演变。新颖的课程逐渐出现,由于其新出现或缺乏探索,很少有标签。在本文中,我们专注于这个具有挑战性但实用的图形少数类新学习(GFSCIL)问题,并提出了一种称为地理表的新方法。 Geometer没有通过找到最近的类原型来预测节点的标签,而不是更换和重新训练完全连接的神经网络分类器。原型是代表公制空间中类的矢量。随着新颖类的弹出窗口,地理表通过观察几何近端,均匀性和分离性来学习和调整基于注意力的原型。进一步引入教师知识蒸馏和偏见的抽样,以减轻灾难性的遗忘和不平衡的标签问题。四个公共数据集的实验结果表明,与最先进的方法相比,地理表可实现9.46%,至27.60%。

With the tremendous expansion of graphs data, node classification shows its great importance in many real-world applications. Existing graph neural network based methods mainly focus on classifying unlabeled nodes within fixed classes with abundant labeling. However, in many practical scenarios, graph evolves with emergence of new nodes and edges. Novel classes appear incrementally along with few labeling due to its newly emergence or lack of exploration. In this paper, we focus on this challenging but practical graph few-shot class-incremental learning (GFSCIL) problem and propose a novel method called Geometer. Instead of replacing and retraining the fully connected neural network classifer, Geometer predicts the label of a node by finding the nearest class prototype. Prototype is a vector representing a class in the metric space. With the pop-up of novel classes, Geometer learns and adjusts the attention-based prototypes by observing the geometric proximity, uniformity and separability. Teacher-student knowledge distillation and biased sampling are further introduced to mitigate catastrophic forgetting and unbalanced labeling problem respectively. Experimental results on four public datasets demonstrate that Geometer achieves a substantial improvement of 9.46% to 27.60% over state-of-the-art methods.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源