论文标题

进化简单学习是一种生成且紧凑的稀疏框架的分类

Evolutionary Simplicial Learning as a Generative and Compact Sparse Framework for Classification

论文作者

Oktar, Yigit, Turkan, Mehmet

论文摘要

稀疏表示的字典学习在许多重建任务中都成功了。简单学习是对字典学习的适应,在该词典中,子空间被剪切并获得任意偏移,采用了简单的形式。这种适应是通过对稀疏代码的其他约束来实现的。此外,可以选择一种进化方法来确定构成简单的简单的数量和维度,其中大多数生成和紧凑的简单都受到青睐。本文提出了一种进化的简单学习方法,作为用于分类的生成且紧凑的稀疏框架。提出的方法首先应用于单级分类任务,它似乎是考虑基准中最可靠的方法。当在多级分类任务中考虑进化简单学习时,观察到最令人惊讶的结果。由于稀疏表示本质上是生成性的,因此它们存在一个基本问题,即无法区分同一子空间上的两个类别。即使证明了仅生成的方法,也可以通过合成实验和简单学习的优越性来验证这一主张。在高维情况下,简单的学习失去了比判别方法的优越性,但可以通过判别性元素进一步修改,以实现分类任务中的最新性能。

Dictionary learning for sparse representations has been successful in many reconstruction tasks. Simplicial learning is an adaptation of dictionary learning, where subspaces become clipped and acquire arbitrary offsets, taking the form of simplices. Such adaptation is achieved through additional constraints on sparse codes. Furthermore, an evolutionary approach can be chosen to determine the number and the dimensionality of simplices composing the simplicial, in which most generative and compact simplicials are favored. This paper proposes an evolutionary simplicial learning method as a generative and compact sparse framework for classification. The proposed approach is first applied on a one-class classification task and it appears as the most reliable method within the considered benchmark. Most surprising results are observed when evolutionary simplicial learning is considered within a multi-class classification task. Since sparse representations are generative in nature, they bear a fundamental problem of not being capable of distinguishing two classes lying on the same subspace. This claim is validated through synthetic experiments and superiority of simplicial learning even as a generative-only approach is demonstrated. Simplicial learning loses its superiority over discriminative methods in high-dimensional cases but can further be modified with discriminative elements to achieve state-of-the-art performance in classification tasks.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源