论文标题

网络层次结构和模式恢复在定向稀疏的Hopfield网络中

Network Hierarchy and Pattern Recovery in Directed Sparse Hopfield Networks

论文作者

Rodgers, Niall, Tino, Peter, Johnson, Samuel

论文摘要

许多现实世界的网络都是指向,稀疏和分层的,相对于层次结构,馈送前进和反馈连接的混合物。此外,少数“主”节点通常能够驱动整个系统。我们使用营养分析研究了稀疏,定向,类似Hopfield的神经网络上模式表现和恢复的动力学,以表征其分层结构。这是一种最近的方法,它量化了每个节点在层次结构(营养级别)中的局部位置以及网络的全局方向性(营养相干)。我们表明,即使在复发网络中,系统的状态也可以由一小部分神经元来控制,这些神经元可以通过其低营养水平来识别。我们还发现,通过调整网络的营养相干性和其他拓扑特性,可以显着提高模式恢复任务的性能。这可以解释在动物大脑中观察到的相对稀疏和相干的结构,并为改善人工神经网络的体系结构提供了见解。此外,我们希望通过数值分析证明的原理与广泛的系统有关,其基础网络结构是指向和稀疏的,例如生物学,社会或财务网络。

Many real-world networks are directed, sparse and hierarchical, with a mixture of feed-forward and feedback connections with respect to the hierarchy. Moreover, a small number of 'master' nodes are often able to drive the whole system. We study the dynamics of pattern presentation and recovery on sparse, directed, Hopfield-like neural networks using Trophic Analysis to characterise their hierarchical structure. This is a recent method which quantifies the local position of each node in a hierarchy (trophic level) as well as the global directionality of the network (trophic coherence). We show that even in a recurrent network, the state of the system can be controlled by a small subset of neurons which can be identified by their low trophic levels. We also find that performance at the pattern recovery task can be significantly improved by tuning the trophic coherence and other topological properties of the network. This may explain the relatively sparse and coherent structures observed in the animal brain, and provide insights for improving the architectures of artificial neural networks. Moreover, we expect that the principles we demonstrate, through numerical analysis, here will be relevant for a broad class of system whose underlying network structure is directed and sparse, such as biological, social or financial networks.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源