论文标题
通过基于库奇的惩罚来保证非凸优化的优化
Convergence Guarantees for Non-Convex Optimisation with Cauchy-Based Penalties
论文作者
论文摘要
在本文中,我们提出了一种基于重尾库奇分布的近端分裂方法,其近端惩罚函数。我们首先建议用于计算Cauchy先验近端操作员的封闭式表达式,然后使其适用于通用近端分裂算法。我们进一步得出了在涉及基于库奇的惩罚函数的优化问题中保证收敛到解决方案所需的条件。通过满足所提出的条件来设置系统参数,即使当通过近端拆分算法进行最小化时,总体成本函数是非凸的,即使整体成本函数是非凸面。通过求解通用信号处理示例,即在频域中deno的1D信号来评估基于Cauchy正则化的提出方法,这是两个图像重建任务,包括脱毛和DeNoing,以及在多 - Antenna通信系统中的误差恢复。我们通过实验验证了各种情况的拟议收敛条件,并显示了拟议的基于库奇的非凸惩罚功能的有效性,而不是最先进的罚款功能,例如$ l_1 $和总变化($ tv $)规范。
In this paper, we propose a proximal splitting methodology with a non-convex penalty function based on the heavy-tailed Cauchy distribution. We first suggest a closed-form expression for calculating the proximal operator of the Cauchy prior, which then makes it applicable in generic proximal splitting algorithms. We further derive the condition required for guaranteed convergence to a solution in optimisation problems involving the Cauchy based penalty function. Setting the system parameters by satisfying the proposed condition ensures convergence even though the overall cost function is non-convex when minimisation is performed via a proximal splitting algorithm. The proposed method based on Cauchy regularisation is evaluated by solving generic signal processing examples, i.e. 1D signal denoising in the frequency domain, two image reconstruction tasks including de-blurring and denoising, and error recovery in a multiple-antenna communication system. We experimentally verify the proposed convergence conditions for various cases, and show the effectiveness of the proposed Cauchy based non-convex penalty function over state-of-the-art penalty functions such as $L_1$ and total variation ($TV$) norms.