论文标题

多项服务网络中QoS受限资源分配的深入强化学习

Deep Reinforcement Learning for QoS-Constrained Resource Allocation in Multiservice Networks

论文作者

Saraiva, Juno V., Braga Jr., Iran M., Monteiro, Victor F., Lima, F. Rafael M., Maciel, Tarcisio F., Freitas Jr., Walter C., Cavalcanti, F. Rodrigo P.

论文摘要

在本文中,我们研究了一个无线电资源分配(RRA),该分配是一个非凸优化问题,其主要目的是最大程度地提高光谱效率,从而获得多功能无线系统中的满意度保证。此问题先前已经在文献和有效的启发式方法中进行了研究。但是,为了评估机器学习(ML)算法在解决RRA背景下的优化问题时的性能,我们重新访问该问题并提出基于增强学习(RL)框架的解决方案。具体而言,开发了基于多代理深度RL的分布式优化方法,每个代理都会决定通过与当地环境进行交互,直到达到融合来找到策略。因此,本文的重点是RL的应用,我们的主要提案包括一种新的基于RL的方法,可以共同处理RRA,在多服务CELULAL网络中的满意保证和服务质量(QoS)约束。最后,通过计算模拟,我们将文献的最新解决方案与我们的建议进行了比较,并且在吞吐量和中断率方面,我们显示了后者几乎最佳的性能。

In this article, we study a Radio Resource Allocation (RRA) that was formulated as a non-convex optimization problem whose main aim is to maximize the spectral efficiency subject to satisfaction guarantees in multiservice wireless systems. This problem has already been previously investigated in the literature and efficient heuristics have been proposed. However, in order to assess the performance of Machine Learning (ML) algorithms when solving optimization problems in the context of RRA, we revisit that problem and propose a solution based on a Reinforcement Learning (RL) framework. Specifically, a distributed optimization method based on multi-agent deep RL is developed, where each agent makes its decisions to find a policy by interacting with the local environment, until reaching convergence. Thus, this article focuses on an application of RL and our main proposal consists in a new deep RL based approach to jointly deal with RRA, satisfaction guarantees and Quality of Service (QoS) constraints in multiservice celular networks. Lastly, through computational simulations we compare the state-of-art solutions of the literature with our proposal and we show a near optimal performance of the latter in terms of throughput and outage rate.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源