论文标题
MMWave通信与智能反射器的分配加强学习
Distributional Reinforcement Learning for mmWave Communications with Intelligent Reflectors on a UAV
论文作者
论文摘要
在本文中,提出了一个新型的通信框架,该框架使用无人驾驶汽车(UAV)的智能反射器(IR),以增强对毫米波(MMWave)频率的多用户下行链路传输。为了最大化下行链路总数,共同得出了最佳的预编码矩阵(在基站)和反射系数(在IR)。接下来,为解决MMWave通道的不确定性并保持实时方式维护视线链接,提出了一种基于分位数回归优化的分配加固学习方法,以学习MMWave通信的传播环境,然后优化UAV-IR的位置,以最大程度地使长期下降沟通能力最大化。仿真结果表明,与非学习的无人机,静态IR和直接传输方案相比,基于学习的UAV-IR的基于学习的部署具有显着优势,这是根据平均数据速率和可实现的下链路链接MMWave MMWAVE通信的可实现的视线可能性。
In this paper, a novel communication framework that uses an unmanned aerial vehicle (UAV)-carried intelligent reflector (IR) is proposed to enhance multi-user downlink transmissions over millimeter wave (mmWave) frequencies. In order to maximize the downlink sum-rate, the optimal precoding matrix (at the base station) and reflection coefficient (at the IR) are jointly derived. Next, to address the uncertainty of mmWave channels and maintain line-of-sight links in a real-time manner, a distributional reinforcement learning approach, based on quantile regression optimization, is proposed to learn the propagation environment of mmWave communications, and, then, optimize the location of the UAV-IR so as to maximize the long-term downlink communication capacity. Simulation results show that the proposed learning-based deployment of the UAV-IR yields a significant advantage, compared to a non-learning UAV-IR, a static IR, and a direct transmission schemes, in terms of the average data rate and the achievable line-of-sight probability of downlink mmWave communications.