论文标题
MMWave/Sub-6双接口的延迟感知时间表:增强学习方法
Delay-Aware Scheduling over mmWave/Sub-6 Dual Interfaces: A Reinforcement Learning Approach
论文作者
论文摘要
我们考虑具有MMWave/sub6双接口的发射器。由于MMWave通道的间歇性,发射器必须在界面上明智地安排数据包,以通过观察系统状态来最大程度地减少平均延迟。我们使用众所周知的动态编程方法和Q学习,以找到最佳的调度策略,并研究观察CSI对环境知识不同的最佳政策的影响。我们发现,只有当频道状态过渡模型不可用时,Instantaneouscsi才能帮助减少系统延迟
We consider a transmitter with mmWave/sub6 dual interfaces. Due to the intermittency of mmWave channel, the transmitter must schedule packets wisely across the interfaces to minimize the average delay by observing the system state. We usethe well-known dynamic programming methods and Q-learning to find the optimal scheduling policy and investigate the influenceof observing CSI on the optimal policy under different levels of knowledge of the environment. We find that only when the channel state transition model is not available, the instantaneousCSI can help in reducing system delay