论文标题

流量控制的深度强化学习利用了不同的物理学来增加雷诺的态度

Deep reinforcement learning for flow control exploits different physics for increasing Reynolds-number regimes

论文作者

Varela, Pau, Suárez, Pol, Alcántara-Ávila, Francisco, Miró, Arnau, Rabault, Jean, Font, Bernat, García-Cuevas, Luis Miguel, Lehmkuhl, Oriol, Vinuesa, Ricardo

论文摘要

深厚的人工神经网络(ANN)与深度加强学习一起使用(DRL),由于控制复杂问题的能力,人们正在受到越来越多的关注。该技术最近用于解决与流控制有关的问题。在这项工作中,通过DRL代理训练的ANN用于执行主动流控制。进行了围绕气缸的流量的二维模拟,并考虑基于位于圆柱体壁上的两个喷气机的主动控制。通过从圆柱体周围的流中收集信息,ANN代理能够学习喷气机的有效控制策略,从而大大减少阻力。在目前的工作中,研究了以前考虑的雷诺数范围,并将其与使用经典流量控制方法获得的结果进行了比较。随着雷诺数的增加,DRL确定了控制策略中的显着不同的性质。对于RE <= 1000,获得了基于相对于唤醒振荡的反对控制的经典控制策略。对于RE = 2000,新策略包括边界层和分离区域的能量,通过高频致动,以类似于阻力危机的方式调节流量分离并减少阻力。在RE = 2000时进行流动的交叉应用,在减少阻力方面获得了相似的结果,而在RE = 1000和2000年接受训练的代理进行了训练。两个不同的策略产生相同的绩效的事实使我们质疑我们的Reynolds数量制度(RE = 2000)是否属于Antural Different Flow的过渡,这只会拖延了一项较高的策略。这一发现允许在较低的雷诺数字上应用ANN,但本质上是可比的,从而节省了计算资源。

Deep artificial neural networks (ANNs) used together with deep reinforcement learning (DRL) are receiving growing attention due to their capabilities to control complex problems. This technique has been recently used to solve problems related to flow control. In this work, an ANN trained through a DRL agent is used to perform active flow control. Two-dimensional simulations of the flow around a cylinder are conducted and an active control based on two jets located on the walls of the cylinder is considered. By gathering information from the flow surrounding the cylinder, the ANN agent is able to learn effective control strategies for the jets, leading to a significant drag reduction. In the present work, a Reynolds-number range beyond those previously considered is studied and compared with results obtained using classical flow-control methods. Significantly different nature in the control strategies is identified by the DRL as the Reynolds number Re increases. For Re <= 1000 the classical control strategy based on an opposition control relative to the wake oscillation is obtained. For Re = 2000 the new strategy consists of an energisation of the boundary layers and the separation area, which modulate the flow separation and reduce drag in a fashion similar to that of the drag crisis, through a high frequency actuation. A cross-application of agents is performed for a flow at Re = 2000, obtaining similar results in terms of drag reduction with the agents trained at Re = 1000 and 2000. The fact that two different strategies yield the same performance make us question whether this Reynolds number regime (Re = 2000) belongs to a transition towards a nature-different flow which would only admit a high-frequency actuation strategy to obtain drag reduction. This finding allows the application of ANNs trained at lower Reynolds numbers but comparable in nature, saving computational resources.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源