论文标题
使用雷达和红外传感的全天候对象识别
All-Weather Object Recognition Using Radar and Infrared Sensing
论文作者
论文摘要
自动驾驶汽车是一种具有改变人类生活的能力的新兴技术。当前最有能力感知的传感器系统基于光传感器。例如,深度神经网络在处理来自相机以及光检测和范围(LIDAR)传感器的数据时表现出了出色的结果。但是,由于传感器波长,这些传感器在不利天气条件下的性能较差,例如雨,雾和雪。本论文探讨了基于长波偏光红外(IR)成像和成像雷达的新传感发展,以识别对象。首先,我们使用偏振红外数据基于Stokes参数开发了一种方法,以使用深层神经网络识别车辆。其次,我们探索了仅使用低THZ雷达传感器捕获的功率谱以在受控方案中执行对象识别的潜力。后者的工作基于数据驱动的方法,以及基于衰减,范围和斑点噪声的数据增强方法的开发。最后,我们在“野外”中创建了一个新的大规模数据集,其中有许多不同的天气情况(阳光,阴天,夜间,雾气,雨水和雪)表现出雷达鲁棒的鲁棒性,可以在不良天气中检测到车辆。高分辨率雷达和极化IR成像,结合深度学习方法,作为基于可见光谱光学技术的当前汽车传感系统的潜在替代方法,因为它们在恶劣天气和不利的光线条件下更强大。
Autonomous cars are an emergent technology which has the capacity to change human lives. The current sensor systems which are most capable of perception are based on optical sensors. For example, deep neural networks show outstanding results in recognising objects when used to process data from cameras and Light Detection And Ranging (LiDAR) sensors. However these sensors perform poorly under adverse weather conditions such as rain, fog, and snow due to the sensor wavelengths. This thesis explores new sensing developments based on long wave polarised infrared (IR) imagery and imaging radar to recognise objects. First, we developed a methodology based on Stokes parameters using polarised infrared data to recognise vehicles using deep neural networks. Second, we explored the potential of using only the power spectrum captured by low-THz radar sensors to perform object recognition in a controlled scenario. This latter work is based on a data-driven approach together with the development of a data augmentation method based on attenuation, range and speckle noise. Last, we created a new large-scale dataset in the "wild" with many different weather scenarios (sunny, overcast, night, fog, rain and snow) showing radar robustness to detect vehicles in adverse weather. High resolution radar and polarised IR imagery, combined with a deep learning approach, are shown as a potential alternative to current automotive sensing systems based on visible spectrum optical technology as they are more robust in severe weather and adverse light conditions.