论文标题
同时使用稀疏极化传感器同时获取高质量的RGB图像和极化信息
Simultaneous Acquisition of High Quality RGB Image and Polarization Information using a Sparse Polarization Sensor
论文作者
论文摘要
本文提出了一种新型的极化传感器结构和网络结构,以获得高质量的RGB图像和极化信息。传统的极化传感器可以同时获取RGB图像和极化信息,但是传感器上的极化器会降低RGB图像的质量。 RGB图像的质量与极化信息之间存在权衡,因为较少的极化像素减少了RGB图像的降解,但减少了极化信息的分辨率。因此,我们提出了一种方法,可以通过在传感器上稀疏地排列极化像素来解决权衡,并使用RGB图像作为指导,以更高的分辨率来补偿低分辨率极化信息。我们提出的网络体系结构由RGB图像改进网络和两极分化信息补偿网络组成。我们通过将其性能与最先进的方法进行比较,确认了我们提出的网络在补偿极化强度的差异成分方面的优势:深度完成。此外,我们证实我们的方法可以同时获得比常规极化传感器更高质量的RGB图像和极化信息,从而解决了RGB图像质量和极化信息之间的权衡。基线代码以及新生成的真实和合成的大规模极化图像数据集可用于进一步的研究和开发。
This paper proposes a novel polarization sensor structure and network architecture to obtain a high-quality RGB image and polarization information. Conventional polarization sensors can simultaneously acquire RGB images and polarization information, but the polarizers on the sensor degrade the quality of the RGB images. There is a trade-off between the quality of the RGB image and polarization information as fewer polarization pixels reduce the degradation of the RGB image but decrease the resolution of polarization information. Therefore, we propose an approach that resolves the trade-off by sparsely arranging polarization pixels on the sensor and compensating for low-resolution polarization information with higher resolution using the RGB image as a guide. Our proposed network architecture consists of an RGB image refinement network and a polarization information compensation network. We confirmed the superiority of our proposed network in compensating the differential component of polarization intensity by comparing its performance with state-of-the-art methods for similar tasks: depth completion. Furthermore, we confirmed that our approach could simultaneously acquire higher quality RGB images and polarization information than conventional polarization sensors, resolving the trade-off between the quality of RGB images and polarization information. The baseline code and newly generated real and synthetic large-scale polarization image datasets are available for further research and development.