论文标题
FAVER:可变帧速率视频的盲目预测
FAVER: Blind Quality Prediction of Variable Frame Rate Videos
论文作者
论文摘要
视频质量评估(VQA)仍然是一个重要且具有挑战性的问题,它会影响最广泛的量表。移动设备和云计算技术的最新进展使得几乎可以瞬间在互联网上捕获,处理和共享高分辨率,高帧速率(HFR)视频成为可能。能够监视和控制这些流视频的质量可以使更愉快的内容和感知优化的速率控制。因此,有迫切需要开发可以在巨大尺度上部署的VQA模型。虽然最近的一些效果已应用于可变帧速率和HFR视频质量的全参考(FR)分析,但靶向框架速率变化的No-Reference(NR)VQA算法的开发很少。在这里,我们提出了一个用于评估HFR视频的首个盲目VQA模型,我们将其配音为带有框架感知的视频评估器(faver)。 Faver使用的扩展模型的空间自然场景统计数据包含时空小波编造的视频信号,以进行有效的帧速率敏感质量预测。我们在几个HFR视频质量数据集上进行的广泛实验表明,Faver以合理的计算成本优于其他盲目VQA算法。为了促进可重复的研究和公众评估,正在在线免费提供FAVER的实施:\ url {https://github.com/uniqzheng/hfr-bvqa}。
Video quality assessment (VQA) remains an important and challenging problem that affects many applications at the widest scales. Recent advances in mobile devices and cloud computing techniques have made it possible to capture, process, and share high resolution, high frame rate (HFR) videos across the Internet nearly instantaneously. Being able to monitor and control the quality of these streamed videos can enable the delivery of more enjoyable content and perceptually optimized rate control. Accordingly, there is a pressing need to develop VQA models that can be deployed at enormous scales. While some recent effects have been applied to full-reference (FR) analysis of variable frame rate and HFR video quality, the development of no-reference (NR) VQA algorithms targeting frame rate variations has been little studied. Here, we propose a first-of-a-kind blind VQA model for evaluating HFR videos, which we dub the Framerate-Aware Video Evaluator w/o Reference (FAVER). FAVER uses extended models of spatial natural scene statistics that encompass space-time wavelet-decomposed video signals, to conduct efficient frame rate sensitive quality prediction. Our extensive experiments on several HFR video quality datasets show that FAVER outperforms other blind VQA algorithms at a reasonable computational cost. To facilitate reproducible research and public evaluation, an implementation of FAVER is being made freely available online: \url{https://github.com/uniqzheng/HFR-BVQA}.