论文标题
C-P地图：扬声器验证的新型评估工具包
C-P Map: A Novel Evaluation Toolkit for Speaker Verification
论文作者
论文摘要
评估试验用于探测自动扬声器验证（ASV）系统的性能。尽管具有明显的重要性和影响，但在研究和工程实践中尚未对评估试验得到认真的处理。本文首先对评估试验进行了理论分析，并以试验设计中最流行的交叉生产方法强调了潜在的偏见。为了解释和解决此问题，我们定义了从中得出的试验配置和C-P映射的概念。 C-P MAP在二维映射中测量了各种试验配置上ASV系统的性能。在地图上，每个位置代表特定的试验配置，其相应的颜色代表系统性能。对代表性ASV系统进行的实验表明，提出的C-P MAP为ASV性能分析和比较提供了强大的评估工具包。 C-P MAP的源代码已在https://gitlab.com/csltstu/sunine上发布。
Evaluation trials are used to probe performance of automatic speaker verification (ASV) systems. In spite of the clear importance and impact, evaluation trials have not been seriously treated in research and engineering practice. This paper firstly presents a theoretical analysis on evaluation trials and highlights potential bias with the most popular cross-pairing approach used in trials design. To interpret and settle this problem, we define the concept of trial config and C-P map derived from it. The C-P map measures the performance of an ASV system on various trial configs in a 2-dimensional map. On the map, each location represents a particular trial config and its corresponding color represents the system performance. Experiments conducted on representative ASV systems show that the proposed C-P map offers a powerful evaluation toolkit for ASV performance analysis and comparison. The source code for C-P map has been release at https://gitlab.com/csltstu/sunine.
