论文标题
二进制分析的地面真相的不便真相
The Inconvenient Truths of Ground Truth for Binary Analysis
论文作者
论文摘要
二进制分析工具和技术的有效性通常是根据它们映射到地面真理的程度。我们发现并非所有地面真理都是平等的。本文挑战了二元分析社区,要长期研究地面真理的概念,以确保我们同意地面真理的定义,以便我们可以对工具和技术的评估充满信心。当我们转向训练有素的机器学习模型时,这变得更加重要,这与培训中地面真相的有效性一样有用。
The effectiveness of binary analysis tools and techniques is often measured with respect to how well they map to a ground truth. We have found that not all ground truths are created equal. This paper challenges the binary analysis community to take a long look at the concept of ground truth, to ensure that we are in agreement with definition(s) of ground truth, so that we can be confident in the evaluation of tools and techniques. This becomes even more important as we move to trained machine learning models, which are only as useful as the validity of the ground truth in the training.