论文标题
在可视化的“英雄时代”中，我们实际上从评估中学到了什么？
What Do We Actually Learn from Evaluations in the "Heroic Era" of Visualization?
论文作者
论文摘要
我们经常指出，可视化系统评估的数量和复杂性与该领域的最早时代的评估相对增加，这是我们作为一个领域的成熟的证据。我不太相信。特别是，我认为对可视化的评估通常是在现场进行的，或者是由审稿人要求的，无论评估的统计严格或生态有效性如何，都无法告诉我们对可视化系统有用或可转移的。通过一系列的思想实验，我展示了我们目前的可视化评估概念如何不完整，反复无常或无用，以实现该领域的目标，这与我们可能渴望成为的严格的基于循证的领域的“英勇时代”更符合医学科学的“英勇时代”。我的结论是，应该重新审视我们设计评估的模型，以及我们作为领域的优先级。
We often point to the relative increase in the amount and sophistication of evaluations of visualization systems versus the earliest days of the field as evidence that we are maturing as a field. I am not so convinced. In particular, I feel that evaluations of visualizations, as they are ordinarily performed in the field or asked for by reviewers, fail to tell us very much that is useful or transferable about visualization systems, regardless of the statistical rigor or ecological validity of the evaluation. Through a series of thought experiments, I show how our current conceptions of visualization evaluations can be incomplete, capricious, or useless for the goal of furthering the field, more in line with the "heroic age" of medical science than the rigorous evidence-based field we might aspire to be. I conclude by suggesting that our models for designing evaluations, and our priorities as a field, should be revisited.
