论文标题
从复制有关基于信息的基于信息的测试案例的研究优先级的研究中学到的经验教训
Lessons learned from replicating a study on information-retrieval based test case prioritization
论文作者
论文摘要
目的：在这项研究中，我们旨在复制一项基于人工制品的软件测试研究以解决差距。我们专注于（a）提供复制的逐步指南，在复制基于人工制品的测试研究时反映了挑战，（b）评估有关结果的有效性和鲁棒性的复制研究。 方法：我们通过Kwon等人复制了测试案例的优先级技术。我们使用四个程序，两个来自原始研究和两个新程序复制了原始研究。复制研究是使用Python实施的，以支持未来的复制。结果：确定了促进复制的各种一般因素，例如：（1）文档的重要性； （2）原始作者需要协助； （3）维护开源存储库中的问题（例如，关于所需的软件依赖关系）； （4）脚本的可用性。我们还提出了一些针对研究及其背景的观察结果，例如使用不同的突变工具和突变产生策略的见解。结论：我们得出的结论是，Kwon等人的研究。在中型程序中是可复制的，并且可以自动化以促进软件从业人员，鉴于所需信息的可用性。
Objective: In this study, we aim to replicate an artefact-based study on software testing to address the gap. We focus on (a) providing a step by step guide of the replication, reflecting on challenges when replicating artefact-based testing research, (b) Evaluating the replicated study concerning its validity and robustness of the findings. Method: We replicate a test case prioritization technique by Kwon et al. We replicated the original study using four programs, two from the original study and two new programs. The replication study was implemented using Python to support future replications. Results: Various general factors facilitating replications are identified, such as: (1) the importance of documentation; (2) the need of assistance from the original authors; (3) issues in the maintenance of open source repositories (e.g., concerning needed software dependencies); (4) availability of scripts. We also raised several observations specific to the study and its context, such as insights from using different mutation tools and strategies for mutant generation. Conclusion: We conclude that the study by Kwon et al. is replicable for small and medium programs and could be automated to facilitate software practitioners, given the availability of required information.
