| 摘要: |
| 测试用例优先排序(test case prioritization,简称TCP)问题是回归测试研究中的一个热点.通过设定特定排序准则,对测试用例进行排序以优化其执行次序,旨在最大化排序目标,例如最大化测试用例集的早期缺陷检测速率.TCP 问题尤其适用于因测试预算不足以致不能执行完所有测试用例的测试场景.首先对TCP问题进行描述,并依次从源代码、需求和模型这3 个角度出发对已有的TCP 技术进行分类;然后对一类特殊的TCP 问题(即测试资源感知的TCP 问题)的已有研究成果进行总结;随后依次总结实证研究中常用的评测指标、评测数据集和缺陷类型对实证研究结论的影响;接着依次介绍TCP 技术在一些特定测试领域中的应用,包括组合测试、事件驱动型应用测试、Web 服务测试和缺陷定位等;最后对下一步工作进行展望. |
| 关键词: 回归测试 测试用例优先排序 贪心法 元启发式搜索 实证研究 |
| DOI：10.3724/SP.J.1001.2013.04420 |
| 分类号: |
| 基金项目:国家自然科学基金(60873027, 61202006); 国家高技术研究发展计划(863)(2006AA01Z177); 国家重点基础研究发展计划(973)(2009CB320705); 江苏省高校自然科学研究项目(12KJB520014); 江苏省研究生培养创新工程(CXZZ120935); 南通市应用研究计划(BK2012023); 南京大学计算机软件新技术国家重点实验室开放课题(KFKT2012B29) |
|
| Survey of Test Case Prioritization Techniques for Regression Testing |
|
CHEN Xiang1,2, CHEN Ji-Hong1, JU Xiao-Lin1, GU Qing2
|
|
1.School of Computer Science and Technology, Nantong University, Nantong 226019, China;2.State Key Laboratory for Novel Software Technology (Nanjing University), Nanjing 210093, China
|
| Abstract: |
| Test case prioritization (TCP) issue is a hot research topic in regression testing research. This method tries to optimize the execution schedule based on a specific prioritization criterion. The purpose of the TCP techniques is to maximize a specific prioritization objective, such as the early fault detection rate of the original test suite. This technique is especially applied to some testing scenarios, for example testing resource is limited for executing all the test cases. This paper first describes the issue of TCP and classifies the existing TCP techniques into three categories: source code, requirement, and model. The paper secondly formulates a specific TCP issue (i.e., resource-aware TCP issue) and summarizes its research work. The paper finally summarizes commonly-used evaluation metrics and subjects in experimental studies, and empirical result affection of different fault injection types. The paper fourthly summarizes the application of TCP in some specific testing domains, such as combinatorial testing, event-driven applications testing, fault localization, and Web services testing and discusses some future work of the TCP issue. |
| Key words: regression testing test case prioritization greedy algorithm meta-heuristic search empirical study |
