| 摘要: |
| 众包测试是一种新兴的软件测试方式,得到了学术界和工业界的广泛关注.系统地总结了近年来众包软件测试研究的学术文献以及工业界实践进展:首先,从学术文献涉及的研究主题演变、涵盖的软件测试问题和众包测试流程、采用的实验对象及测试人员规模等多个角度对相关文献中提出的技术和方法进行了汇总;然后,从测试领域、测试对象、工人召集方式、绩效考核方式等方面分析对比了当前应用最广泛的20个众包测试商业平台;最后,探讨了众包软件测试的未来发展趋势、机遇和挑战. |
| 关键词: 软件工程 软件测试 众包 众包测试 众包平台 |
| DOI:10.13328/j.cnki.jos.005377 |
| 分类号: |
| 基金项目:国家自然科学基金(61772263,61772014,61572375);软件新技术与产业化协同创新中心资助 |
|
| Research Progress of Crowdsourced Software Testing |
|
ZHANG Xiao-Fang1,2, FENG Yang2, LIU Di1, CHEN Zhen-Yu2, XU Bao-Wen2
|
|
1.School of Computer Science and Technology, Soochow University, Suzhou 215006, China;2.State Key Laboratory for Novel Software Technology(Nanjing University), Nanjing 210023, China
|
| Abstract: |
| Crowdsourced software testing is an emerging testing method which has drawn extensive attention in both industrial and academic community. This paper systematically summarizes the academic literatures and industry practice in recent years. This article first summarizes the related literatures from the perspectives of the research topics including software testing, crowdsourcing test process, experimental subjects and scale of crowdsourcing. It also compares total of 20 widely used crowdsourced software testing commercial platforms, and discusses their task domains, subjects, open call forms and performance evaluation forms. Finally, the paper presents the future trends, issues and opportunities for crowdsourced software testing. |
| Key words: software engineering software testing crowdsourcing crowdsourced testing crowdsourced platform |