Journal of Software:2018.29(1):69-88

(苏州大学 计算机科学与技术学院, 江苏 苏州 215006;计算机软件新技术国家重点实验室(南京大学), 江苏 南京 210023)
Research Progress of Crowdsourced Software Testing
ZHANG Xiao-Fang,FENG Yang,LIU Di,CHEN Zhen-Yu,XU Bao-Wen
(School of Computer Science and Technology, Soochow University, Suzhou 215006, China;State Key Laboratory for Novel Software Technology(Nanjing University), Nanjing 210023, China)
Chart / table
Similar Articles
Article :Browse 6944   Download 8025
Received:June 23, 2017    Revised:August 01, 2017
> 中文摘要: 众包测试是一种新兴的软件测试方式,得到了学术界和工业界的广泛关注.系统地总结了近年来众包软件测试研究的学术文献以及工业界实践进展:首先,从学术文献涉及的研究主题演变、涵盖的软件测试问题和众包测试流程、采用的实验对象及测试人员规模等多个角度对相关文献中提出的技术和方法进行了汇总;然后,从测试领域、测试对象、工人召集方式、绩效考核方式等方面分析对比了当前应用最广泛的20个众包测试商业平台;最后,探讨了众包软件测试的未来发展趋势、机遇和挑战.
Abstract:Crowdsourced software testing is an emerging testing method which has drawn extensive attention in both industrial and academic community. This paper systematically summarizes the academic literatures and industry practice in recent years. This article first summarizes the related literatures from the perspectives of the research topics including software testing, crowdsourcing test process, experimental subjects and scale of crowdsourcing. It also compares total of 20 widely used crowdsourced software testing commercial platforms, and discusses their task domains, subjects, open call forms and performance evaluation forms. Finally, the paper presents the future trends, issues and opportunities for crowdsourced software testing.
文章编号:     中图分类号:    文献标志码:
基金项目:国家自然科学基金(61772263,61772014,61572375);软件新技术与产业化协同创新中心资助 国家自然科学基金(61772263,61772014,61572375);软件新技术与产业化协同创新中心资助
Foundation items:National Natural Science Foundation of China (61772263, 61772014, 61572375); Collaborative Innovation Center of Novel Software Technology and Industrialization
Reference text:


ZHANG Xiao-Fang,FENG Yang,LIU Di,CHEN Zhen-Yu,XU Bao-Wen.Research Progress of Crowdsourced Software Testing.Journal of Software,2018,29(1):69-88