Article :Browse 6944 Download 8025
Received:June 23, 2017 Revised:August 01, 2017
Received:June 23, 2017 Revised:August 01, 2017
Abstract:Crowdsourced software testing is an emerging testing method which has drawn extensive attention in both industrial and academic community. This paper systematically summarizes the academic literatures and industry practice in recent years. This article first summarizes the related literatures from the perspectives of the research topics including software testing, crowdsourcing test process, experimental subjects and scale of crowdsourcing. It also compares total of 20 widely used crowdsourced software testing commercial platforms, and discusses their task domains, subjects, open call forms and performance evaluation forms. Finally, the paper presents the future trends, issues and opportunities for crowdsourced software testing.
keywords: software engineering software testing crowdsourcing crowdsourced testing crowdsourced platform
Foundation items:National Natural Science Foundation of China (61772263, 61772014, 61572375); Collaborative Innovation Center of Novel Software Technology and Industrialization
Reference text:
ZHANG Xiao-Fang,FENG Yang,LIU Di,CHEN Zhen-Yu,XU Bao-Wen.Research Progress of Crowdsourced Software Testing.Journal of Software,2018,29(1):69-88
ZHANG Xiao-Fang,FENG Yang,LIU Di,CHEN Zhen-Yu,XU Bao-Wen.Research Progress of Crowdsourced Software Testing.Journal of Software,2018,29(1):69-88