###
Journal of Software:2013.24(1):109-120

基于分辨粒度的gROC曲线分析方法
董元方,李雄飞,李军,赵海英
(符号计算与知识工程教育部重点实验室(吉林大学),吉林 长春 130012;长春理工大学 经济管理学院,吉林 长春 130022;符号计算与知识工程教育部重点实验室(吉林大学),吉林 长春 130012;长春理工大学 应用数学系,吉林 长春 130022;北京邮电大学 世纪学院,北京 100083)
gROC Curve Analysis Method Based on Discernible Granularity
DONG Yuan-Fang,LI Xiong-Fei,LI Jun,ZHAO Hai-Ying
(Key Laboratory of Symbolic Computation and Knowledge Engineering for Ministry of Education (Jilin University), Changchun 130012, China;School of Economics and Management, Changchun University of Science and Technology, Changchun 130022, China;Key Laboratory of Symbolic Computation and Knowledge Engineering for Ministry of Education (Jilin University), Changchun 130012, China;Department of Applied Mathematics, Changchun University of Science and Technology, Changchun 130022, China;Century College, Beijing University of Posts and Telecommunications, Beijing 100083, China)
Abstract
Chart / table
Reference
Similar Articles
Article :Browse 3534   Download 4008
Received:May 19, 2011    Revised:March 19, 2012
> 中文摘要: ROC曲线是模型选择的一种重要方法,但ROC曲线的不确定性影响了模型选择的准确性.基于分辨粒度,从反映得分的不确定性的角度提出gROC和gAUC的概念,从理论上讨论了gROC的若干性质.在给出其算法之后,利用双正态模型检验了gROC的合理性.在此基础上,提出了两个模型选择度量——λAUC和ρAUC,并在UCI数据集上验证了该模型选择度量的高效性.实验结果表明,gROC能够有效反映ROC曲线的不确定性,基于λAUC和ρAUC的模型选择方法优于基于AUC或sAUC的模型选择方法,在某些情况下,gROC具有更强的对分类器性能的比较能力.
中文关键词: 机器学习  模型选择  分类  ROC曲线  粒度
Abstract:ROC Curve is an important method of model selection, but its uncertainty affects the accuracy of model selection. Based on discernible granularity and the view of reflecting the score's uncertainty, the study proposes the concept of gROC and gAUC, and discusses, theoretically, some properties of the gROC. The study also tests the reasonableness of gROC using binormal model after gave its algorithm. On this basis, the paper also proposes two model selection measures, λAUC and ρAUC. The effieciency of these measures is verified based on UCI data sets. Experimental results show that the gROC can effectively reflect the uncertainty of ROC curve, and the model selection methods based on λAUC and ρAUC are better than the method based on AUC or sAUC. In some cases, gROC has stronger capability on comparison of classifiers performance.
文章编号:     中图分类号:    文献标志码:
基金项目:国家自然科学基金(60863010, 61163044); 国家重点基础研究发展计划(973)(2010CB334709); 吉林省科技发展计划(20090704) 国家自然科学基金(60863010, 61163044); 国家重点基础研究发展计划(973)(2010CB334709); 吉林省科技发展计划(20090704)
Foundation items:
Reference text:

董元方,李雄飞,李军,赵海英.基于分辨粒度的gROC曲线分析方法.软件学报,2013,24(1):109-120

DONG Yuan-Fang,LI Xiong-Fei,LI Jun,ZHAO Hai-Ying.gROC Curve Analysis Method Based on Discernible Granularity.Journal of Software,2013,24(1):109-120