###
Journal of Software:2020.31(3):710-725

面向多维稀疏数据仓库的欺诈销售行为挖掘
郑皎凌,乔少杰,舒红平,应广华,LouisAlbertoGUTIERREZ
(软件自动生成与智能服务四川省重点实验室(成都信息工程大学), 四川 成都 610225;成都信息工程大学 软件工程学院, 四川 成都 610225;阿里巴巴技术有限公司, 浙江 杭州 311121;Department of Computer Science, Rensselaer Polytechnic Institute, New York, USA)
Sale Fraud Behavior Detection over Multidimensional Sparse Data Warehouse
ZHENG Jiao-Ling,QIAO Shao-Jie,SHU Hong-Ping,YING Guang-Hua,Louis Alberto GUTIERREZ
(Sichuan Key Laboratory of Software Automatic Generation and Intelligent Service(Chengdu University of Information Technology), Chengdu 610225, China;School of Software Engineering, Chengdu University of Information Technology, Chengdu 610225, China;Alibaba(China) Technology Co. Ltd., Hangzhou 311121, China;Department of Computer Science, Rensselaer Polytechnic Institute, New York, USA)
Abstract
Chart / table
Reference
Similar Articles
Article :Browse 787   Download 797
Received:July 20, 2019    Revised:September 10, 2019
> 中文摘要: 分销渠道系统中,产品制造商会分配给销售额较大的分销商更多返点利润鼓励销售,而分销商之间可能会联合起来将多个分销商的销售业绩累计在其中一个分销商上,获取高额利润,这种商业欺诈行为被称为挂单或窜货.由于数据中大量正常极值点的存在,使得传统异常探测算法很难区分正常极值和由挂单导致的异常极值;另外,多维销售数据本身就存在的稀疏性导致多维数据异常探测算法无法有效运行.为了克服上述问题,将人工智能和数据库技术结合起来,提出了基于分割率的特征提取方法和基于张量重构的挂单行为挖掘算法.同时,由于分销商之间存在多种挂单行为,设计了基于挂单模式偏序格的特征提取方法来对销售数据集中存在的挂单行为进行分类.在合成数据的实验中,所提出的挂单点挖掘算法能达到65%的平均AUC值,而传统特征提取方法仅达到36%和30%的平均AUC值.在真实数据上的实验结果表明,挂单行为探测方法能区分正常销售极值和挂单行为产生的异常极值.
Abstract:In distribution channel system, product manufacturer will often reward retail trader who makes big deal to increase the sales. On the other hand, in order to obtain high reward, retail traders may form alliance, where a cheating retail trader accumulates the deals of other retail traders. This type of commercial fraud is called deal cheating or cross region sale. Because the sales contain a lot of normal big deals, traditional outlier detection methods cannot distinguish the normal extreme value and the true outlier generated by deal cheating behavior. Meanwhile, the sparsity of the multidimensional sales data makes the outlier detection methods based on multidimensional space cannot work effectively. To handle the aforementioned problems, this study proposes deal cheating mining algorithms based on ratio characteristic and tensor reconstruction method. These algorithms combine artificial intelligence and database technique. Meanwhile, because there are multiple types of deal cheating patterns, this study proposes deal cheating pattern classification methods based on the partially ordered lattice of deal cheating patterns. In the experiments on synthetic data, the deal cheating detection algorithm based on the ratio characteristic can achieve an average AUC-value of 65%. The traditional feature extraction methods can only achieve average AUC-values of 36% and 30%. In the experiments on the real data, the results shows the deal cheating detection algorithm is capable of distinguishing normal big deal from abnormal big deal which may be generated by the deal cheating behaviors.
文章编号:     中图分类号:    文献标志码:
基金项目:国家自然科学基金(61772091,61802035,61962006);四川省科技计划(20YYJC2785,2018JY0448,2019YFG0106,2019YFS0067);四川高校科研创新团队建设计划(18TD0027);广西自然科学基金(2018GXNSFDA138005);成都信息工程大学科研基金(KYTZ201715,KYTZ201750);成都信息工程大学中青年学术带头人科研基金(J201701);广东省普及型高性能计算机重点实验室项目(2017B030314073) 国家自然科学基金(61772091,61802035,61962006);四川省科技计划(20YYJC2785,2018JY0448,2019YFG0106,2019YFS0067);四川高校科研创新团队建设计划(18TD0027);广西自然科学基金(2018GXNSFDA138005);成都信息工程大学科研基金(KYTZ201715,KYTZ201750);成都信息工程大学中青年学术带头人科研基金(J201701);广东省普及型高性能计算机重点实验室项目(2017B030314073)
Foundation items:National Natural Science Foundation of China (61772091, 61802035, 61962006); Sichuan Science and Technology Program (20YYJC2785, 2018JY0448, 2019YFG0106, 2019YFS0067); Innovative Research Team Construction Plan in Universities of Sichuan Province (18TD0027); National Natural Science Foundation of Guangxi of China (2018GXNSFDA138005); Scientific Research Foundation for Advanced Talents of Chengdu University of Information Technology (KYTZ201715, KYTZ201750); Scientific Research Foundation for Young Academic Leaders of Chengdu University of Information Technology (J201701); Guangdong Province Key Laboratory of Popular High Performance Computers (2017B030314073)
Reference text:

郑皎凌,乔少杰,舒红平,应广华,Louis Alberto GUTIERREZ.面向多维稀疏数据仓库的欺诈销售行为挖掘.软件学报,2020,31(3):710-725

ZHENG Jiao-Ling,QIAO Shao-Jie,SHU Hong-Ping,YING Guang-Hua,Louis Alberto GUTIERREZ.Sale Fraud Behavior Detection over Multidimensional Sparse Data Warehouse.Journal of Software,2020,31(3):710-725