###
Journal of Software:2020.31(3):845-865

基于PSP_HDP主题模型的非结构化经济指标挖掘
张奕韬,万常选,刘喜平,江腾蛟,刘德喜,廖国琼
(江西财经大学 信息管理学院, 江西 南昌 330013;华东交通大学 软件学院, 江西 南昌 330013;数据与知识工程江西省高校重点实验室(江西财经大学), 江西 南昌 330013;江西财经大学 信息管理学院, 江西 南昌 330013;数据与知识工程江西省高校重点实验室(江西财经大学), 江西 南昌 330013)
Mining Unstructured Economic Indicators Based on PSP_HDP Topic Model
ZHANG Yi-Tao,WAN Chang-Xuan,LIU Xi-Ping,JIANG Teng-Jiao,LIU De-Xi,LIAO Guo-Qiong
(School of Information Management, Jiangxi University of Finance and Economics, Nanchang 330013, China;School of Software, East China Jiaotong University, Nanchang 330013, China;Jiangxi Key Laboratory of Data and Knowledge Engineering(Jiangxi University of Finance and Economics), Nanchang 330013, China;School of Information Management, Jiangxi University of Finance and Economics, Nanchang 330013, China;Jiangxi Key Laboratory of Data and Knowledge Engineering(Jiangxi University of Finance and Economics), Nanchang 330013, China)
Abstract
Chart / table
Reference
Similar Articles
Article :Browse 779   Download 775
Received:July 05, 2019    Revised:September 10, 2019
> 中文摘要: 随着经济活动数据的不断丰富,互联网平台上产生了大量的财经文本,其中蕴含了经济领域发展状况的影响因素.如何从这些财经文本中有效地挖掘与经济有关的经济要素,是实现非结构化数据在经济研究中应用的关键.根据人工构建非结构化经济指标的局限性,以及主题模型在非结构化经济指标挖掘中存在的问题,结合已有经济领域分类标准、词语之间的语义关系和词语对主题的代表性,定义了文档的领域隶属度、词语与主题的语义相关度和词语对主题的贡献度,用于分别描述CRF(Chinese restaurant franchise)中餐厅的菜肴风格、顾客之间对菜肴要求的一致程度和顾客对菜肴的专一程度;结合文档领域属性、词语语义和词语在主题中的出现情况,提出了PSP_HDP(combining documents' domain properties,word semantics and words' presences in topics with HDP)主题模型.由于PSP_HDP主题模型改进了文档-主题与主题-词语的分配过程,从而提高了经济主题的区分度和辨识度,可以更有效地挖掘与经济有关的经济主题和经济要素词.实验结果表明:提出的PSP_HDP主题模型不仅在主题多样性、内容困惑度和模型复杂度等评价指标方面的整体性能优于HDP主题模型,而且在非结构化经济指标挖掘和经济要素词抽取方面能够得到区分度更好、辨识度更高的结果.
Abstract:With the increasing enrichment of economic activity data, a large number of financial texts have emerged on Internet, which contains the influence factors of the economic development. How to mine these economic factors from these texts is the key to conduct economic analysis based on unstructured data. Due to the limitation of manual selection of economic indicators, and the inaccuracy of modelling economic indicators in unstructured texts, the CRF (Chinese restaurant franchise) allocation processes in HDP topic model are extended to a more efficient pattern. In order to describe the dish style in a restaurant, the existing economic taxonomies are used to determine the domain membership of a document. The semantic similarity between words is exploited to define the semantic relevance between words and topics, which reflect the similarity of customers' requirements for dishes. For each word, its representativeness of each topic is employed to evaluate its contribution to the topic, which explains the loyalty of a customer to each dish. By combining documents' domain properties, word semantics and words' presence in topics with HDP topic model, a novel model, PSP_HDP topic model, is proposed. As the PSP_HDP topic model improves documents-topics and topics-words allocation processes, it increases the accuracy of identifying economic topics and distinctiveness of the topics, which leads to a more effective mining of economic topics and economic factors. Experimental results show that the proposed model not only achieves a better performance in terms of topic diversity, topic perplexity and topic complexity, but also is effective in finding more cohesive unstructured economic indicators and economic factors.
文章编号:     中图分类号:    文献标志码:
基金项目:国家自然科学基金(61972184,61562032,61662027,61762042);江西省自然科学基金(20152ACB20003) 国家自然科学基金(61972184,61562032,61662027,61762042);江西省自然科学基金(20152ACB20003)
Foundation items:National Natural Science Foundation of China (61972184, 61562032, 61662027, 61762042); Natural Science Foundation of Jiangxi Province of China (20152ACB20003)
Author NameAffiliationE-mail
ZHANG Yi-Tao School of Information Management, Jiangxi University of Finance and Economics, Nanchang 330013, China
School of Software, East China Jiaotong University, Nanchang 330013, China
Jiangxi Key Laboratory of Data and Knowledge Engineering(Jiangxi University of Finance and Economics), Nanchang 330013, China 
 
WAN Chang-Xuan School of Information Management, Jiangxi University of Finance and Economics, Nanchang 330013, China
Jiangxi Key Laboratory of Data and Knowledge Engineering(Jiangxi University of Finance and Economics), Nanchang 330013, China 
wanchangxuan@263.net 
LIU Xi-Ping School of Information Management, Jiangxi University of Finance and Economics, Nanchang 330013, China
Jiangxi Key Laboratory of Data and Knowledge Engineering(Jiangxi University of Finance and Economics), Nanchang 330013, China 
 
JIANG Teng-Jiao School of Information Management, Jiangxi University of Finance and Economics, Nanchang 330013, China
Jiangxi Key Laboratory of Data and Knowledge Engineering(Jiangxi University of Finance and Economics), Nanchang 330013, China 
 
LIU De-Xi School of Information Management, Jiangxi University of Finance and Economics, Nanchang 330013, China
Jiangxi Key Laboratory of Data and Knowledge Engineering(Jiangxi University of Finance and Economics), Nanchang 330013, China 
 
LIAO Guo-Qiong School of Information Management, Jiangxi University of Finance and Economics, Nanchang 330013, China
Jiangxi Key Laboratory of Data and Knowledge Engineering(Jiangxi University of Finance and Economics), Nanchang 330013, China 
 
Reference text:

张奕韬,万常选,刘喜平,江腾蛟,刘德喜,廖国琼.基于PSP_HDP主题模型的非结构化经济指标挖掘.软件学报,2020,31(3):845-865

ZHANG Yi-Tao,WAN Chang-Xuan,LIU Xi-Ping,JIANG Teng-Jiao,LIU De-Xi,LIAO Guo-Qiong.Mining Unstructured Economic Indicators Based on PSP_HDP Topic Model.Journal of Software,2020,31(3):845-865