| 本文已被：浏览 3315次 下载 7829次 |
码上扫一扫！ |
|
|
| 基于PSP_HDP主题模型的非结构化经济指标挖掘 |
|
张奕韬1,2,3, 万常选1,3, 刘喜平1,3, 江腾蛟1,3, 刘德喜1,3, 廖国琼1,3
|
|
1.江西财经大学 信息管理学院, 江西 南昌 330013;2.华东交通大学 软件学院, 江西 南昌 330013;3.数据与知识工程江西省高校重点实验室(江西财经大学), 江西 南昌 330013
|
|
| 摘要: |
| 随着经济活动数据的不断丰富，互联网平台上产生了大量的财经文本，其中蕴含了经济领域发展状况的影响因素.如何从这些财经文本中有效地挖掘与经济有关的经济要素，是实现非结构化数据在经济研究中应用的关键.根据人工构建非结构化经济指标的局限性，以及主题模型在非结构化经济指标挖掘中存在的问题，结合已有经济领域分类标准、词语之间的语义关系和词语对主题的代表性，定义了文档的领域隶属度、词语与主题的语义相关度和词语对主题的贡献度，用于分别描述CRF（Chinese restaurant franchise）中餐厅的菜肴风格、顾客之间对菜肴要求的一致程度和顾客对菜肴的专一程度；结合文档领域属性、词语语义和词语在主题中的出现情况，提出了PSP_HDP（combining documents' domain properties，word semantics and words' presences in topics with HDP）主题模型.由于PSP_HDP主题模型改进了文档-主题与主题-词语的分配过程，从而提高了经济主题的区分度和辨识度，可以更有效地挖掘与经济有关的经济主题和经济要素词.实验结果表明：提出的PSP_HDP主题模型不仅在主题多样性、内容困惑度和模型复杂度等评价指标方面的整体性能优于HDP主题模型，而且在非结构化经济指标挖掘和经济要素词抽取方面能够得到区分度更好、辨识度更高的结果. |
| 关键词: HDP主题模型 经济领域分类标准 语义关系 非结构化经济指标 经济要素词 |
| DOI：10.13328/j.cnki.jos.005898 |
| 分类号: |
| 基金项目:国家自然科学基金（61972184，61562032，61662027，61762042）；江西省自然科学基金（20152ACB20003） |
|
| Mining Unstructured Economic Indicators Based on PSP_HDP Topic Model |
|
ZHANG Yi-Tao1,2,3, WAN Chang-Xuan1,3, LIU Xi-Ping1,3, JIANG Teng-Jiao1,3, LIU De-Xi1,3, LIAO Guo-Qiong1,3
|
|
1.School of Information Management, Jiangxi University of Finance and Economics, Nanchang 330013, China;2.School of Software, East China Jiaotong University, Nanchang 330013, China;3.Jiangxi Key Laboratory of Data and Knowledge Engineering(Jiangxi University of Finance and Economics), Nanchang 330013, China
|
| Abstract: |
| With the increasing enrichment of economic activity data, a large number of financial texts have emerged on Internet, which contains the influence factors of the economic development. How to mine these economic factors from these texts is the key to conduct economic analysis based on unstructured data. Due to the limitation of manual selection of economic indicators, and the inaccuracy of modelling economic indicators in unstructured texts, the CRF (Chinese restaurant franchise) allocation processes in HDP topic model are extended to a more efficient pattern. In order to describe the dish style in a restaurant, the existing economic taxonomies are used to determine the domain membership of a document. The semantic similarity between words is exploited to define the semantic relevance between words and topics, which reflect the similarity of customers' requirements for dishes. For each word, its representativeness of each topic is employed to evaluate its contribution to the topic, which explains the loyalty of a customer to each dish. By combining documents' domain properties, word semantics and words' presence in topics with HDP topic model, a novel model, PSP_HDP topic model, is proposed. As the PSP_HDP topic model improves documents-topics and topics-words allocation processes, it increases the accuracy of identifying economic topics and distinctiveness of the topics, which leads to a more effective mining of economic topics and economic factors. Experimental results show that the proposed model not only achieves a better performance in terms of topic diversity, topic perplexity and topic complexity, but also is effective in finding more cohesive unstructured economic indicators and economic factors. |
| Key words: HDP topic model economic taxonomy semantic relevance unstructured economic indicator economic factor |
