| 本文已被:浏览 2663次 下载 5604次 |
 码上扫一扫! |
|
|
| 基于多粒度注意力网络的知识超图链接预测 |
|
庞俊1,2, 刘小琪1,2, 谷峪3, 王鑫4, 赵宇海3, 张晓龙1,2, 于戈3
|
|
1.武汉科技大学 计算机科学与技术学院, 湖北 武汉 430065;2.智能信息处理与实时工业系统湖北省重点实验室(武汉科技大学), 湖北 武汉 430065;3.东北大学 计算机科学与工程学院, 辽宁 沈阳 110169;4.天津大学 智能与计算学部, 天津 300354
|
|
| 摘要: |
| 在知识图谱中进行链接预测是图谱补全的有效方法,可以有效地改善知识图谱的数据质量.然而,现实生活中的关系往往是多元的,这些包含多元关系的知识图谱可称为知识超图(knowledge hypergraph,KHG).然而,现有的知识超图链接预测模型忽略了多元关系的平等性(多元关系中实体不存在先后关系)与整体性(多元关系缺少一个实体则不成立).针对以上问题,首先提出了一种知识超图多元关系表示模型,可以直接建模知识超图中的多元关系;然后研究了一种基于多粒度神经网络的链接预测方法(hyperedge prediction based on multi-granular attention network,HPMG).该模型将关系划分为多重粒度进行学习,从不同粒度联合完成知识超图的学习和预测,充分考虑了知识超图中不同维度多元关系的整体性.接下来,针对HPMG特征融合不充分的问题,提出了基于多粒度注意力网络的知识超图链接预测方法HPMG+,结合全局和局部注意力,实现了不同特征的有区分融合,进一步提高了模型的性能.最后,真实数据集上的大量实验结果验证了所提方法的效果显著地优于所有基线方法. |
| 关键词: 知识超图 链接预测 多粒度 嵌入学习 注意力机制 |
| DOI:10.13328/j.cnki.jos.006788 |
| 分类号: |
| 基金项目:国家重点研发计划(2020AAA0108503);国家自然科学基金(62072083,61972299) |
|
| Knowledge Hypergraph Link Prediction Based on Multi-granular Attention Network |
|
PANG Jun1,2, LIU Xiao-Qi1,2, GU Yu3, WANG Xin4, ZHAO Yu-Hai3, ZHANG Xiao-Long1,2, YU Ge3
|
|
1.School of Computer Science and Technology, Wuhan University of Science and Technology, Wuhan 430065, China;2.Hubei Province Key Laboratory of Intelligent Information Processing and Real-time Industrial System (Wuhan University of Science and Technology), Wuhan 430065, China;3.School of Computer Science and Engineering, Northeastern University, Shenyang 110169, China;4.College of Intelligence and Computing, Tianjin University, Tianjin 300354, China
|
| Abstract: |
| Link prediction in knowledge graphs is the most effective method for graph complementation, which can effectively improve the data quality of knowledge graphs. However, the relationships in real life are often multiple, thus these knowledge graphs containing multiple relationships can be called knowledge hypergraphs (KHGs). Unfortunately, the existing knowledge graph link prediction methods cannot be directly applied to knowledge hypergraphs, and the existing knowledge hypergraph link prediction models ignore the equality (there is no sequential relationship among the elements in a multivariate relationship) and completeness (a multivariate relationship is not valid if it lacks elements) of the real-life multivariate relationships. To address these problems, a knowledge hypergraph multivariate representation model is firstly proposed, which can directly model the multivariate relationships in the knowledge hypergraph. Then, a multi-granularity neural network-based hypergraph prediction method (HPMG) is studied, which divides the relations into multiple granularities for learning and prediction from different granularities jointly. Next, to address the problem of inadequate HPMG feature fusion, HPMG+ is proposed based on multi-granularity attention network for link prediction of knowledge hypergraphs, which combines all and local attention to achieve differentiated fusion of different features and further improves the performance of the model. Finally, extensive experimental results on real datasets verify that the proposed methods significantly outperform all baseline methods in terms of hyper-edge prediction. |
| Key words: knowledge hypergraph link prediction multi-granularity embedding learning attention mechanism |