引用本文:朱敏,毛莺池,程永,陈程军,王龙宝.基于双重注意力机制的事件抽取方法.软件学报,2023,34(7):3226-3240
【打印本页】   【下载PDF全文】   查看/发表评论  【EndNote】   【RefMan】   【BibTex】
←前一篇|后一篇→ 过刊浏览    高级检索
本文已被:浏览 1843次   下载 4636 本文二维码信息
码上扫一扫!
分享到: 微信 更多
基于双重注意力机制的事件抽取方法
朱敏1, 毛莺池1,2, 程永1, 陈程军1, 王龙宝1,2
1.河海大学 计算机与信息学院, 江苏 南京 211100;2.水利部水利大数据重点实验室(河海大学), 江苏 南京 211100
摘要:
针对事件抽取存在未充分利用句法关系、论元角色缺失的情况,提出了基于双重注意力机制的事件抽取(event extraction based on dual attention mechanism,EEDAM)方法,有助于提高事件抽取的精确率和召回率.首先,基于4种嵌入向量进行句子编码,引入依赖关系,构建依赖关系图,使深度神经网络可以充分利用句法关系.然后,通过图转换注意网络生成新的依赖弧和聚合节点信息,捕获长程依赖关系和潜在交互,加权融合注意力网络,捕捉句中关键的语义信息,抽取句子级事件论元,提升模型预测能力.最后,利用关键句检测和相似性排序,进行文档级论元填充.实验结果表明,采用基于双重注意力机制的事件抽取方法,在ACE2005数据集上,较最佳基线联合多中文事件抽取器(joint multiple Chinese event extractor,JMCEE)在精确率、召回率和F1-score分别提高17.82%、4.61%、9.80%;在大坝安全运行日志数据集上,较最佳基线JMCEE在精确率、召回率和F1-score上分别提高18.08%、4.41%、9.93%.
关键词:  事件抽取  双重注意力  依赖关系  论元填充  神经网络
DOI:10.13328/j.cnki.jos.006520
分类号:TP18
基金项目:国家重点研发计划(2018YFC0407105);江苏省重点研发计划(BE2020729);江苏省研究生科研创新项目(B200203130);华能集团总部科技项目(HNKJ19-H12)
Event Extraction Method Based on Dual Attention Mechanism
ZHU Min1, MAO Ying-Chi1,2, CHENG Yong1, CHEN Cheng-Jun1, WANG Long-Bao1,2
1.College of Computer and Information, Hohai University, Nanjing 211100, China;2.Key Laboratory of Water Big Data Technology of Ministry of Water Resources (Hohai University), Nanjing 211100, China
Abstract:
In view of the fact that the syntactic relationship is not fully utilized and the argument role is missing in event extraction, an event extraction based on dual attention mechanism (EEDAM) method is proposed to improve the accuracy and recall rate of event extraction. Firstly, sentence coding is based on four embedded vectors and dependency relation is introduced to construct dependency relation graph, so that deep neural network can make full use of syntactic relation. Then, through graph transformation attention network, new dependency arcs and aggregate node information are generated to capture long-range dependencies and potential interactions, weighted attention network is integrated to capture key semantic information in sentences, and sentence level event arguments are extracted to improve the prediction ability of the model. Finally, the key sentence detection and similarity ranking are used to fill in the document level arguments. The experimental results show that the event extraction method based on dual attention mechanism can improve the accuracy rate, recall rate, and F1-score by 17.82%, 4.61%, and 9.80% respectively compared with the optimal baseline joint multiple Chinese event extractor (JMCEE) on ACE2005 data set. On the data set of dam safety operation records, the accuracy, recall rate, and F1 score are 18.08%, 4.41%, and 9.93% higher than the optimal baseline JMCEE, respectively.
Key words:  event extraction  double attention  dependency  argument filling  neural network

引用本文:
【打印本页】   【下载PDF全文】   查看/发表评论  【EndNote】   【RefMan】   【BibTex】
←前一篇|后一篇→ 过刊浏览    高级检索
本文已被:浏览次   下载  
分享到: 微信 更多
摘要:
关键词:  
DOI:
分类号:
基金项目:
Abstract:
Key words: