| 本文已被：浏览 5074次 下载 22033次 |
码上扫一扫！ |
|
|
| 基于神经网络的机器阅读理解综述 |
|
顾迎捷1,2, 桂小林1,2, 李德福1,2, 沈毅1,2, 廖东1,2
|
|
1.西安交通大学 电子与信息工程学部, 陕西 西安 710049;2.陕西省计算机网络重点实验室(西安交通大学), 陕西 西安 710049
|
|
| 摘要: |
| 机器阅读理解的目标是使机器理解自然语言文本，并能够正确回答与文本相关的问题.由于数据集规模的制约，早期的机器阅读理解方法大多基于人工特征以及传统机器学习方法进行建模.近年来，随着知识库、众包群智的发展，研究者们陆续提出了高质量的大规模数据集，为神经网络模型以及机器阅读理解的发展带来了新的契机.对基于神经网络的机器阅读理解相关的最新研究成果进行了详尽的归纳：首先，概述了机器阅读理解的发展历程、问题描述以及评价指标；然后，针对当前最流行的神经阅读理解模型架构，包括嵌入层、编码层、交互层和输出层中所使用的相关技术进行了全面的综述，同时阐述了最新的BERT预训练模型及其优势；之后，归纳了近年来机器阅读理解数据集和神经阅读理解模型的研究进展，同时，详细比较分析了最具代表性的数据集以及神经网络模型；最后展望了机器阅读理解研究所面临的挑战和未来的研究方向. |
| 关键词: 机器阅读理解 自然语言处理 注意力机制 神经阅读理解模型 |
| DOI：10.13328/j.cnki.jos.006048 |
| 分类号: |
| 基金项目:国家重点研发计划（2018YFB1800304）；陕西省重点研发项目（2019GY-005，2017ZDXM-GY-011，2020GY-033） |
|
| Survey of Machine Reading Comprehension Based on Neural Network |
|
GU Ying-Jie1,2, GUI Xiao-Lin1,2, LI De-Fu1,2, SHEN Yi1,2, LIAO Dong1,2
|
|
1.Faculty of Electronics&Information Engineering, Xi'an Jiaotong University, Xi'an 710049, China;2.Shaanxi Province Key Laboratory of Computer Network(Xi'an Jiaotong University), Xi'an 710049, China
|
| Abstract: |
| The task of machine reading comprehension is to make the machine understand natural language text and correctly answer text-related questions. Due to the limitation of the dataset scale, most of the early machine reading comprehension methods were modeled based on manual features and traditional machine learning methods. In recent years, with the development of knowledge bases and crowdsourcing, high quality large-scale datasets have been proposed by researchers, which has brought a new opportunity for the advance of neural network models and machine reading comprehension. In this survey, an exhaustive review on the state-of-the-art research efforts on machine reading comprehension based on neural network is made. First, an overview of machine reading comprehension, including development process, problem formulation, and evaluation metric, is given. Then, a comprehensive review is conducted of related technologies in the most fashionable neural reading comprehension framework including the embedding layer, encoder layer, interaction layer, and output layer as well as the latest BERT pre-training model and its advantages are discussed. After that, this paper concludes the recent research progress of machine reading comprehension datasets and neural reading comprehension model, and gives a comparison and analysis of the most representative datasets and neural network models in detail. Finally, the research challenges and future direction of machine reading comprehension are presented. |
| Key words: machine reading comprehension natural language processing attention mechanism neural reading comprehension model |
