| 引用本文: | 闫兴龙,刘奕群,方奇,张敏,马少平,茹立云.基于网络资源与用户行为信息的领域术语提取.软件学报,2013,24(9):2089-2100 |
| |
|
| |
|
|
| 本文已被：浏览 4718次 下载 7201次 |
码上扫一扫！ |
|
|
| 基于网络资源与用户行为信息的领域术语提取 |
|
闫兴龙1,2,3,4, 刘奕群1,2,3, 方奇1,2,3, 张敏1,2,3, 马少平1,2,3, 茹立云1,2,3
|
|
1.智能技术与系统国家重点实验室(清华大学), 北京 100084;2.清华大学 信息科学与技术国家实验室, 北京 100084;3.清华大学 计算机科学与技术系, 北京 100084;4.总参陆航研究所, 北京 101121
|
|
| 摘要: |
| 领域术语是反映领域特征的词语.领域术语自动抽取是自然语言处理中的一项重要任务,可以应用在领域本体抽取、专业搜索、文本分类、类语言建模等诸多研究领域,利用互联网上大规模的特定领域语料来构建领域词典成为一项既有挑战性又有实际价值的工作.当前,领域术语提取工作所利用的网络语料主要是网页对应的正文,但是由于网页正文信息抽取所面临的难题会影响领域术语抽取的效果,那么利用网页的锚文本和查询文本替代网页正文进行领域术语抽取,则可以避免网页正文信息抽取所面临的难题.针对锚文本和查询文本所存在的文本长度过短、语义信息不足等缺点,提出一种适用于各种类型网络数据及网络用户行为数据的领域数据提取方法,并使用该方法基于提取到的网页正文数据、网页锚文本数据、用户查询信息数据、用户浏览信息数据等开展了领域术语提取工作,重点考察不同类型网络资源和用户行为信息对领域术语提取工作的效果差异.在海量规模真实网络数据上的实验结果表明,基于用户查询信息和用户浏览过的锚文本信息比基于网页正文提取技术得到的正文取得了更好的领域术语提取效果. |
| 关键词: 领域术语自动抽取 新词发现 Web 数据挖掘 用户行为分析 |
| DOI：10.3724/SP.J.1001.2013.04358 |
| 分类号: |
| 基金项目:国家自然科学基金(60736044, 60903107, 61073071);高等学校博士学科点专项科研基金(20090002120005) |
|
| Domain-Specific Terms Extraction Based on Web Resource and User Behavior |
|
YAN Xing-Long1,2,3,4, LIU Yi-Qun1,2,3, FANG Qi1,2,3, ZHANG Min1,2,3, MA Shao-Ping1,2,3, RU Li-Yun1,2,3
|
|
1.State Key Laboratory of Intelligent Technology and Systems (Tsinghua University), Beijing 100084, China;2.National Laboratory for Information Science and Technology, Tsinghua University, Beijing 100084, China;3.Department of Computer Science and Technology, Tsinghua University, Beijing 100084, China;4.Army Aviation Institute of General Staff, Beijing, Beijing 101121, China
|
| Abstract: |
| The automatic domain-specific term extraction is an important task in natural language processing, which can be adoptedin domain-specific ontology construction, vertical search, text classification, class-based language model etc. A Web page contains lots of noises and irrelevantcontents, therefore, extracting domain-specific terms from original pages becomes a challenging task. Different from previous works, which rely on the original text of Web pages, this study focuses on anchor text and query log history of pages. This strategy would avoid the trouble of information extraction from the original Web pageand therefore improves the term extraction performance. In this paper, a novel term extraction algorithmis based onanalysis into Web resource and user behaviors. Different Web resources including body of the page data, anchor text of the page and the information of user query data were employed to extract the domain-specific terms and their performances were compared.The result based on scale of the network datademonstratesthe resources of anchor text and the way user query data can obtain a better effect. |
| Key words: automatic domain-specific term extraction novel term extraction Web data mining user behavior analysis |
|
|
|
|
