###
Journal of Software:2011.22(9):2075-2088

基于语义的主题爬行策略
叶育鑫,欧阳丹彤
(吉林大学 计算机科学与技术学院,吉林 长春 130012;吉林大学 符号计算与知识工程教育部重点实验室,吉林 长春 130012)
Semantic-Based Focused Crawling Approach
YE Yu-Xin,OUYANG Dan-Tong
(School of Computer Science and Technology, Jilin University, Changchun 130012, China;Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, Jilin University, Changchun 130012, China)
Abstract
Chart / table
Reference
Similar Articles
Article :Browse 3714   Download 3927
Received:May 13, 2009    Revised:August 26, 2009
> 中文摘要: 为使主题爬行能够充分利用资源的语义信息,提出基于语义的主题爬行策略.该策略利用领域本体刻画爬行主题,将本体语义映射到关键词表.通过定义断言集一致性扩展和域值关联推理任务,推演关键词间语义关系.在定义网页主题概念的基础上,结合本体推理方案提出主题概念的语义叠加效应模型.最后,利用主题概念的语义包含关系判定URLs 抓取顺序.实验结果表明,该语义主题爬行策略在抓取收获率和爬行效率上优于现有同类方法,该方案有效、可行.
中文关键词: 本体  语义Web  主题爬行  Tableau 演算
Abstract:An approach of semantic-based focused crawling is proposed in order to use semantic resource efficiently. In this paper, a domain-ontology is used to describe the topic of Web crawling. Lexicon of the keywords list are mapped to ontology, and semantic of words are obtained through mapping. Inference services about assertion set expanding and domain-range relation are defined. The semantic relation among keywords can be inferred by inference services. At the same time, the definition of concept about Web page is given. A semantic computational model is proposed by combining inference services mentioned above. In the end, the order of URLs corresponding to their Web page is decided according to the subsumption of topic concepts. The result show that this approach is advanced in harvest-rate and crawling efficiency and is better than some classical algorithms.
文章编号:     中图分类号:    文献标志码:
基金项目:国家自然科学基金重大项目(60496320, 60496321); 国家自然科学基金(60873148, 60973089); 吉林省科技发展计划(20080107); 欧盟合作项目(155776-EM-1-2009-1-IT-ERAMUNDUS-ECW-L12); 符号计算与知识工程教育部重点实验室开放基金(450060326019) 国家自然科学基金重大项目(60496320, 60496321); 国家自然科学基金(60873148, 60973089); 吉林省科技发展计划(20080107); 欧盟合作项目(155776-EM-1-2009-1-IT-ERAMUNDUS-ECW-L12); 符号计算与知识工程教育部重点实验室开放基金(450060326019)
Foundation items:
Reference text:

叶育鑫,欧阳丹彤.基于语义的主题爬行策略.软件学报,2011,22(9):2075-2088

YE Yu-Xin,OUYANG Dan-Tong.Semantic-Based Focused Crawling Approach.Journal of Software,2011,22(9):2075-2088