Learning to crawl deep web

作者: Qinghua Zheng , Zhaohui Wu , Xiaocheng Cheng , Lu Jiang , Jun Liu

DOI: 10.1016/J.IS.2013.02.001

关键词: Semantic Web StackCrawlingWeb query classificationSearch engineFocused crawlerInformation retrievalSocial Semantic WebSite mapWeb modelingWeb crawlerDistributed web crawlingWeb navigationWeb search queryWorld Wide WebData WebWeb serviceComputer science

摘要: … This section proposes a formal framework for the deep web crawling based on the reinforcement learning (RL) and formalizes the crawling problem under the framework. To be readily …

参考文章(43)
Christopher J. C. H. Watkins, Peter Dayan, Technical Note : \cal Q -Learning Machine Learning. ,vol. 8, pp. 279- 292 ,(1992) , 10.1007/BF00992698
Kevin Chen Chuan Chang, Zhen Zhang, Bin He, Toward large scale integration: Building a MetaQuerier over databases on the Web conference on innovative data systems research. pp. 44- 55 ,(2005)
Shirley Cohen, Shawn R. Jeffery, David Ko, Alon Halevy, Xin (Luna) Dong, Jayant Madhavan, Cong Yu, Web-scale Data Integration: You can only afford to Pay As You Go conference on innovative data systems research. pp. 342- 350 ,(2007)
Zhaohui Wu, Lu Jiang, Qinghua Zheng, Jun Liu, None, Learning to surface deep web content national conference on artificial intelligence. pp. 1967- 1968 ,(2010)
Yan Wang, Jianguo Lu, Jie Liang, Jessica Chen, Jiming Liu, Selecting queries from sample to crawl deep web data sources Web Intelligence and Agent Systems: An International Journal. ,vol. 10, pp. 75- 88 ,(2012) , 10.3233/WIA-2012-0232
Damien Ernst, Arthur Louette, Introduction to Reinforcement Learning MIT Press. ,(1998)
Otis Gospodnetić, Erik Hatcher, Doug Cutting, Lucene in Action ,(2004)
Hai He, Weiyi Meng, Clement Yu, Zonghuan Wu, Wise-integrator: an automatic integrator of web search interfaces for E-commerce very large data bases. pp. 357- 368 ,(2003) , 10.1016/B978-012722442-8/50039-2