An Axiomatic Approach to Regularizing Neural Ranking Models.

作者: Nick Craswell , Chenyan Xiong , Bhaskar Mitra , Xia Song , Saurabh Tiwary

DOI:

关键词:

摘要: Axiomatic information retrieval (IR) seeks a set of principle properties desirable in IR models. These when formally expressed provide guidance the search for better relevance estimation functions. Neural ranking models typically contain large number parameters. The training these involve appropriate parameter values based on quantities labeled examples. Intuitively, axioms that can guide traditional should also help machine learning rankers. This work explores use to augment direct supervision from data neural We modify documents our dataset along lines well-known during and add regularization loss agreement between model which version document---the original or perturbed---should be preferred. Our experiments show achieves faster convergence generalization with axiomatic regularization.

参考文章(25)
Hao Wu, Hui Fang, Relation based term weighting regularization european conference on information retrieval. pp. 109- 120 ,(2012) , 10.1007/978-3-642-28997-2_10
Léon Bottou, Large-Scale Machine Learning with Stochastic Gradient Descent Proceedings of COMPSTAT'2010. pp. 177- 186 ,(2010) , 10.1007/978-3-7908-2604-3_16
P. D. Bruza, T. W. C. Huibers, Investigating aboutness axioms using information fields international acm sigir conference on research and development in information retrieval. pp. 112- 121 ,(1994) , 10.5555/188490.188521
Yuanhua Lv, ChengXiang Zhai, Lower-bounding term frequency normalization Proceedings of the 20th ACM international conference on Information and knowledge management - CIKM '11. pp. 7- 16 ,(2011) , 10.1145/2063576.2063584
Stephen Robertson, Understanding inverse document frequency: on theoretical arguments for IDF Journal of Documentation. ,vol. 60, pp. 503- 520 ,(2004) , 10.1108/00220410410560582
Hui Fang, Tao Tao, Chengxiang Zhai, Diagnostic Evaluation of Information Retrieval Models ACM Transactions on Information Systems. ,vol. 29, pp. 1- 42 ,(2011) , 10.1145/1961209.1961210
Mike Mintz, Steven Bills, Rion Snow, Dan Jurafsky, Distant supervision for relation extraction without labeled data international joint conference on natural language processing. pp. 1003- 1011 ,(2009) , 10.3115/1690219.1690287
ChengXiang Zhai, Hui Fang, Axiomatic Analysis and Optimization of Information Retrieval Models international conference on the theory of information retrieval. pp. 3- 3 ,(2013) , 10.1145/2499178.2499205
Hui Fang, Tao Tao, ChengXiang Zhai, A formal study of information retrieval heuristics Proceedings of the 27th annual international conference on Research and development in information retrieval - SIGIR '04. pp. 49- 56 ,(2004) , 10.1145/1008992.1009004