Risk-Sensitive Learning to Rank with Evolutionary Multi-Objective Feature Selection

作者: Daniel Xavier Sousa , Sérgio Canuto , Marcos André Gonçalves , Thierson Couto Rosa , Wellington Santos Martins

DOI: 10.1145/3300196

关键词:

摘要: Learning to Rank (L2R) is one of the main research lines in Information Retrieval. Risk-sensitive L2R a sub-area that tries learn models are good on average while at same time reducing risk performing poorly few but important queries (e.g., medical or legal queries). One way learned by selecting and removing noisy, redundant features, features promote some detriment others. This exacerbated learning methods usually maximize an metric mean precision (MAP) Normalized Discounted Cumulative Gain (NDCG)). However, historically, feature selection (FS) have focused only effectiveness reduction as objectives. Accordingly, this work, we propose evaluate FS for with additional objective mind, namely risk-sensitiveness. We present novel single multi-objective criteria optimize reduction, effectiveness, risk-sensitiveness, all time. also introduce new methodology explore search space, suggesting effective efficient extensions well-known Evolutionary Algorithm (SPEA2) applied L2R. Our experiments show explicitly including criterion crucial achieving more risk-sensitive performance. provide thorough analysis our experimental results.

参考文章(44)
B. Taner Dinçer, Iadh Ounis, Craig Macdonald, Tackling Biased Baselines in the Risk-Sensitive Evaluation of Retrieval Systems Lecture Notes in Computer Science. pp. 26- 38 ,(2014) , 10.1007/978-3-319-06028-6_3
Kaweh Djafari Naini, Ismail Sengor Altingovde, Exploiting Result Diversification Methods for Feature Selection in Learning to Rank Lecture Notes in Computer Science. pp. 455- 461 ,(2014) , 10.1007/978-3-319-06028-6_41
Robert Tibshirani, Trevor Hastie, Jerome H. Friedman, The Elements of Statistical Learning ,(2001)
Ellen M. Voorhees, Kevyn Collins-Thompson, Paul N. Bennett, Craig Macdonald, Fernando Diaz, TREC 2014 Web Track Overview text retrieval conference. ,(2015)
Marco Laumanns, Eckart Zitzler, Lothar Thiele, On the Effects of Archiving, Elitism, and Density Based Selection in Evolutionary Multi-objective Optimization international conference on evolutionary multi criterion optimization. pp. 181- 196 ,(2001) , 10.1007/3-540-44719-9_13
Mehrnoush Barani Shirzad, Mohammad Reza Keyvanpour, A feature selection method based on minimum redundancy maximum relevance for learning to rank 2015 AI & Robotics (IRANOPEN). pp. 1- 5 ,(2015) , 10.1109/RIOS.2015.7270735
Eckart Zitzler, Marco Laumanns, Lothar Thiele, SPEA2: Improving the strength pareto evolutionary algorithm Technical Report, Gloriastrasse 35. ,vol. 103, ,(2001) , 10.3929/ETHZ-A-004284029
Sanmay Das, Filters, Wrappers and a Boosting-Based Hybrid for Feature Selection international conference on machine learning. pp. 74- 81 ,(2001)
Franco Maria Nardini, Gabriele Capannini, Raffaele Perego, Nicola Tonellotto, Claudio Lucchese, Salvatore Orlando, Domenico Dato, Monica Mori, QuickRank: a C++ Suite of Learning to Rank Algorithms italian information retrieval workshop. ,vol. 1404, ,(2015)
Lea Laporte, Remi Flamary, Stephane Canu, Sebastien Dejean, Josiane Mothe, Nonconvex Regularizations for Feature Selection in Ranking With Sparse SVM IEEE Transactions on Neural Networks. ,vol. 25, pp. 1118- 1130 ,(2014) , 10.1109/TNNLS.2013.2286696