Learning compact class codes for fast inference in large multi class classification

作者: M. Cissé , T. Artières , Patrick Gallinari

DOI: 10.1007/978-3-642-33460-3_38

关键词:

摘要: We describe a new approach for classification with very large number of classes where we assume some class similarity information is available, e.g. through hierarchical organization. The proposed method learns compact binary code using such an existing defined on classes. Binary classifiers are then trained this and decoding performed simple nearest neighbor rule. This strategy, related to Error Correcting Output Codes methods, shown perform similarly or better than the standard efficient one-vs-all approach, much lower inference complexity.

参考文章(21)
Yoshua Bengio, Hugo Larochelle, Dumitru Erhan, Zero-data learning of new tasks national conference on artificial intelligence. pp. 646- 651 ,(2008)
Andrew William Moore, None, Efficient memory-based learning for robot control ,(1990)
T. G. Dietterich, G. Bakiri, Solving multiclass learning problems via error-correcting output codes Journal of Artificial Intelligence Research. ,vol. 2, pp. 263- 286 ,(1994) , 10.1613/JAIR.105
Oriol Pujol, Sergio Escalera, Petia Radeva, An incremental node embedding technique for error correcting output codes Pattern Recognition. ,vol. 41, pp. 713- 725 ,(2008) , 10.1016/J.PATCOG.2007.04.008
Lijuan Cai, Thomas Hofmann, Hierarchical document categorization with support vector machines conference on information and knowledge management. pp. 78- 87 ,(2004) , 10.1145/1031171.1031186
Pascal Vincent, Hugo Larochelle, Yoshua Bengio, Pierre-Antoine Manzagol, Extracting and composing robust features with denoising autoencoders Proceedings of the 25th international conference on Machine learning - ICML '08. pp. 1096- 1103 ,(2008) , 10.1145/1390156.1390294
A. Kosmopoulos, E. Gaussier, G. Paliouras, S. Aseervatham, The ECIR 2010 large scale hierarchical classification workshop international acm sigir conference on research and development in information retrieval. ,vol. 44, pp. 23- 32 ,(2010) , 10.1145/1842890.1842894
Reducing multiclass to binary: a unifying approach for margin classifiers Journal of Machine Learning Research. ,vol. 1, pp. 113- 141 ,(2001) , 10.1162/15324430152733133
Paul N. Bennett, Nam Nguyen, Refined experts: improving classification in large taxonomies international acm sigir conference on research and development in information retrieval. pp. 11- 18 ,(2009) , 10.1145/1571941.1571946
Jane Bromley, James W. Bentz, Léon Bottou, Isabelle Guyon, Yann LeCun, Cliff Moore, Roopak Säckinger, Eduard and Shah, Signature Verification using a "Siamese" Time Delay Neural Network neural information processing systems. ,vol. 6, pp. 737- 744 ,(1993)