Error-Correcting Factorization

作者: Fernando de la Torre , Sergio Escalera , Miguel Angel Bautista , Oriol Pujol

DOI:

关键词:

摘要: Error Correcting Output Codes (ECOC) is a successful technique in multi-class classification, which core problem Pattern Recognition and Machine Learning. A major advantage of ECOC over other methods that the multi- class decoupled into set binary problems are solved independently. However, literature defines general error-correcting capability for ECOCs without analyzing how it distributes among classes, hindering deeper analysis pair-wise error-correction. To address these limitations this paper proposes an Error-Correcting Factorization (ECF) method, our contribution three fold: (I) We propose novel representation error-correction capability, called design matrix, enables us to build on basis allocating correction pairs classes. (II) derive optimal code length using rank properties matrix. (III) ECF formulated as discrete optimization problem, relaxed solution found efficient constrained block coordinate descent approach. (IV) Enabled by flexibility introduced with matrix we allocate classes prone confusion. Experimental results several databases show when confusable outperforms state-of-the-art approaches.

参考文章(48)
Jason Weston, Chris Watkins, Support vector machines for multi-class pattern recognition. the european symposium on artificial neural networks. pp. 219- 224 ,(1999)
Gert R. G. Lanckriet, Serge J. Belongie, Josh Wills, Sameer Agarwal, David J. Kriegman, Lawrence Cayton, Generalized Non-metric Multidimensional Scaling. international conference on artificial intelligence and statistics. pp. 11- 18 ,(2007)
Yair Weiss, Rob Fergus, Antonio Torralba, None, Multidimensional Spectral Hashing Computer Vision – ECCV 2012. pp. 340- 353 ,(2012) , 10.1007/978-3-642-33715-4_25
André C. P. L. F. Carvalho, Ana C. Lorena, Evolutionary design of multiclass support vector machines brazilian symposium on neural networks. ,vol. 18, pp. 445- 454 ,(2007) , 10.5555/1369356.1369360
P. Tseng, Convergence of a Block Coordinate Descent Method for Nondifferentiable Minimization Journal of Optimization Theory and Applications. ,vol. 109, pp. 475- 494 ,(2001) , 10.1023/A:1017501703105
Robert E. Schapire, Using output codes to boost multiclass learning problems international conference on machine learning. pp. 313- 321 ,(1997)
Walter Murray, Philip E. Gill, Margaret H. Wright, Numerical linear algebra and optimization Addison-Wesley Pub. Co., Advanced Book Program. ,(1991)
T. G. Dietterich, G. Bakiri, Solving multiclass learning problems via error-correcting output codes Journal of Artificial Intelligence Research. ,vol. 2, pp. 263- 286 ,(1994) , 10.1613/JAIR.105
Marcin Marszałek, Cordelia Schmid, Constructing Category Hierarchies for Visual Recognition european conference on computer vision. ,vol. 5305, pp. 479- 491 ,(2008) , 10.1007/978-3-540-88693-8_35
Y. X. Gu, Q. R. Wang, C. Y. Suen, Application of a Multilayer Decision Tree in Computer Recognition of Chinese Characters IEEE Transactions on Pattern Analysis and Machine Intelligence. ,vol. PAMI-5, pp. 83- 89 ,(1983) , 10.1109/TPAMI.1983.4767349