Learning generative texture models with extended Fields-of-Experts

作者: Nicolas Heess , Christopher K.I. Williams , Geoffrey E. Hinton

DOI: 10.5244/C.23.115

关键词:

摘要: We evaluate the ability of popular Field-of-Experts (FoE) to model structure in images. As a test case we focus on modeling synthetic and natural textures. find that even for single textures, FoE provides insufficient flexibility learn good generative models ‐ it does not perform any better than much simpler Gaussian FoE. propose an extended version (allowing bimodal potentials) demonstrate this novel formulation, when trained with approximation likelihood gradient, gives rise more powerful specific visual produces significantly results texture task.

参考文章(17)
Rama Chellappa, Shankar Chatterjee, Richard Bagdazian, Texture synthesis and compression using Gaussian-Markov random field models systems man and cybernetics. ,vol. 15, pp. 298- 303 ,(1985) , 10.1109/TSMC.1985.6313361
D.E. Melas, S.P. Wilson, Double Markov random fields and Bayesian image segmentation IEEE Transactions on Signal Processing. ,vol. 50, pp. 357- 365 ,(2002) , 10.1109/78.978390
Yair Weiss, William T. Freeman, What makes a good model of natural images? 2007 IEEE Conference on Computer Vision and Pattern Recognition. pp. 1- 8 ,(2007) , 10.1109/CVPR.2007.383092
Bruno A. Olshausen, David J. Field, Sparse Coding with an Overcomplete Basis Set: A Strategy Employed by V1 ? Vision Research. ,vol. 37, pp. 3311- 3325 ,(1997) , 10.1016/S0042-6989(97)00169-7
Geoffrey Hinton, Simon Osindero, Max Welling, Yee-Whye Teh, Unsupervised Discovery of Nonlinear Structure Using Contrastive Backpropagation Cognitive Science. ,vol. 30, pp. 725- 731 ,(2006) , 10.1207/S15516709COG0000_76
A.A. Efros, T.K. Leung, Texture synthesis by non-parametric sampling international conference on computer vision. ,vol. 2, pp. 1033- 1038 ,(1999) , 10.1109/ICCV.1999.790383
Geoffrey E. Hinton, Training products of experts by minimizing contrastive divergence Neural Computation. ,vol. 14, pp. 1771- 1800 ,(2002) , 10.1162/089976602760128018
Tijmen Tieleman, Training restricted Boltzmann machines using approximations to the likelihood gradient Proceedings of the 25th international conference on Machine learning - ICML '08. pp. 1064- 1071 ,(2008) , 10.1145/1390156.1390290
S. Roth, M.J. Black, Fields of Experts: a framework for learning image priors computer vision and pattern recognition. ,vol. 2, pp. 860- 867 ,(2005) , 10.1109/CVPR.2005.160
Geoffrey E. Hinton, Simon Osindero, Max Welling, Learning Sparse Topographic Representations with Products of Student-t Distributions neural information processing systems. ,vol. 15, pp. 1383- 1390 ,(2002)