A Neural Algorithm of Artistic Style

作者: Matthias Bethge , Leon A. Gatys , Alexander S. Ecker

DOI:

关键词: Class (computer programming)PerceptionQuality (philosophy)Computer sciencePath (graph theory)Artificial neural networkAlgorithmFacial recognition systemVisual perceptionObject (computer science)

摘要: In fine art, especially painting, humans have mastered the skill to create unique visual experiences through composing a complex interplay between content and style of an image. Thus far algorithmic basis this process is unknown there exists no artificial system with similar capabilities. However, in other key areas perception such as object face recognition near-human performance was recently demonstrated by class biologically inspired vision models called Deep Neural Networks. Here we introduce based on Network that creates artistic images high perceptual quality. The uses neural representations separate recombine arbitrary images, providing algorithm for creation images. Moreover, light striking similarities performance-optimised networks biological vision, our work offers path forward understanding how perceive imagery.

参考文章(21)
Karen Simonyan, Andrew Zisserman, Very Deep Convolutional Networks for Large-Scale Image Recognition computer vision and pattern recognition. ,(2014)
U. Güçlü, M. van Gerven, Deep Neural Networks Reveal a Gradient in the Complexity of Neural Representations across the Ventral Stream The Journal of Neuroscience. ,vol. 35, pp. 10005- 10014 ,(2015) , 10.1523/JNEUROSCI.5023-14.2015
Hochang Lee, Sanghyun Seo, Seungtaek Ryoo, Kyunghyun Yoon, None, Directional texture transfer Proceedings of the 8th International Symposium on Non-Photorealistic Animation and Rendering - NPAR 10. pp. 43- 48 ,(2010) , 10.1145/1809939.1809945
Alexei A. Efros, William T. Freeman, Image quilting for texture synthesis and transfer international conference on computer graphics and interactive techniques. pp. 341- 346 ,(2001) , 10.1145/383259.383296
D. L. K. Yamins, H. Hong, C. F. Cadieu, E. A. Solomon, D. Seibert, J. J. DiCarlo, Performance-optimized hierarchical models predict neural responses in higher visual cortex Proceedings of the National Academy of Sciences of the United States of America. ,vol. 111, pp. 8619- 8624 ,(2014) , 10.1073/PNAS.1403112111
David J. Heeger, James R. Bergen, Pyramid-based texture analysis/synthesis Proceedings of the 22nd annual conference on Computer graphics and interactive techniques - SIGGRAPH '95. pp. 229- 238 ,(1995) , 10.1145/218380.218446
Xuexiang Xie, Feng Tian, Hock Soon Seah, Feature Guided Texture Synthesis (FGTS) for artistic style transfer digital interactive media in entertainment and arts. pp. 44- 49 ,(2007) , 10.1145/1306813.1306830
Edward H. Adelson, James R. Bergen, Spatiotemporal energy models for the perception of motion Journal of The Optical Society of America A-optics Image Science and Vision. ,vol. 2, pp. 284- 299 ,(1985) , 10.1364/JOSAA.2.000284
Jan Eric Kyprianidis, John Collomosse, Tinghuai Wang, Tobias Isenberg, State of the "Art”: A Taxonomy of Artistic Stylization Techniques for Images and Video IEEE Transactions on Visualization and Computer Graphics. ,vol. 19, pp. 866- 885 ,(2013) , 10.1109/TVCG.2012.160
Olga Russakovsky, Jia Deng, Hao Su, Jonathan Krause, Sanjeev Satheesh, Sean Ma, Zhiheng Huang, Andrej Karpathy, Aditya Khosla, Michael Bernstein, Alexander C. Berg, Li Fei-Fei, ImageNet Large Scale Visual Recognition Challenge International Journal of Computer Vision. ,vol. 115, pp. 211- 252 ,(2015) , 10.1007/S11263-015-0816-Y