Synthesis of Reflectance Function Textures from Examples

作者: Yacov Hel-Or , Tom Malzbender , Dan Gelb

DOI:

关键词:

摘要: Abstract We extend the machinery of existing texture synthesis methods to handle images where each pixel contains not only RGB values, but reflectance functions. Like conventional methods, we can use photographs surface textures as examples base from. However multiple same are used characterize across lighting variation, and is based on these source images. Our approach performs directly in space functions does require any intermediate 3D reconstruction target surface. The resulting synthetic be rendered real-time with continuous control direction. 1. Introduction characterization real world surfaces an important aspect enabling photorealistic rendering. Early [Perlin 85, Peachy 85] relied ingenuity programmer develop procedural models that approximate appearance materials. Unfortunately, representation did lend itself automatic from photographs. This ability especially useful when new instantiations performed such a characterization. Powerful were developed late 80’s 90’s able synthesize samples photographic examples. Discussion found section 2.2. These have practical ramifications for computer graphics since they simplify mapping process several ways. First, larger patches produced, yielding more material process. Second, may synthesized periodic boundary conditions, producing seamlessly tiled, high image quality Although powerful, limitations address this paper. Since example input algorithms captured under specific conditions ‘baked in’. results will convincing those match patch finds object, general case. In fact, single map wrapped around even simple opposite sides object experience completely reversed directions local coordinate system map. Due spatial variation mesostructure microgeometry, modifications due changes illumination poorly approximated by attenuating intensity geometry. Figure 1 demonstrates behavior, rendering using light-dependent model compared modeled without dependency. Image-based re-lighting [Debevec 00, Malzbender 01, Ashikhmin 02, Debevec 02] provide solution quandary. approach, surface, person or taken varying static pose, characterizing changing constructed. With enough resolution spatially direction, very realistic renderings original produced arbitrary conditions. paper demonstrate how image-based polynomial maps (PTMs) [Malzbender 01] leveraged purposes synthesizing

参考文章(20)
Thomas Leung, Jitendra Malik, Representing and Recognizing the Visual Appearance of Materials using Three-dimensional Textons International Journal of Computer Vision. ,vol. 43, pp. 29- 44 ,(2001) , 10.1023/A:1011126920638
Hel-Or, Hel-Or, Real time pattern matching using projection kernels international conference on computer vision. pp. 1486- 1493 ,(2003) , 10.1109/ICCV.2003.1238666
Alexei A. Efros, William T. Freeman, Image quilting for texture synthesis and transfer international conference on computer graphics and interactive techniques. pp. 341- 346 ,(2001) , 10.1145/383259.383296
Kristin J. Dana, Bram van Ginneken, Shree K. Nayar, Jan J. Koenderink, Reflectance and texture of real-world surfaces ACM Transactions on Graphics. ,vol. 18, pp. 1- 34 ,(1999) , 10.1145/300776.300778
Tom Malzbender, Dan Gelb, Hans Wolters, Polynomial texture maps international conference on computer graphics and interactive techniques. pp. 519- 528 ,(2001) , 10.1145/383259.383320
Jeremy S. De Bonet, Multiresolution sampling procedure for analysis and synthesis of texture images international conference on computer graphics and interactive techniques. pp. 361- 368 ,(1997) , 10.1145/258734.258882
Xinguo Liu, Yizhou Yu, Heung-Yeung Shum, Synthesizing bidirectional texture functions for real-world surfaces international conference on computer graphics and interactive techniques. pp. 97- 106 ,(2001) , 10.1145/383259.383269
Michael Ashikhmin, Peter Shirley, Steerable illumination textures ACM Transactions on Graphics. ,vol. 21, pp. 1- 19 ,(2002) , 10.1145/504789.504790
David J. Heeger, James R. Bergen, Pyramid-based texture analysis/synthesis Proceedings of the 22nd annual conference on Computer graphics and interactive techniques - SIGGRAPH '95. pp. 229- 238 ,(1995) , 10.1145/218380.218446
Lin Liang, Ce Liu, Ying-Qing Xu, Baining Guo, Heung-Yeung Shum, Real-time texture synthesis by patch-based sampling ACM Transactions on Graphics. ,vol. 20, pp. 127- 150 ,(2001) , 10.1145/501786.501787