Specularity removal in images and videos: a PDE approach

作者: Satya P. Mallick , Todd Zickler , Peter N. Belhumeur , David J. Kriegman

DOI: 10.1007/11744023_43

关键词:

摘要: We present a unified framework for separating specular and diffuse reflection components in images videos of textured scenes. This can be used specularity removal independently processing, filtering, recombining the two components. Beginning with partial separation provided by an illumination-dependent color space, challenge is to complete using spatio-temporal information. accomplished evolving differential equation (PDE) that iteratively erodes component at each pixel. A family PDEs appropriate differing image sources (still vs. videos), prior information (e.g., highly lightly scenes), or computations optical flow) introduced. In contrast many other methods, explicit segmentation and/or manual intervention are not required. results on high-quality video acquired laboratory addition taken from Internet. Results latter demonstrate robustness low dynamic range, JPEG artifacts, lack knowledge illuminant color. Empirical comparison physical specularities polarization provided. Finally, application termed dichromatic editing presented which processed produce variety visual effects.

参考文章(20)
Shree K. Nayar, Xi-Sheng Fang, Terrance Boult, Separation of Reflection Components Using Color and Polarization International Journal of Computer Vision. ,vol. 21, pp. 163- 186 ,(1997) , 10.1023/A:1007937815113
A. Blake, G. Brelstaff, Geometry From Specularities international conference on computer vision. pp. 394- 403 ,(1988) , 10.1109/CCV.1988.590016
Petros Maragos, Muhammad Akmal Butt, Curve evolution, differential morphology, and distance transforms applied to multiscale and eikonal problems Fundamenta Informaticae. ,vol. 41, pp. 91- 129 ,(2000) , 10.3233/FI-2000-411204
R.W. Brockett, P. Maragos, Evolution equations for continuous-scale morphological filtering IEEE Transactions on Signal Processing. ,vol. 42, pp. 3377- 3386 ,(1994) , 10.1109/78.340774
Gleen Healey, Thomas O. Binford, Local shape from specularity Graphical Models \/graphical Models and Image Processing \/computer Vision, Graphics, and Image Processing. ,vol. 42, pp. 62- 86 ,(1988) , 10.1016/0734-189X(88)90143-0
Steven A. Shafer, Using color to separate reflection components Color Research and Application. ,vol. 10, pp. 210- 218 ,(1985) , 10.1002/COL.5080100409
Michael G. Crandall, Hitoshi Ishii, Pierre-Louis Lions, User’s guide to viscosity solutions of second order partial differential equations Bulletin of the American Mathematical Society. ,vol. 27, pp. 1- 67 ,(1992) , 10.1090/S0273-0979-1992-00266-5
Ruzena Bajcsy, Sang Wook Lee, Ale? Leonardis, Detection of diffuse and specular interface reflections and inter-reflections by color image segmentation International Journal of Computer Vision. ,vol. 17, pp. 241- 272 ,(1996) , 10.1007/BF00128233
Jae Byung Park, Efficient color representation for image segmentation under nonwhite illumination international conference on robotics and automation. ,vol. 5267, pp. 163- 174 ,(2003) , 10.1117/12.519400
R.T. Tan, K. Nishino, K. Ikeuchi, Separating reflection components based on chromaticity and noise analysis IEEE Transactions on Pattern Analysis and Machine Intelligence. ,vol. 26, pp. 1373- 1379 ,(2004) , 10.1109/TPAMI.2004.90