PiCam

作者: Kartik Venkataraman , Dan Lelescu , Jacques Duparré , Andrew McMahon , Gabriel Molina

DOI: 10.1145/2508363.2508390

关键词: View synthesisPixelComputer graphics (images)Computer visionImage restorationChannel (digital image)ParallaxMobile deviceLight fieldCamera auto-calibrationComputer scienceImage qualityLens (optics)Artificial intelligenceSuperresolutionDepth map

摘要: We present PiCam (Pelican Imaging Camera-Array), an ultra-thin high performance monolithic camera array, that captures light fields and synthesizes resolution images along with a range image (scene depth) through integrated parallax detection superresolution. The is passive, supporting both stills video, low capable, small enough to be included in the next generation of mobile devices including smartphones. Prior works [Rander et al. 1997; Yang 2002; Zhang Chen 2004; Tanida 2001; 2003; Duparre 2004] arrays have explored multiple facets field capture - from viewpoint synthesis, synthetic refocus, computing images, speed micro-optical aspects system miniaturization. However, none these addressed modifications needed achieve strict form factor quality required make array cameras practical for devices. In our approach, we customize many lenses, pixels, sensors, software algorithms imaging comparable existing phone cameras.Our contributions post-processing include cost function integrates across color channels, regularized restoration (superresolution) process takes into account all degradations adapts conditions. registration uncertainty Maximum-a-Posteriori formulation estimate scene depth. conclude some examples capabilities such as postcapture (still) video view synthesis demonstrate motion parallax, 3D briefly address future work.

参考文章(37)
Sven Wanner, Bastian Goldluecke, Spatial and Angular Variational Super-Resolution of 4D Light Fields Computer Vision – ECCV 2012. pp. 608- 621 ,(2012) , 10.1007/978-3-642-33715-4_44
Yoshikuni Nomura, Shree K. Nayar, Li Zhang, Scene collages and flexible camera arrays eurographics symposium on rendering techniques. pp. 127- 138 ,(2007) , 10.5555/2383847.2383866
Noha A. El-Yamany, Panos E. Papamichalis, Robust color image superresolution: an adaptive M-estimation framework Eurasip Journal on Image and Video Processing. ,vol. 2008, pp. 763254- ,(2008) , 10.1155/2008/763254
Jacques Duparré, Peter Dannberg, Peter Schreiber, Andreas Bräuer, Andreas Tünnermann, Artificial apposition compound eye fabricated by micro-optics technology Applied Optics. ,vol. 43, pp. 4303- 4310 ,(2004) , 10.1364/AO.43.004303
Andreas Brueckner, Jacques Duparré, Robert Leitel, Peter Dannberg, Andreas Bräuer, Andreas Tünnermann, Thin wafer-level camera lenses inspired by insect compound eyes Optics Express. ,vol. 18, pp. 24379- 24394 ,(2010) , 10.1364/OE.18.024379
Ryoichi Horisaki, Yoshizumi Nakao, Takashi Toyoda, Keiichiro Kagawa, Yasuo Masaki, Jun Tanida, A compound-eye imaging system with irregular lens-array arrangement Proceedings of SPIE. ,vol. 7072, ,(2008) , 10.1117/12.796698
Todor Georgiev, Georgi Chunev, Andrew Lumsdaine, Superresolution with the focused plenoptic camera Computational Imaging IX. ,vol. 7873, ,(2011) , 10.1117/12.872666
Rudolf Kingslake, Lens design fundamentals ,(1978)
Peter Rander, Takeo Kanade, P. J. Narayanan, Virtualized reality: constructing time-varying virtual worlds from real world events ieee visualization. pp. 277- 283 ,(1997) , 10.5555/266989.267081
Marc Levoy, Pat Hanrahan, Light field rendering international conference on computer graphics and interactive techniques. pp. 31- 42 ,(1996) , 10.1145/237170.237199