Semantic Foggy Scene Understanding with Synthetic Data

作者: Christos Sakaridis , Dengxin Dai , Luc Van Gool

DOI: 10.1007/S11263-018-1072-8

关键词:

摘要: This work addresses the problem of semantic foggy scene understanding (SFSU). Although extensive research has been performed on image dehazing and with clear-weather images, little attention paid to SFSU. Due difficulty collecting annotating we choose generate synthetic fog real images that depict outdoor scenes, then leverage these partially data for SFSU by employing state-of-the-art convolutional neural networks (CNN). In particular, a complete pipeline add real, using incomplete depth information is developed. We apply our synthesis Cityscapes dataset Foggy 20550 images. tackled in two ways: 1) typical supervised learning, 2) novel type semi-supervised which combines an unsupervised supervision transfer from their counterparts. addition, carefully study usefulness For evaluation, present Driving, 101 real-world depicting driving come ground truth annotations segmentation object detection. Extensive experiments show learning significantly improves performance CNN Driving; strategy further performance; 3) marginally advances strategy. The datasets, models code are made publicly available.

参考文章(72)
Nathan Silberman, Derek Hoiem, Pushmeet Kohli, Rob Fergus, Indoor Segmentation and Support Inference from RGBD Images Computer Vision – ECCV 2012. pp. 746- 760 ,(2012) , 10.1007/978-3-642-33715-4_54
Saurabh Gupta, Judy Hoffman, Jitendra Malik, Cross Modal Distillation for Supervision Transfer computer vision and pattern recognition. pp. 2827- 2836 ,(2016) , 10.1109/CVPR.2016.309
Alexey Dosovitskiy, Philipp Fischer, Eddy Ilg, Philip Hausser, Caner Hazirbas, Vladimir Golkov, Patrick Van Der Smagt, Daniel Cremers, Thomas Brox, None, FlowNet: Learning Optical Flow with Convolutional Networks 2015 IEEE International Conference on Computer Vision (ICCV). pp. 2758- 2766 ,(2015) , 10.1109/ICCV.2015.316
Ross Girshick, Fast R-CNN international conference on computer vision. pp. 1440- 1448 ,(2015) , 10.1109/ICCV.2015.169
Razvan-Catalin Miclea, Ioan Silea, Visibility Detection in Foggy Environment international conference on control systems and computer science. pp. 959- 964 ,(2015) , 10.1109/CSCS.2015.56
Morten Borno Jensen, Mark Philip Philipsen, Andreas Mogelmose, Thomas Baltzer Moeslund, Mohan Manubhai Trivedi, Vision for Looking at Traffic Lights: Issues, Survey, and Perspectives IEEE Transactions on Intelligent Transportation Systems. ,vol. 17, pp. 1800- 1815 ,(2016) , 10.1109/TITS.2015.2509509
Geoffrey Hinton, Oriol Vinyals, Jeff Dean, Distilling the Knowledge in a Neural Network arXiv: Machine Learning. ,(2015)
Gabriel J. Brostow, Jamie Shotton, Julien Fauqueur, Roberto Cipolla, Segmentation and Recognition Using Structure from Motion Point Clouds Lecture Notes in Computer Science. pp. 44- 57 ,(2008) , 10.1007/978-3-540-88682-2_5
Dengxin Dai, Till Kroeger, Radu Timofte, Luc Van Gool, Metric imitation by manifold transfer for efficient vision applications computer vision and pattern recognition. pp. 3527- 3536 ,(2015) , 10.1109/CVPR.2015.7298975
Rita Spinneker, Carsten Koch, Su-Birm Park, Jason Jeongsuk Yoon, Fast Fog Detection for Camera Based Advanced Driver Assistance Systems international conference on intelligent transportation systems. pp. 1369- 1374 ,(2014) , 10.1109/ITSC.2014.6957878