User-assisted sparse stereo-video segmentation

作者: Félix Raimbault , François Pitié , Anil Kokaram

DOI: 10.1145/2534008.2534027

关键词: Image segmentationConsistency (database systems)Pairwise comparisonScale-space segmentationSegmentation-based object categorizationStereoscopySegmentationArtificial intelligenceComputer visionComputer scienceFeature (computer vision)

摘要: Motion-based video segmentation has been studied for many years and remains challenging. Ill-posed problems must be solved when seeking a fully automated solution, so it is increasingly popular to maintain users in the processing loop by letting them set parameters or draw mattes guide process. When multiple-view videos, however, amount of user interaction should not proportional number views. In this paper we present novel sparse algorithm two-view stereoscopic videos that maintains temporal coherence view consistency throughout. We track feature points on both views with generic tracker analyse pairwise affinity temporally overlapping disjoint tracks, whereas existing similar techniques only exploit information available tracks overlap. The use stereo-disparity also allows our technique process jointly views, exhibiting good output. To make up lack high level understanding inherent techniques, allow refine output split-and-merge approach as obtain desired view-consistent over frames few clicks. several real examples illustrate versatility technique.

参考文章(27)
Katerina Fragkiadaki, Weiyu Zhang, Geng Zhang, Jianbo Shi, Two-Granularity Tracking: Mediating Trajectory and Detection Graphs for Tracking under Occlusions Computer Vision – ECCV 2012. pp. 552- 565 ,(2012) , 10.1007/978-3-642-33715-4_40
Vasileios Karavasilis, Konstantinos Blekas, Christophoros Nikou, Motion segmentation by model-based clustering of incomplete trajectories european conference on machine learning. pp. 146- 161 ,(2011) , 10.1007/978-3-642-23783-6_10
Thomas Brox, Jitendra Malik, None, Object segmentation by long term analysis of point trajectories european conference on computer vision. pp. 282- 295 ,(2010) , 10.1007/978-3-642-15555-0_21
Michael Zillich, Andreas Richtsfeld, Markus Vincze, Implementation of Gestalt principles for object segmentation international conference on pattern recognition. pp. 1330- 1333 ,(2012)
Narayanan Sundaram, Thomas Brox, Kurt Keutzer, None, Dense point trajectories by GPU-accelerated large displacement optical flow european conference on computer vision. pp. 438- 451 ,(2010) , 10.1007/978-3-642-15549-9_32
Jens Klappstein, Tobi Vaudrey, Clemens Rabe, Andreas Wedel, Reinhard Klette, Moving Object Segmentation Using Optical Flow and Depth Information pacific-rim symposium on image and video technology. ,vol. 2009, pp. 611- 623 ,(2009) , 10.1007/978-3-540-92957-4_53
Felix Raimbault, Yalcin Incesu, Adaptive video stabilisation with dominant motion layer estimation for home video and TV broadcast 2013 IEEE International Conference on Image Processing. pp. 3825- 3829 ,(2013) , 10.1109/ICIP.2013.6738788
Alexey Abramov, Karl Pauwels, Jeremie Papon, Florentin Worgotter, Babette Dellen, Real-Time Segmentation of Stereo Videos on a Portable System With a Mobile GPU IEEE Transactions on Circuits and Systems for Video Technology. ,vol. 22, pp. 1292- 1305 ,(2012) , 10.1109/TCSVT.2012.2199389
Ehsan Elhamifar, Rene Vidal, Sparse subspace clustering computer vision and pattern recognition. pp. 2790- 2797 ,(2009) , 10.1109/CVPR.2009.5206547
Roberto Tron, Rene Vidal, A Benchmark for the Comparison of 3-D Motion Segmentation Algorithms computer vision and pattern recognition. pp. 1- 8 ,(2007) , 10.1109/CVPR.2007.382974