Lip segmentation using automatic selected initial contours based on localized active contour model

作者: Yuanyao Lu , Qingqing Liu

DOI: 10.1186/S13640-017-0243-9

关键词:

摘要: With the rapid development of artificial intelligence and increasing popularity smart devices, human-computer interaction technology has become a multimedia multimode from being computer-focused to people-centered. Among all ways interactions, using language interact with machines is most convenient efficient one. However, performance audio speech recognition systems not satisfied in noisy environment. Thus, more researchers focus their works on visual lip reading technology. By extracting movement features speakers rather than features, can get superior results when noises interferences exist. Lip segmentation plays an important role system, since result crucial final accuracy. In this paper, we propose localized active contour model-based method two initial contours combined color space. We apply illumination equalization original RGB images decrease interference uneven illumination. A space consists U component CIE-LUV sum C2 C3 components image after discrete Hartley transform. select rhombus as closed mouth, because it similar shape lip. For open utilize semi-ellipse both outer inner boundaries. After attaining each separately, merge them together obtain result. From experiment, conclude that better compared circle segment gray space, especially for mouth. An extremely obvious advantage mouth excluding internal information such teeth, black holes, tongue, introduction contour.

参考文章(40)
Thomas Dziurzyk, Ulrich Canzler, Extraction of Non Manual Features for Videobased Sign Language Recognition. Journal of Machine Vision and Applications. pp. 318- 321 ,(2002)
Meng Li, Yiu-ming Cheung, Automatic Segmentation of Color Lip Images Based on Morphological Filter Artificial Neural Networks – ICANN 2010. pp. 384- 387 ,(2010) , 10.1007/978-3-642-15819-3_51
Manassanan Srikham, Active contours segmentation with edge based and local region based international conference on pattern recognition. pp. 1989- 1992 ,(2012)
Nikos Paragios, Rachid Deriche, Geodesic Active Regions and Level Set Methods for Supervised Texture Segmentation International Journal of Computer Vision. ,vol. 46, pp. 223- 247 ,(2002) , 10.1023/A:1014080923068
Ma Xinjun, Zhang Hongqiao, Lip segmentation algorithm based on bi-color space chinese control conference. pp. 3776- 3779 ,(2015) , 10.1109/CHICC.2015.7260223
Jian Yang, Shangbing Gao, Saliency-seeded localizing region-based active contour for automatic natural object segmentation international conference on pattern recognition. pp. 3644- 3647 ,(2012)
David M. W. Powers, Trent W. Lewis, Lip feature extraction using red exclusion VIP '00 Selected papers from the Pan-Sydney workshop on Visualisation - Volume 2. pp. 61- 67 ,(2000)
Aris Nasuha, Tri Arief Sardjono, Mauridhi Hery Purnomo, Lip segmentation and tracking based on Chan-Vese model international conference on information technology and electrical engineering. pp. 155- 158 ,(2013) , 10.1109/ICITEED.2013.6676230
Hamed Talea, Khashayar Yaghmaie, Automatic combined lip segmentation in color images ieee international conference on communication software and networks. pp. 109- 112 ,(2011) , 10.1109/ICCSN.2011.6014860
Stanley Osher, James A Sethian, Fronts propagating with curvature-dependent speed: algorithms based on Hamilton-Jacobi formulations Journal of Computational Physics. ,vol. 79, pp. 12- 49 ,(1988) , 10.1016/0021-9991(88)90002-2