Real-Time Lip Tracking for Audio-Visual Speech Recognition Applications

摘要: Developments in dynamic contour tracking permit sparse representation of the outlines moving contours. Given increasing computing power general-purpose workstations it is now possible to track human faces and parts real-time without special hardware. This paper describes a lip tracker that uses Kalman filter based outline lips. Two alternative trackers, one tracks lips from profile view other frontal view, were developed extract visual speech recognition features contour. In both cases, have been incorporated into an acoustic automatic recogniser. Tests on small isolated-word vocabularies using time warping audio-visual recogniser demonstrate real-time, contour-based can be used supplement acoustic-only recognisers enabling robust presence noise.