Lipreadability of a synthetic talking face in normal hearing and hearing-impaired listeners

作者: Andrew Faulkner , Geoff Williams , Catherine Siciliano

DOI:

关键词:

摘要: The Synface project is developing a synthetic talking face to aid the hearing-impaired in telephone conversation. This report investigates gain intelligibility from head when controlled by hand-annotated speech both 12 normal hearing (NH) and 13 (HI) listeners (average loss 86 dB). For NH listeners, audio everyday sentences was degraded simulate information losses that arise severe-to-profound impairment. HI group, filtered speech. Auditory signals were presented alone, with face, video of original talker. Purely auditory low for group. With addition average increased 22%. group had large variation purely condition. They showed 22% improvement face. groups, significantly lower than natural However, sufficient be useful communication. Questionnaire responses indicated strong interest system.

参考文章(6)
John Bamford, John Bench, Speech-hearing tests and the spoken language of hearing-impaired children Academic Press. ,(1979)
Jonas Beskow, Tobias Öhman, Martin Dahlquist, Karl-Erik Spens, Magnus Lundeberg, Björn Granström, The teleface project multi-modal speech-communication for the hearing impaired. conference of the international speech communication association. ,(1997)
R. V. Shannon, F.-G. Zeng, V. Kamath, J. Wygonski, M. Ekelid, Speech recognition with primarily temporal cues. Science. ,vol. 270, pp. 303- 304 ,(1995) , 10.1126/SCIENCE.270.5234.303
Edgar Villchur, Electronic models to simulate the effect of sensory distortions on speech perception by the deaf The Journal of the Acoustical Society of America. ,vol. 62, pp. 665- 674 ,(1977) , 10.1121/1.381579
Jonas Beskow, Andrew Faulkner, Geoff Williams, Catherine Siciliano, Evaluation of a multilingual synthetic talking face as a communication aid for the hearing impaired In: Proceedings of the 15th International Congress of Phonetic Sciences: 15th ICPhS, Barcelona 3-9 August 2003. (pp. 131 - 134). Universitat Autònoma de Barcelona / International Phonetic Association: Barcelona, Spain. (2003). ,(2003)
Benjamin Lee, Talking heads ,(1997)