Tuyển tập báo cáo các nghiên cứu khoa học quốc tế ngành hóa học dành cho các bạn yêu hóa học tham khảo đề tài: Research Article SynFace—Speech-Driven Facial Animation for Virtual Speech-Reading Support | Hindawi Publishing Corporation EURASIP Journal on Audio Speech and Music Processing Volume 2009 Article ID 191940 10 pages doi 2009 191940 Research Article SynFace Speech-Driven Facial Animation for Virtual Speech-Reading Support Giampiero Salvi Jonas Beskow Samer Al Moubayed and Bjorn Granstrom KTH School of Computer Science and Communication Deptarment for Speech Music and Hearing Lindstedtsvagen 24 SE-100 44 Stockholm Sweden Correspondence should be addressed to Giampiero Salvi giampi@ Received 13 March 2009 Revised 23 July 2009 Accepted 23 September 2009 Recommended by Gerard Bailly This paper describes SynFace a supportive technology that aims at enhancing audio-based spoken communication in adverse acoustic conditions by providing the missing visual information in the form of an animated talking head. Firstly we describe the system architecture consisting of a 3D animated face model controlled from the speech input by a specifically optimised phonetic recogniser. Secondly we report on speech intelligibility experiments with focus on multilinguality and robustness to audio quality. The system already available for Swedish English and Flemish was optimised for German and for Swedish wide-band speech quality available in TV radio and Internet communication. Lastly the paper covers experiments with nonverbal motions driven from the speech signal. It is shown that turn-taking gestures can be used to affect the flow of human-human dialogues. We have focused specifically on two categories of cues that may be extracted from the acoustic signal prominence emphasis and interactional cues turn-taking back-channelling . Copyright 2009 Giampiero Salvi et al. This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use distribution and reproduction in any medium provided the original work is properly cited. 1. Introduction For a hearing impaired person and for a normal hearing person in adverse .
