Scholarly record
VISEMAS AND VIRTUAL SPEAKING HEAD AS A COMMUNICATION FORM
Abstract
The people coordination in extreme situations involve correct communication form. Lot of deaf and hearing impared people are using lips reading or total communication TC as a main communication form. They prefer Virtual speaking head in extreme situations, as is crisis time as fire, flood, bombs, and different evacuation and as a communication form in high mountains, in caves and on lonely areas. A viseme is a representational unit used to classify speech sounds in the visual domain. A "viseme" describes the particular facial and oral positions and movements that occur alongside the voicing of phonemes. Virtual speaking head and correct speech visemas can be used as a communication help in all extreme situations. Design tool for creating virtual speaking head and correct speech visemas is designed. Its composed from 5 modules; module for creating phonemes, module for creating 3D speech visemes, module for facial expression and module for synchronization between phonemes and visemes and last one module to generate speech triphones. The paper describe developed tool and using the Virtual speaking head as a helpful for people and mostly for hearing impaired people in crisis and extreme situations to orientate himself.
Publication Impact Profile
Publication details
References14
N DARJAA, Sakhia - CERŇAK, Miloš - TRNKA, Marián - RUSKO, Milan - SABO, Róbert. Effective triphone mapping for acoustic modeling in speech recognition. In INTERSPEECH 2011 : Speech Science and Technology for Real Life, p. 1717-1720. ISSN 1990-9772.
Peter Drahoš and Martin Šperka, Face Expressions Animation in e-Learning. lconf06.dei.uc.pt/pdfs/paper14.pdf.
DARJAA, Sakhia - CERŇAK, Miloš - TRNKA, Marián - RUSKO, Milan - SABO, Róbert. Effective triphone mapping for acoustic modeling in speech recognition. In INTERSPEECH 2011 : Speech Science and Technology for Real Life, p. 1717-1720. ISSN 1990-9772.
ApJ. Ma, R. Cole, B. Pellom, W. Ward, and B. Wise. Accurate visible speech synthesis based on concatenating variable length motion capture data. IEEE
Christina M.Poe, The pros and cons of three main communication methods for Deaf and hard-of-hearing students. http://lifeprint.com/asl101/topics/communicatingwithdeaf.htm.
T. Ezzat, G. Geiger, and T. Poggio. Trainable videorealistic speech animation. In SIGGRAPH ’02: Proceedings of the 29th annual conference on Computer graphics and interactive techniques, pages 388–398. ACM Press, 2002.
M. M. Cohen and D. W. Massaro. Modeling coarticulation in synthetic visual speech. In N. Magnenat Thalmann and D. Thalmann, editors, Models and Techniques in Computer Animation, pages 139–156. Springer, Tokyo, 1994.
M. Brand. Voice puppetry. In SIGGRAPH ’99: Proceedings of the 26th annual conference on Computer graphics and interactive techniques, pages 21– 28. ACM Press/Addison-Wesley Publishing Co., 1999.
I.-J. Kim and H.-S. Ko. 3d lip-synch generation with data-faithful machine learning. In Computer Graphics Forum, Vol. 26, No. 3 EUROGRAPHICS 2007, 2007.
C. Bregler, M. Covell, and M. Slaney. Video rewrite:driving visual speech with audio. In Computer Graphics Proc. SIGGRAPH’97, pages 67–74, 1997.
Meadow – Orlans, Kathryn P., Mertens, Donna M., & Sass – Lehrer Marilyn. (2003) Parents and their Deaf Children, Washington D.C.; Gallaudet University Press.
D C. Sylvie, W. Ong, S. Ranganath. Automatic Sign Language Analysis: A Survey and the Future beyond Lexical Meaning, IEEE Trans. on Pattern Analysis and Machine Intelligence 27(6):873-891, 2005.
R. Bowden, Gregor A. Kalberer, Pascal Müller, Luc Van Gool, Visual speech, a trajectory in viseme space. International Journal of Imaging Systems and Technology. Special Issue: Facial Image Processin, Analyziz, and Synthesis.
Eva Pajorová. "Complicated Simulation Visualization Based on Grid and Cloud Computing", Lecture Notes in Computer Science, 2010.
View or Download full articleAccess options
SWS access login
Login as SWS Scientific CommitteeLogin as SWS Scientific PartnerLogin as SWS AuthorAuthors and approved SWS contributors will read and export their own linked papers after identity matching by SWS profile, email and SGEM GlobalID.
For librarian assistance: [email protected]
Purchase Instant Access
- Article can be downloaded after successful payment.
- Article may be used according to SWS library access terms.
- Article cannot be redistributed.
