Automatic Synthesis of Facial Expression with Speech

M. Hoguro, T. Umezaki, and N. Kimura (Japan)


: Facial Expression, Artificial Neural Networks, Kohonen's model, Synchronization with Speech


In this paper, a method of synthesizing speech facial expression by the Kohonen's artificial neural networks (KNN) is proposed. The proposed method generates facial expression series in speech of vowel to vowel with KNN automatically, which uses the still images of the five Japanese vowels pronunciation and non-speech state. Synchronization with speech sound was done by separating the stable sections and transition sections of facial expression based on the sound power, assigning a fixed facial expression to the stable section and the evenly distributed facial expression series to the transition section. The proposed method yielded much realistic speech facialexpression.

Important Links:

Go Back