Audiovisual Feedback for Foreign Language Learning

G. Demenko, A. Wagner, N. Cylwik (Poland), O. Jokisch, U. Koloska, and D. Hirschfeld (Germany)


Educational multimedia, language, education, databases, multimedia tools


In recent years the application of computer software to the learning process has been acknowledged an indisputably effective tool supporting traditional teaching methods. Particular focus has been put on the application of techniques based on speech and language processing to second language learning. Most of commercial self-study programs, however, do not allow for the introduction of an individualized learning course by the teacher and focus on segmental features only. The paper presents specifications for the Euronounce project which aims at creating an intelligent tutoring system with multimodal feedback functions for acquiring foreign languages‟ pronunciation and prosody. In response to the European Union's call for promoting less widely spoken languages the project focuses on German as a target language for native speakers of Polish, Slovak, Czech or Russian and vice versa. The design of the speech corpus for the purpose of tutoring system is described. The analysis of pronunciation errors provides information which is important for ASR training on the one hand, and for automatic error detection on the other hand. The paper also presents the Pitch Line software which can be implemented in the prosody visualization and training module of the AzAR (German acronym for "Automat for accent reduction") tutoring system.

Important Links:

Go Back