Pronunciation Instruction using CG Animation based on Articulatory Features

Abstract

We describe a pronunciation instruction system that dynamically generates CG animations to express the pronunciation from speech based on articulatory features. Specifically, the system displays the results of phoneme recognition and animation of the pronunciation movements of both the learner and teacher from their speech in order to show in what way the learner’s pronunciation is wrong. Learners can thus understand their wrong pronunciation and the correct pronunciation method through specific pronunciation animations. Experiments confirmed the effectiveness of the animations.