Effects of Automatic Hidden Caption Classification on a Content-based Computer-Assisted Language Learning System for Foreign Language Listening

Abstract

This study develops a content-based computer-assisted language learning tool for training English listening through multimedia. The system automatically provides instant vocabulary translation and classification to users whenever they pause while watching videos. Experiments were conducted to compare the novel system with the traditional solution using a translation machine to support subtitle comprehension. The first goal of the novel system is to support listening comprehension, and the second goal is to confirm its usability. These two goals were successfully achieved in the study. Eye tracking was used to observe variations in gazing and reliance on subtitles. The results of vision analysis show that the degrees of reliance on subtitles remain unchanged.