Audio Subtitle Mapping System between Slide and Subtitles by Co-occurrence Graphs on VOD Lecture

Abstract

Many VOD lectures are played alongside a video, making it difficult to understand some content due to mishearing something or not catching the sound on a slide. Therefore, the ability to display audio subtitles that explain data or paragraphs on slides may improve student understanding of some lectures. This system will generate co-occurrence graphs for each paragraph and subtitle on a slide (Microsoft PowerPoint), and depending on the type of co-occurrence graph, and seek correspondence relations. These correspondence relations are used to support understanding of audio information by converting it to textual data and presenting displays and printouts of explanatory information on subtitles for each part of a slide.