Multimodal Interaction Aware Platform for Collaborative Learning

Abstract

A number of studies in the research field of Computer Supported Collaborative Learning (CSCL) have proposed various systems in order to facilitate learning in the context of social interactions. In a collaborative learning, participants exchange not only verbal but also nonverbal cues such as utterance, gaze and gesture for maintaining the relationships among one another. Nevertheless, very few attempts have been made to construct a CSCL system that can utilize such multimodal (verbal and non-verbal) information to support communication in a collaborative learning. In this paper, we propose a novel platform that enables CSCL system developers to construct their learning support tools that have original functions to process such multimodal information. By building learning support tools on our multimodal aware platform, we confirmed its usefulness and also potential to pioneer unexploited filed of research in learning analytics for CSCL and methods to intervene in collaborative learning processes using verbal and non-verbal information unutilized so far.