AR based Skill Learning Support System with Velocity Adjustment of Virtual Instructor Movement

Abstract

In this paper, we propose the skill learning support system to give learner the real time feedback information. In this system, to construct feedback, the virtual room based on recorded user’s image is used. In virtual room, instructors bone model is displayed too. In learning process, learner imitates displayed bone model to get the knowledge about skill corresponding to instructor’s movement. By displaying virtual instructor and learner’s body in the virtual room, learner can see virtual instructor’s movement and learner’s posture. Additionally, virtual instructor’s speed can be adjusted by learner’s intention. To control virtual instructor’s speed, learner’s voice is used as input information. To get user’s voice and record image, Microsoft Kinect sensor is used as a camera and a microphone in the developed prototype system. To evaluate this approach, the prototype system for learning skill of soft tennis (swing form) was developed. So, evaluations experiments were conducted by using the prototype system of soft tennis and effectiveness of adjustment of virtual instructor’s speed in learning process was shown.