An Embodied Projection Recognition System for Situated Learning to Enhance Learning Effectiveness and Self-Reflection Ability
DOI:
https://doi.org/10.58459/icce.2024.4850Abstract
In service-oriented disciplines such as Hospitality Management Education and Nursing Education, multimodal elements such as bodily movements and facial expressions play crucial roles in addition to learning through oral instruction and written materials. Current digital reality learning systems provide excellent spaces for situated learning and real-time assessment. However, they often lack an environment that simultaneously considers real-time assessments of physical actions and spatial awareness. This omission can prevent students from effectively applying their learned knowledge in real professional settings, thereby reducing the practicality and effectiveness of their learning. To address this issue, our study has developed a teaching assistance system aimed at enhancing learners' experiences through readily available technologies. We established a new learning environment and model that can be used in the classroom, incorporating the concepts of personas and spatial computation proposed by Apple Vision Pro to facilitate real-time assessment and scaffolded guidance in service-oriented learning. This model, which complements traditional learning methods, supports embodied cognition and situated learning, allowing users to interact simultaneously with the physical environment and digital reality. Students can engage in both language and embodied action exercises within this environment. Through the system's real-time evaluation and feedback, students can immediately reflect and adjust their behavior in a nearly real interaction setting, enhancing their practical experience and thus improving their ability to absorb and apply learned skills. Moreover, students' performances in the digital reality are displayed on a large screen in the classroom, allowing peers in the audience area to simultaneously observe each other's acts, thereby creating a theater-style learning environment. This transformation not only allows students to see their own and others' real-time performances but also shifts their role from mere participants to performers. This shift helps build a sense of responsibility and enhances their motivation to learn. This method was tested in the 'Hospitality Practices and Japanese' course at a university of technology, with results showing significant improvements in learning outcomes in practical courses that require physical and verbal interactions compared to traditional digital realities.