Designing an AI-Enhanced Timeline for Monitoring Multimodal Interactions in Embodied Learning Environments

Authors

  • Joyce FONTELES Vanderbilt University Author
  • Namrata SRIVASTAVA Center for Learning Analytics, Monash University; and Vanderbilt University Author
  • Eduardo DAVALOS Vanderbilt University Author
  • Ashwin T S Vanderbilt University Author
  • Gautam BISWAS Vanderbilt University Author

DOI:

https://doi.org/10.58459/icce.2024.4907

Abstract

Embodied learning represents a natural and immersive approach to education, where the physical engagement of learners plays a critical role in how they perceive and internalize concepts. This allows students to actively embody and explore knowledge through interaction with their environment, significantly enhancing retention and understanding of complex subjects. However, researchers face significant challenges in exploring children's learning in these physically interactive spaces, particularly due to the complexity of tracking multiple students' movements and dynamic interactions in real-time. To address these challenges, this paper introduces a Double Diamond design thinking process for developing an AI-enhanced timeline aimed at assisting researchers in visualizing and analyzing interactions within embodied learning environments. We outline key considerations, challenges, and lessons learned in this user-centered design process. Our goal is to create a timeline that employs state-of-the-art AI techniques to help researchers interpret complex datasets, such as children's movements, gaze directions, and affective states during learning activities, thereby simplifying their tasks and augmenting the process of interaction analysis.

Downloads

Download data is not yet available.

Downloads

Published

2024-11-25

How to Cite

Designing an AI-Enhanced Timeline for Monitoring Multimodal Interactions in Embodied Learning Environments. (2024). International Conference on Computers in Education. https://doi.org/10.58459/icce.2024.4907