Fusing Physiological Signals to Build a Cognitive Screening Architecture and Adaptive Learning Environment in the Metaverse

Abstract

Cognitive health plays a vital role in one's quality of life across the lifespan, particularly in the elderly, where cognitive decline can be more prominent. Conventional screening methods, e.g., Addenbrooke's Cognitive Examination, Montreal Cognitive Assessment, etc., though effective, are time-consuming and resource-intensive. Recent advances highlight the potential of integrating physiological signals as biomarkers for rapid, language-agnostic assessment of cognitive health. This concept paper proposes an architecture that fuses eye-tracking and Heart Rate Variability within the LA-ReflecT platform that can then be utilized for cognitive screening and learning. A two-phase implementation plan is proposed to develop and validate a cognitive screening platform integrated with physiological biomarkers and further use the inputs to tailor learning tasks in the metaverse for improved skill learning. This approach has the potential to support cognitive skill maintenance and enhance skill learning outcomes through adaptive, data-driven methods.