Towards an Evaluation Service for Adaptive Learning Systems

Abstract

This paper presents a service that supports the evaluation of adaptive learning systems. This evaluation service has been developed for and tested with an adaptive digital libraries system created in the CUTLURA project. Based on these experiences an approach is outlined, how it can be used in a similar way to evaluate the features and aspects of adaptive learning systems. Following the layered evaluation approach, qualities are defined that are evaluated individually. The evaluation service supports the whole evaluation process, which includes modelling the qualities to be evaluated, data collection, and automatic reports based on data analysis. Multi-modal data collection facilitates continuous and non-continuous, as well as invasive and non-invasive evaluation.