How to Measure the Collaborative Problem-solving Competency Based on Conversational Agent

Abstract

Nowadays, collaborative problem-solving competency has become one of the essential core skills for talents in the 21st century. Limited by the complex and variable factors of collaborative problem-solving activities, the current assessment method was difficult to understand the real situation of students' collaborative activities and problem-solving. Based on the PISA2015 collaborative problem-solving competency assessment framework, this study build an assessment model and integrated the computer conversational agent technology to develop the prototype of the collaborative problem-solving competency evaluation system. We found the performance level of individual and teams' collaborative problem-solving patterns. It provides a reference for the evaluation of collaborative problem-solving competency, and also provides a new direction for human-computer interaction based on conversational agents.