Comparison of Concept Map Evaluation between Kit-Build Method and Handmade Method

Abstract

This paper describes the reliability of our automatic concept map evaluation framework that is called Kit-Build concept map. This framework is developed based on concept map that is used for organizing and representing knowledge. It is enhanced to support an education. However, the automatic concept map evaluation has not investigated about the reliability. To confirm the reliability of Kit-Build concept map, we compare Kit-Build concept map with two handmade concept map evaluation methods that contain the structural scoring and the propositional scoring. These handmade methods can evaluate concept map flexibly because the human can understand the meaning of each proposition in concept map even the words of proposition do not appear in a learning material. So the handmade methods are claimed that they have the reliability enough for evaluating concept map. To reduce time cost and human workload, researchers propose the automatic concept map evaluation that becomes an important and useful for a classroom situation. It can evaluate a lot of concept maps in a short time, but it still needs to be examined the reliability. We designed preliminary experiment in two learning situations that are teaching and reading situations and compared the correlation between the handmade methods and Kit-Build concept map. Even though these are preliminary results, they suggest that using Kit-Build concept map in teaching situation gets acceptable reliability when it is compared the correlation with two handmade concept map evaluation methods.