A multi-expert approach for developing testing and diagnostic systems

Abstract

In recent years, researchers have attempted to develop computer-assisted testing and diagnostic systems to help students improve their learning performance. In developing a diagnostic system for detecting students' learning problem, it is difficult for the teachers to address the exact relationships between the test items and the concepts. Consequently, it becomes an interesting issue to integrate opinions from teachers. This study proposes a set of weighting rules to elicit and integrate the weightings of test item-concept relationships given by multiple experts. Based on the proposed approach, a testing and diagnostic system has been implemented. In addition, a practical application on a Mathematics course is going to be conducted to demonstrate the effectiveness of this innovative approach.