Computer Adaptive Testing (CAT) has been highlighted as a promising assessment method to fulfill two testing purposes: estimating student academic ability and classifying student academic level. In this paper, we introduced the Web-based Adaptive Testing System (WATS) developed to support a cost effective assessment for classifying students’ ability into different academic levels. Instead of us...

It is suggested to insert into test matrix 1s for correct responses, 0s for response refusals, and negative corrective elements for incorrect responses. With the classical test theory approach test scores of examinees and items are calculated traditionally as sums of matrix elements, organized in rows and columns. Correlation coefficients are estimated using correction coefficients. In item res...

We discuss new measures in assessing the skill level of students based on their interactions with the Socratic homework tutor, MasteringPhysics. We show that the measurement of the difficulty of problems for a given student as determined by the time to first correct response, the number of incorrect responses without advice, and hints have high reliability (96%). As an immediate application, we...

The impact of curricular reform efforts that are incorporated into the Statewide Systemic Initiatives (SSIs) program were examined at the item level using data from the 1990, 1992, and 1996 NAEP state administrations. The item-level data from the State NAEP for grade 8 from 1990, 1992, and 1996 and for grade 4 from 1992, and 1996 were examined applying methodology developed for the study of dif...

H susceptibility is a measured by how easily a person can be hypnotized (2). There are several types of scales used; among all of them, the Harvard Group Scale of Hypnotic Susceptibility (HGSHS) (3,4,5) and the Stanford Hypnotic Susceptibility Scales (SHSS) (4,5) are the most common (6). Both of the Standard scales and Harvard scales are connected to the traditional perspective of hypnosis. The...

In this research, we use Item Response Theory based model for computing procedural knowledge of a sample of primary school children solving fraction addition exercises. For each exercise, the model needs to automatically construct a solution graph. We have explored different strategies for building such graphs and the effects they have on the quality of the model predictions. The results obtain...

This study investigates differences in the partial scoring performance of examinees in elimination testing and conventional dichotomous scoring of multiple-choice tests implemented on a computer-based system. Elimination testing that uses the same set of multiple-choice items rewards examinees with partial knowledge over those who are simply guessing. This study provides a computer-based test a...

SIETTE is an efficient web-based implementation of a Computer Adaptive Test. The inference machine used is based on Item Response Theory. New enhances in the evaluation mechanisms, question selection and finalization criteria have been introduced. New evaluation mechanism allows giving structured knowledge estimation about all topics evaluated in a test. Question selection criteria are able to ...

The validation of models for skills assessment is often conducted by using simulated students because their skills mastery can be predefined. Student performance data is generated according to the predefined skills and models are trained over this data. The accuracy of model skill predictions can thereafter be verified by comparing the predefined skills with the predicted ones. We investigate t...

One of the most popular student modeling techniques currently available is Constraint Based Modeling (CBM), which is based on Ohlsson's theory of learning from performance errors. It focuses on the domain principles to correct faulty knowledge and assumes that a student will reach a correct solution without violating these fundamental domain concepts. However, even though this is a powerful and...