PURPOSE The reliability of test is determined by each items' characteristics. Item analysis is achieved by classical test theory and item response theory. The purpose of the study was to compare the discrimination indices with item response theory using the Rasch model. METHODS Thirty-one 4th-year medical school students participated in the clinical course written examination, which included ...

PURPOSE To assess and re-engineer the Vision Core Measure 1 (VCM1) questionnaire in low vision (LV) and cataract participants using Rasch analysis. METHODS 295 participants drawn from a low vision clinic and 181 from a cataract surgery waiting list completed the 10-item VCM1. Unidimensionality, item fit to the model, response category performance, differential item functioning (DIF) and targe...

The authors compared the fit of the 2- and 3-parameter logistic models (2PLM; 3PLM) on 15 unidimensional factor scales derived from the Minnesota Multiphasic Personality Inventory--Adolescent item pool. Log-likelihood chi-square deviance tests indicated that a 3PLM provided an improved fit. However, residual statistics indicated that the difference in fit between the 2 models was negligible. An...

An item-fit index is a measure of how accurately a set of item responses can be predicted by the test design model. In a diagnostic assessment where items test student mastery on a cognitive model of skills, such an index is needed to determine the alignment between the item responses and skills that each item is designed to measure. In this study, we introduce the Item Consistency Index (ICI),...

This study investigated the factorial validity of the 33-item self-rated Emotional Intelligence Scale (EIS: Schutte et al., 1998) for use with athletes. In stage 1, content validity of the EIS was assessed by a panel of experts (n = 9). Items were evaluated in terms of whether they assessed EI related to oneself and EI focused on others. Content validity further examined items in terms of aware...

OBJECTIVE Pediatric somatization studies have used the 35-item Child Somatization Inventory (CSI-35) or psychometrically refined 24-item CSI (CSI-24). Exploratory factor analysis of the CSI-24 has identified a single factor that did not show good model fit in confirmatory factor analysis (CFA). Further evaluation of the CSI-24 factor structure is needed. METHODS The present study examined alt...

This study investigated the utility of all of the above (AOTA) as a test option in multiple-choice items. It aimed at estimating item fit, item difficulty, item discrimination, and guess factor of such a choice. Five reading passages of the Key English Test (KET, 2010) were adapted. The test was reconstructed in 2 parallel forms: Test 1 did not include the abovementioned alternative, whereas Te...

The article provides an overview of goodness-of-fit assessment methods for item response theory (IRT) models. It is now possible to obtain accurate p-values of the overall fit of the model if bivariate information statistics are used. Several alternative approaches are described. As the validity of inferences drawn on the fitted model depends on the magnitude of the misfit, if the model is reje...