We describe a methodology for improving the generation of multiple-choice test items through the usage of language technologies. We apply common natural language processing techniques, like constituency parsing and automatic term extraction together with additional morphosyntactic rules on raw instructional material in order to determine its key terms. These key terms are then used for the crea...

This study was an attemptto provide detailed information of the strengths and weaknesses of test takers‟ real ability through cognitive diagnostic assessment, and to detect differential item functioning in each test item. The rationale for using CDA was that it estimates an item‟s discrimination power, whereas clas- sical test theory or item response theory depicts between rather within item mu...

veryfew attempts have been made in the past to develop instruments to measure pragmatic knowledge of second language (l2) learners. the absence of such instruments in the literature of english language teaching (elt) underscores the need for the researchers to develop new tests that are specifically designed to assess this crucial but less explored aspect of language learners’ (lls) knowledge. ...

Mixed format tests (e.g., a test consisting of multiple-choice [MC] items and constructed response [CR] items) have become increasingly popular. However, the latent structure of item pools consisting of the two formats is still equivocal. Moreover, the implications of this latent structure are unclear: For example, do constructed response items tap reasoning skills that cannot be assessed with ...

BACKGROUND This study investigated the impact of addressing item writing flaws, testing at low cognitive level and non-functioning distractors (< 5 % selection frequency) in multiple-choice assessment in preclinical medical education. METHOD Multiple-choice questions with too high or too low difficulty (difficulty index < 0.4 or > 0.8) and insufficient discriminatory ability (point-biserial c...

Background and Aim: The aim of this study was to evaluate the structural integrity of multiple-choice questions according to the Millman checklist, and to assess thedistinguishing power of these questions between weak and strong students in theoretical courses of Periodontics in an academic year (2014-15) in Dental Branch of Tehran Islamic Azad University. Materials and Methods: A total of...

Aberrations in eating patterns constitute a substantial public health burden. Computer-based paradigms that measure responses to images of foods are potentially useful tools for assessing food attitudes and characteristics of eating behavior. In particular, food choice tasks attempt to directly probe aspects of individuals' decisions about what to eat. In the Food Choice Task participants rate ...

This work studies the psychometric properties of the multiple choice tests used to assess skills in Statistics in the Integrated Masters Degree in Engineering and Industrial Management of the University of Minho. The results show the importance of measuring the quality of the instruments to a fair assessment of the students. Moreover, in the Bologna Process context, multiple choice tests in com...

A taxonomy of 31 multiple-choice item-writing guidelines was validated through a logical process that included two sources of evidence: the consensus achieved from reviewing what was found in 27 textbooks on educational testing and the results of 27 research studies and reviews published since 1990. This taxonomy is mainly intended for classroom assessment. Because textbooks have potential to e...