Using Automatic Item Generation to Address Item Demands for CAT
نویسندگان
چکیده
Item writing is a craft that is both resource intensive and time consuming. In order to minimize item exposure, computer adaptive testing requires a large number of test items for administration. As test development become more complex, demand for the quantity and quality of items far exceeds the capacity of item writers writing in the current fashion. To address the demand for items to be created in a precise and high-volume fashion, this study suggests the use of automatic item generation (AIG) as a solution to current test development practices. The purpose of this paper is to explore development preferences of item models under AIG, using an item model taxonomy. After adequate training, 34 item models were created and categorized under the taxonomy, and generated 64,280 items. Implications from the study and potential challenges for applying AIG are discussed.
منابع مشابه
Establishing Item Uniqueness for Automatic Item Generation
Objective The growing popularity of Automatic Item Generation (AIG) can be attributed to the increasing demand for the production of large pools of operational test items. AIG is an algorithmic way of generating assessment tasks which combines cognitive theories, psychometric practices and computer technologies. The outcome of this algorithmic transcriptions of assessment task is 1986). The ite...
متن کاملMultidimensional Computerized Adaptive Testing in Recovering Reading and Mathematics Abilities
Under a MIRT CAT’s (multidimensional computerized adaptive testing) testing scenario, an ability estimate in one dimension will provide clues for subsequently seeking a solution in other dimensions. This feature may enhance the efficiency of MIRT CAT’s item selection as well as its scoring algorithms compared with its counterpart, unidimensional CAT (UCAT). The shadow test approach ( van der Li...
متن کاملAutomatic Item Text Generation in Educational Assessment
We present an automatic text generation system (ATG) developed for the generation of natural language text for automatically produced test items. This ATG has been developed to work with an automatic item generation system for analytical reasoning items for use in tests with high-stakes outcomes (such as college admissions decisions). As such, the development and implementation of this ATG is c...
متن کاملControlling item difficulty for automatic vocabulary question generation
The present study investigates the best factor for controlling the item difficulty of multiple-choice English vocabulary questions generated by an automatic question generation system. Three factors are considered for controlling item difficulty: (1) reading passage difficulty, (2) semantic similarity between the correct answer and distractors, and (3) the distractor word difficulty level. An e...
متن کاملAdaptive evaluation in an E-Learning System Architecture
This paper presents the result of the integration of an automatic evaluation module in ELSA, a complete, user-friendly and easy-to-use e-learning environment. Although this new module is already operative, it is in the marketing phase to be included both in BOGA, the commercial version of ELSA to be used on Internet, and in Hezinet, the version nowadays employed as a complementary tool in class...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2010