Cloze tests have been widely used for measuring reading comprehension, readability and language proficiency. There is still much controversy on what it really is that cloze measures. The result of much correlational research is contradictory and very unsatisfactory. Thus, with a qualitative orientation, this study attempts to look at the judgmental validity of cloze as a test of reading compreh...

Most of the previous work on cloze prediction focused on grammar testing such as preposition generation. In this paper we explore a different problem on knowledge testing by designing a system to automatically generate blanks for cloze test. We present a cross-document Information Extraction (IE) driven approach, and compare its performance on two different tasks with and without background doc...

This paper studies the problem of automated educational test generation. We describe a procedure for generating cloze test items from Russian-language text, which consists of three steps: sentence splitting, sentence filtering, and question generation. The sentence filtering issue is discussed as an application of automatic summarization techniques. We describe a simple experimental system whic...

1 We report experience in applying techniques for natural language processing to algorithmically generating test items for both reading and listening cloze items. We propose a word sense disambiguationbased method for locating sentences in which designated words carry specific senses, and apply a collocation-based method for selecting distractors that are necessary for multiple-choice cloze ite...

We propose a method to generate high-quality cloze test questions using a computational approach. Previous methods for automatic cloze test generation have contained some problems; specifically, there can be multiple correct answers. We found that approximately 50% of the generated answers have such errors with previous methods, which requires human post-editing was necessary in previous resear...

Cloze test is widely adopted in language exams to evaluate students’ language proficiency. In this paper, we propose the first large-scale human-designed cloze test dataset CLOTH 1, in which the questions were used in middle-school and high-school language exams. With the missing blanks carefully created by teachers and candidate choices purposely designed to be confusing, CLOTH requires a deep...

test method facet is one of the factors which can have an influence on the test takers’ performance. the purpose of the current study was to investigate the effects of two different response types, multiple-choice cloze and multiple-choice test, on the pre-intermediate and intermediate test takers’ reading comprehension performance. to this end, 40 pre-intermediate and intermediate learners par...

More innovative test methods may measure language learners’ test performance more accurately, contributing to much fairer decisions. This study examined Iranian language learners’ performance on cloze-elide test as an innovative, integrative test method. It specifically focused on investigating whether personality types correlated with their performance and whether personality types could predi...